2024-04-26T12:08:12.436 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T12:08:12.436 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/admin_socket_objecter_requests thrashosds-health} --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --owner scheduled_teuthology@teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210 -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/orig.config.yaml 2024-04-26T12:08:12.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:08:12.550 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674210' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaNAUt6GuelCRjv1dVkjGYFvdyPMzmppkUcUiQQPUtnPF5P2Ly4lY2JuF2thyyD7vYdMiOwH9YCUwer279NnBw= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDES9ND8XySIjmk9rbd0xqSJlgKRkLH5SMcN9+5YSIuH3/b8eKdHdMsOCInzV4VJfRtFpzvvIEA+sfrCwCDAUb4= smithi113.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6SBHf61L2KmyskMFFMeS3TTsIorAupTnBwQcH41RdC1npfdL4c47PGs+HKtPgtF/d6/MFr1O7hmH0urSSnlKE= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ+zURNpc8zWUBRLLJhg+B64K/K+Jz3m8dysn/6hiWnBr6mxnYYitx1OGMFLfJ2A4PEpW7D8Wzg5zV7rfWjRxFk= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T12:08:12.550 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T12:08:12.551 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T12:08:12.551 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T12:08:12.552 INFO:teuthology.task.internal:Checking packages... 2024-04-26T12:08:12.576 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T12:08:12.576 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T12:08:12.576 INFO:teuthology.packaging:ref: None 2024-04-26T12:08:12.576 INFO:teuthology.packaging:tag: None 2024-04-26T12:08:12.576 INFO:teuthology.packaging:branch: reef 2024-04-26T12:08:12.576 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:08:12.576 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-26T12:08:12.807 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T12:08:12.808 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T12:08:12.815 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T12:08:12.815 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T12:08:12.852 INFO:teuthology.task.internal:Saving configuration 2024-04-26T12:08:12.864 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T12:08:12.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T12:08:12.901 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:02:32.245298', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaNAUt6GuelCRjv1dVkjGYFvdyPMzmppkUcUiQQPUtnPF5P2Ly4lY2JuF2thyyD7vYdMiOwH9YCUwer279NnBw='} 2024-04-26T12:08:12.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:02:32.247232', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDES9ND8XySIjmk9rbd0xqSJlgKRkLH5SMcN9+5YSIuH3/b8eKdHdMsOCInzV4VJfRtFpzvvIEA+sfrCwCDAUb4='} 2024-04-26T12:08:12.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:02:32.248839', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6SBHf61L2KmyskMFFMeS3TTsIorAupTnBwQcH41RdC1npfdL4c47PGs+HKtPgtF/d6/MFr1O7hmH0urSSnlKE='} 2024-04-26T12:08:12.964 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:02:32.250450', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ+zURNpc8zWUBRLLJhg+B64K/K+Jz3m8dysn/6hiWnBr6mxnYYitx1OGMFLfJ2A4PEpW7D8Wzg5zV7rfWjRxFk='} 2024-04-26T12:08:12.964 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T12:08:12.970 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T12:08:12.970 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['osd.0'] 2024-04-26T12:08:12.970 INFO:teuthology.task.internal:roles: ubuntu@smithi113.front.sepia.ceph.com - ['osd.1'] 2024-04-26T12:08:12.970 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['osd.2'] 2024-04-26T12:08:12.970 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T12:08:13.115 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb8cddab0d0>, signals=[15]) 2024-04-26T12:08:13.115 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T12:08:13.122 INFO:teuthology.task.internal:Opening connections... 2024-04-26T12:08:13.122 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2024-04-26T12:08:13.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:08:13.208 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T12:08:13.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:08:13.292 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:08:13.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:08:13.384 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T12:08:13.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:08:13.472 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T12:08:13.479 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-04-26T12:08:13.497 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-04-26T12:08:13.497 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-04-26T12:08:13.554 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-04-26T12:08:13.554 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-04-26T12:08:13.554 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-04-26T12:08:13.554 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:08:13.555 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-04-26T12:08:13.555 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-04-26T12:08:13.555 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T12:08:13.555 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-04-26T12:08:13.555 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-04-26T12:08:13.555 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T12:08:13.556 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:08:13.556 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:08:13.556 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T12:08:13.556 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:08:13.556 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-04-26T12:08:13.739 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-04-26T12:08:13.758 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-04-26T12:08:13.758 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-26T12:08:13.815 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-26T12:08:13.815 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-26T12:08:13.815 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-26T12:08:13.815 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:08:13.815 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-26T12:08:13.815 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T12:08:13.816 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:08:13.817 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-26T12:08:13.834 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-04-26T12:08:13.852 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-04-26T12:08:13.852 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-04-26T12:08:13.909 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-04-26T12:08:13.909 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2024-04-26T12:08:13.909 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-04-26T12:08:13.909 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:08:13.909 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2024-04-26T12:08:13.909 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T12:08:13.910 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:08:13.910 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-04-26T12:08:13.934 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-26T12:08:13.952 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-26T12:08:13.952 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-26T12:08:14.009 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-26T12:08:14.009 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-26T12:08:14.009 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-26T12:08:14.009 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:08:14.009 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T12:08:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:08:14.010 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-26T12:08:14.034 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T12:08:14.043 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T12:08:14.075 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T12:08:14.075 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:08:14.078 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:08:14.080 DEBUG:teuthology.orchestra.run.smithi113:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:08:14.083 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:08:14.099 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T12:08:14.104 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T12:08:14.105 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:08:14.135 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:08:14.138 DEBUG:teuthology.orchestra.run.smithi113:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:08:14.140 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:08:14.251 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T12:08:14.967 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T12:08:15.200 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T12:08:15.200 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T12:08:15.200 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:08:15.201 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:08:15.201 DEBUG:teuthology.orchestra.run.smithi113:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:08:15.201 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:08:15.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:15.220 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2024-04-26T12:08:15.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:15.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:15.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:15.223 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-04-26T12:08:15.223 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2024-04-26T12:08:15.223 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-26T12:08:15.278 INFO:teuthology.orchestra.run.smithi113.stdout:5.14.0-437.el9.x86_64 2024-04-26T12:08:15.278 INFO:teuthology.task.kernel:Running kernel on smithi113: 5.14.0-437.el9.x86_64 2024-04-26T12:08:15.278 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum install -y kernel 2024-04-26T12:08:15.281 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-437.el9.x86_64 2024-04-26T12:08:15.281 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-437.el9.x86_64 2024-04-26T12:08:15.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-04-26T12:08:15.283 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-437.el9.x86_64 2024-04-26T12:08:15.283 INFO:teuthology.orchestra.run.smithi069.stdout:5.14.0-437.el9.x86_64 2024-04-26T12:08:15.283 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-437.el9.x86_64 2024-04-26T12:08:15.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-04-26T12:08:15.284 INFO:teuthology.task.kernel:Running kernel on smithi069: 5.14.0-437.el9.x86_64 2024-04-26T12:08:15.284 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum install -y kernel 2024-04-26T12:08:17.837 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.0 MB 00:00 2024-04-26T12:08:18.163 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.0 MB 00:01 2024-04-26T12:08:18.470 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-04-26T12:08:18.582 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.0 MB 00:01 2024-04-26T12:08:19.912 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-26T12:08:20.198 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-26T12:08:20.710 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-26T12:08:21.505 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 19 MB 00:01 2024-04-26T12:08:23.963 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T12:08:24.323 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T12:08:24.991 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.2 MB 00:00 2024-04-26T12:08:25.613 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-26T12:08:25.819 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-04-26T12:08:26.013 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-26T12:08:26.539 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-26T12:08:27.214 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-26T12:08:27.545 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-26T12:08:27.714 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-26T12:08:28.801 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 21 MB 00:02 2024-04-26T12:08:29.032 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-26T12:08:32.255 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-26T12:08:32.670 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-26T12:08:33.824 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-26T12:08:34.071 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T12:08:34.111 INFO:teuthology.orchestra.run.smithi113.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T12:08:34.111 INFO:teuthology.orchestra.run.smithi113.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T12:08:34.206 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-26T12:08:34.206 INFO:teuthology.orchestra.run.smithi113.stdout:Nothing to do. 2024-04-26T12:08:34.206 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-04-26T12:08:34.316 DEBUG:teuthology.orchestra.run.smithi113:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:08:34.500 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T12:08:34.500 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T12:08:34.598 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T12:08:34.599 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-04-26T12:08:34.599 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-04-26T12:08:34.699 DEBUG:teuthology.orchestra.run.smithi070:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:08:34.809 INFO:teuthology.orchestra.run.smithi113.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 12:08:32 PM UTC. 2024-04-26T12:08:34.927 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:Reinstalling: 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 255 k 2024-04-26T12:08:34.943 INFO:teuthology.orchestra.run.smithi113.stdout:Installed size: 0 2024-04-26T12:08:34.944 INFO:teuthology.orchestra.run.smithi113.stderr:Operation aborted. 2024-04-26T12:08:35.005 INFO:teuthology.orchestra.run.smithi113.stdout:Is this ok [y/N]: 2024-04-26T12:08:35.005 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum reinstall -y kernel || true 2024-04-26T12:08:35.196 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:08:32 PM UTC. 2024-04-26T12:08:35.314 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T12:08:35.321 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T12:08:35.321 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:35.321 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout:Reinstalling: 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 255 k 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 0 2024-04-26T12:08:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:Operation aborted. 2024-04-26T12:08:35.382 INFO:teuthology.orchestra.run.smithi070.stdout:Is this ok [y/N]: 2024-04-26T12:08:35.382 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum reinstall -y kernel || true 2024-04-26T12:08:35.495 INFO:teuthology.orchestra.run.smithi113.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:08:32 PM UTC. 2024-04-26T12:08:35.612 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout:Reinstalling: 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-04-26T12:08:35.613 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-26T12:08:35.614 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:08:35.614 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 255 k 2024-04-26T12:08:35.614 INFO:teuthology.orchestra.run.smithi113.stdout:Installed size: 0 2024-04-26T12:08:35.614 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2024-04-26T12:08:35.672 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T12:08:35.672 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T12:08:35.757 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-26T12:08:35.758 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-26T12:08:35.759 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-26T12:08:35.862 DEBUG:teuthology.orchestra.run.smithi069:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:08:35.873 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:08:32 PM UTC. 2024-04-26T12:08:35.874 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-26T12:08:35.874 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:08:35.875 INFO:teuthology.orchestra.run.smithi113.stdout:Total 975 kB/s | 255 kB 00:00 2024-04-26T12:08:35.895 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2024-04-26T12:08:35.927 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T12:08:35.927 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T12:08:35.989 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T12:08:35.990 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T12:08:35.990 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:35.990 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T12:08:35.990 INFO:teuthology.orchestra.run.smithi070.stdout:Reinstalling: 2024-04-26T12:08:35.990 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:08:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-04-26T12:08:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-04-26T12:08:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:08:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 255 k 2024-04-26T12:08:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 0 2024-04-26T12:08:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-04-26T12:08:36.018 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T12:08:36.019 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T12:08:36.019 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T12:08:36.070 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2024-04-26T12:08:36.070 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2024-04-26T12:08:36.074 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2024-04-26T12:08:36.075 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2024-04-26T12:08:36.152 DEBUG:teuthology.orchestra.run.smithi172:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:08:36.236 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2024-04-26T12:08:36.255 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-26T12:08:36.255 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:08:36.255 INFO:teuthology.orchestra.run.smithi070.stdout:Total 960 kB/s | 255 kB 00:00 2024-04-26T12:08:36.271 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-04-26T12:08:36.333 INFO:teuthology.orchestra.run.smithi113.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:36.333 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:36.400 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:08:33 PM UTC. 2024-04-26T12:08:36.466 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-04-26T12:08:36.466 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-04-26T12:08:36.471 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-04-26T12:08:36.471 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-04-26T12:08:36.529 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalling: 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:08:36.537 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 255 k 2024-04-26T12:08:36.538 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 0 2024-04-26T12:08:36.538 INFO:teuthology.orchestra.run.smithi069.stderr:Operation aborted. 2024-04-26T12:08:36.590 INFO:teuthology.orchestra.run.smithi069.stdout:Is this ok [y/N]: 2024-04-26T12:08:36.590 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum reinstall -y kernel || true 2024-04-26T12:08:36.627 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-04-26T12:08:36.653 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:08:33 PM UTC. 2024-04-26T12:08:36.706 INFO:teuthology.orchestra.run.smithi070.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:36.706 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:36.782 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T12:08:36.790 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T12:08:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-26T12:08:36.791 INFO:teuthology.orchestra.run.smithi172.stderr:Operation aborted. 2024-04-26T12:08:36.855 INFO:teuthology.orchestra.run.smithi172.stdout:Is this ok [y/N]: 2024-04-26T12:08:36.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum reinstall -y kernel || true 2024-04-26T12:08:37.067 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:37.067 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:37.079 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 12:08:33 PM UTC. 2024-04-26T12:08:37.195 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalling: 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 255 k 2024-04-26T12:08:37.196 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 0 2024-04-26T12:08:37.197 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-26T12:08:37.324 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:37.324 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:37.347 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 12:08:33 PM UTC. 2024-04-26T12:08:37.465 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T12:08:37.465 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:08:37.466 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-26T12:08:37.467 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-26T12:08:37.467 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T12:08:37.517 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.3 MB/s | 255 kB 00:00 2024-04-26T12:08:37.518 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:08:37.518 INFO:teuthology.orchestra.run.smithi069.stdout:Total 792 kB/s | 255 kB 00:00 2024-04-26T12:08:37.538 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-26T12:08:37.711 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-26T12:08:37.711 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-26T12:08:37.716 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-26T12:08:37.716 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-26T12:08:37.739 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:37.739 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:08:37.739 INFO:teuthology.orchestra.run.smithi113.stdout:Reinstalled: 2024-04-26T12:08:37.740 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:37.740 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:08:37.740 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-04-26T12:08:37.854 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-26T12:08:37.909 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:08:37.935 INFO:teuthology.orchestra.run.smithi069.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:37.935 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:37.955 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:37.956 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T12:08:37.956 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:08:37.956 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T12:08:37.956 DEBUG:teuthology.orchestra.run.smithi113:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:08:37.986 INFO:teuthology.orchestra.run.smithi113.stdout:ttyS1 2024-04-26T12:08:38.011 DEBUG:teuthology.parallel:result is None 2024-04-26T12:08:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:08:38.055 INFO:teuthology.orchestra.run.smithi070.stdout:Reinstalled: 2024-04-26T12:08:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:08:38.055 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-04-26T12:08:38.189 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64.rpm 563 kB/s | 255 kB 00:00 2024-04-26T12:08:38.190 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:08:38.190 INFO:teuthology.orchestra.run.smithi172.stdout:Total 352 kB/s | 255 kB 00:00 2024-04-26T12:08:38.206 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T12:08:38.216 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:08:38.263 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:38.263 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T12:08:38.263 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:08:38.263 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T12:08:38.264 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:08:38.298 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-04-26T12:08:38.315 DEBUG:teuthology.parallel:result is None 2024-04-26T12:08:38.391 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T12:08:38.392 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T12:08:38.396 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T12:08:38.397 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T12:08:38.542 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T12:08:38.603 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:38.603 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:38.615 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:39.300 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:39.301 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:08:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalled: 2024-04-26T12:08:39.301 INFO:teuthology.orchestra.run.smithi069.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:39.301 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:08:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-26T12:08:39.301 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:39.302 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:08:39.454 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:08:39.500 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:39.501 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T12:08:39.501 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:08:39.501 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T12:08:39.501 DEBUG:teuthology.orchestra.run.smithi069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:08:39.534 INFO:teuthology.orchestra.run.smithi069.stdout:ttyS1 2024-04-26T12:08:39.554 DEBUG:teuthology.parallel:result is None 2024-04-26T12:08:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:08:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:08:40.029 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalled: 2024-04-26T12:08:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:08:40.029 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T12:08:40.203 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:08:40.290 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T12:08:40.291 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T12:08:40.291 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:08:40.291 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T12:08:40.292 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:08:40.319 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-04-26T12:08:40.339 DEBUG:teuthology.parallel:result is None 2024-04-26T12:08:40.340 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T12:08:40.347 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T12:08:40.347 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:08:40.351 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:08:40.353 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:08:40.356 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:08:40.395 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T12:08:40.401 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T12:08:40.424 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T12:08:40.424 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:08:40.426 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:08:40.428 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:08:40.431 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:08:40.477 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T12:08:40.484 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T12:08:40.484 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:08:40.487 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:08:40.491 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:08:40.498 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:08:40.513 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.523 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.524 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.534 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.556 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.558 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.567 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.567 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:08:40.569 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T12:08:40.577 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T12:08:40.577 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:08:40.580 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:08:40.582 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:08:40.584 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:08:40.609 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T12:08:40.619 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T12:08:40.620 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:08:40.647 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:08:40.650 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:08:40.652 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:08:40.667 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:40.745 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:40.794 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:40.877 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:40.917 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:08:40.917 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:08:40.982 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:41.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:41.081 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:41.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:41.207 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:08:41.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:08:41.272 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:41.318 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:41.378 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:41.421 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:41.463 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:08:41.463 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:08:41.528 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:41.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:08:41.620 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:41.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:08:41.745 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:08:41.746 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:08:41.811 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2024-04-26T12:08:41.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-04-26T12:08:41.816 DEBUG:teuthology.orchestra.run.smithi113:> sudo service rsyslog restart 2024-04-26T12:08:41.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-04-26T12:08:41.852 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:08:41.853 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:08:41.853 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:08:41.884 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:08:42.362 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T12:08:42.370 INFO:teuthology.task.internal:Starting timer... 2024-04-26T12:08:42.370 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T12:08:42.419 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T12:08:42.442 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2024-04-26T12:08:42.489 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2024-04-26T12:08:42.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-04-26T12:08:42.542 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-04-26T12:08:42.544 DEBUG:teuthology.orchestra.run.smithi113:> sudo service auditd rotate 2024-04-26T12:08:42.614 INFO:teuthology.orchestra.run.smithi113.stdout:Rotating logs: 2024-04-26T12:08:42.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-04-26T12:08:42.668 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-04-26T12:08:42.669 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T12:08:42.670 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2024-04-26T12:08:42.705 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2024-04-26T12:08:42.705 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-04-26T12:08:42.724 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-04-26T12:08:42.724 DEBUG:teuthology.orchestra.run.smithi113:> /usr/sbin/getenforce 2024-04-26T12:08:42.746 INFO:teuthology.orchestra.run.smithi113.stdout:Permissive 2024-04-26T12:08:42.747 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-04-26T12:08:42.766 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-04-26T12:08:42.767 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi113.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-04-26T12:08:42.767 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:08:42.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:42.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:08:42.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:42.818 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:08:42.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:42.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:08:42.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:08:42.873 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T12:08:42.873 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:08:42.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:08:42.923 DEBUG:teuthology.orchestra.run.smithi113:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:08:42.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:08:42.971 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T12:08:42.981 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T12:08:42.986 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T12:08:43.112 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T12:08:43.128 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T12:08:43.129 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi070.front.sepia.ceph.com,smithi113.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:12:19.736 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi113.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-04-26T12:12:19.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-26T12:12:19.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:12:19.814 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-04-26T12:12:19.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-26T12:12:19.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-26T12:12:19.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:12:19.926 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-04-26T12:12:20.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-26T12:12:20.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-26T12:12:20.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:12:20.086 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-04-26T12:12:20.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-26T12:12:20.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T12:12:20.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:12:20.206 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-26T12:12:20.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T12:12:20.287 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:12:20.298 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:12:20.298 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:12:20.299 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:12:20.301 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:12:20.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:12:20.303 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:12:20.304 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:12:20.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:12:20.306 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:12:20.329 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:12:20.333 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:12:20.333 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:12:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:12:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:12:20.348 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:12:20.355 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:12:20.365 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2024-04-26T12:12:20.369 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:12:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: ntpd: command not found 2024-04-26T12:12:20.372 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-04-26T12:12:20.375 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2024-04-26T12:12:20.380 INFO:teuthology.orchestra.run.smithi113.stdout:506 Cannot talk to daemon 2024-04-26T12:12:20.383 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-04-26T12:12:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:12:20.392 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-04-26T12:12:20.393 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:12:20.397 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:12:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:12:20.402 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-04-26T12:12:20.406 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:12:20.411 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:12:20.418 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:12:20.429 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:12:20.457 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:12:20.459 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:12:20.461 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:12:20.461 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-04-26T12:12:20.461 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.461 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.461 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.461 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.463 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:12:20.463 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2024-04-26T12:12:20.463 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.463 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.463 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.463 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:12:20.471 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:12:20.471 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-04-26T12:12:20.471 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.471 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.471 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.471 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.482 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:12:20.486 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:12:20.486 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-26T12:12:20.486 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.486 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.486 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.486 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:12:20.487 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:12:20.495 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:12:20.495 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T12:12:20.496 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T12:12:20.496 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:12:20.501 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:12:20.501 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:12:20.502 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:12:20.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:12:20.504 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:12:20.505 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:12:20.506 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:12:20.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:12:20.507 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:12:20.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:12:20.654 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:12:20.654 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:12:20.657 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:12:20.657 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:12:20.662 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:12:20.662 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:12:20.727 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T12:12:20.728 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:12:20.768 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:12:20.768 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:12:20.768 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:12:20.779 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:12:20.779 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:12:20.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:12:20.782 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:12:20.783 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:12:20.783 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:12:20.802 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:12:20.802 DEBUG:teuthology.orchestra.run.smithi113:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:12:20.807 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:12:20.807 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:12:20.808 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:12:20.808 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:12:20.866 DEBUG:teuthology.orchestra.run.smithi113:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:12:20.871 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:12:20.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:12:20.899 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:12:20.899 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:12:20.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:12:20.924 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:12:20.925 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:12:20.938 DEBUG:teuthology.orchestra.run.smithi113:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:12:20.944 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:12:20.946 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:12:20.990 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:12:21.001 INFO:teuthology.orchestra.run.smithi113.stdout:check_obsoletes = 1 2024-04-26T12:12:21.002 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum clean all 2024-04-26T12:12:21.007 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2024-04-26T12:12:21.008 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2024-04-26T12:12:21.009 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-04-26T12:12:21.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-04-26T12:12:21.065 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:12:21.129 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-04-26T12:12:21.131 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-04-26T12:12:21.226 INFO:teuthology.orchestra.run.smithi113.stdout:48 files removed 2024-04-26T12:12:21.231 INFO:teuthology.orchestra.run.smithi069.stdout:48 files removed 2024-04-26T12:12:21.234 INFO:teuthology.orchestra.run.smithi070.stdout:48 files removed 2024-04-26T12:12:21.253 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:12:21.257 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:12:21.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:12:21.357 INFO:teuthology.orchestra.run.smithi172.stdout:48 files removed 2024-04-26T12:12:21.385 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:12:21.862 INFO:teuthology.orchestra.run.smithi113.stdout:ceph packages for x86_64 220 kB/s | 77 kB 00:00 2024-04-26T12:12:21.914 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 194 kB/s | 77 kB 00:00 2024-04-26T12:12:21.984 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 166 kB/s | 77 kB 00:00 2024-04-26T12:12:22.068 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 183 kB/s | 77 kB 00:00 2024-04-26T12:12:22.256 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-04-26T12:12:22.261 INFO:teuthology.orchestra.run.smithi113.stdout:ceph noarch packages 32 kB/s | 11 kB 00:00 2024-04-26T12:12:22.360 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-26T12:12:22.427 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-26T12:12:22.587 INFO:teuthology.orchestra.run.smithi113.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-04-26T12:12:22.607 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-26T12:12:22.710 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-26T12:12:22.836 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-26T12:12:23.190 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-26T12:12:23.235 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-26T12:12:23.413 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T12:12:25.249 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-26T12:12:25.452 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-26T12:12:25.810 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-26T12:12:26.930 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.0 MB 00:04 2024-04-26T12:12:28.706 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-04-26T12:12:29.566 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.2 MB 00:00 2024-04-26T12:12:29.786 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T12:12:29.914 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-26T12:12:31.223 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-26T12:12:31.337 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-04-26T12:12:32.660 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T12:12:32.940 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.2 MB 00:00 2024-04-26T12:12:33.088 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-26T12:12:35.272 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-26T12:12:36.657 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-26T12:12:37.715 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T12:12:38.388 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 5.8 kB/s | 1.7 kB 00:00 2024-04-26T12:12:39.822 INFO:teuthology.orchestra.run.smithi113.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:39.822 INFO:teuthology.orchestra.run.smithi113.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:39.888 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-26T12:12:39.895 INFO:teuthology.orchestra.run.smithi113.stdout:======================================================================================= 2024-04-26T12:12:39.895 INFO:teuthology.orchestra.run.smithi113.stdout: Package Arch Version Repository Size 2024-04-26T12:12:39.896 INFO:teuthology.orchestra.run.smithi113.stdout:======================================================================================= 2024-04-26T12:12:39.896 INFO:teuthology.orchestra.run.smithi113.stdout:Installing: 2024-04-26T12:12:39.896 INFO:teuthology.orchestra.run.smithi113.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:12:39.896 INFO:teuthology.orchestra.run.smithi113.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:12:39.896 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:12:39.897 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:12:39.898 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrading: 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:39.899 INFO:teuthology.orchestra.run.smithi113.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout:Installing dependencies: 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:12:39.900 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:12:39.901 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:12:39.902 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:12:39.903 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:12:39.904 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:12:39.905 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:12:39.906 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout:======================================================================================= 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout:Install 123 Packages 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrade 4 Packages 2024-04-26T12:12:39.907 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:12:39.908 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 189 M 2024-04-26T12:12:39.908 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2024-04-26T12:12:40.480 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:40.481 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:40.546 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-04-26T12:12:40.553 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-04-26T12:12:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-04-26T12:12:40.553 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-04-26T12:12:40.553 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-04-26T12:12:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:12:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:12:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:12:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:12:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:12:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:12:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:12:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:12:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:12:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:12:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:12:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:12:40.563 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-04-26T12:12:40.564 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-04-26T12:12:40.564 INFO:teuthology.orchestra.run.smithi070.stdout:Install 123 Packages 2024-04-26T12:12:40.564 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 4 Packages 2024-04-26T12:12:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:12:40.564 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 189 M 2024-04-26T12:12:40.564 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-04-26T12:12:41.114 INFO:teuthology.orchestra.run.smithi070.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2024-04-26T12:12:41.706 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-26T12:12:41.714 INFO:teuthology.orchestra.run.smithi070.stdout:(2/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 6.1 MB/s | 5.1 MB 00:00 2024-04-26T12:12:41.790 INFO:teuthology.orchestra.run.smithi070.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 1.9 MB/s | 142 kB 00:00 2024-04-26T12:12:41.965 INFO:teuthology.orchestra.run.smithi070.stdout:(4/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 997 kB/s | 848 kB 00:00 2024-04-26T12:12:42.090 INFO:teuthology.orchestra.run.smithi070.stdout:(5/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 7.0 MB/s | 2.1 MB 00:00 2024-04-26T12:12:42.699 INFO:teuthology.orchestra.run.smithi070.stdout:(6/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 7.7 MB/s | 4.7 MB 00:00 2024-04-26T12:12:42.741 INFO:teuthology.orchestra.run.smithi113.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2024-04-26T12:12:42.916 INFO:teuthology.orchestra.run.smithi070.stdout:(7/127): ceph-common-18.2.2-1256.gdc093b5e.el9. 9.0 MB/s | 18 MB 00:02 2024-04-26T12:12:42.966 INFO:teuthology.orchestra.run.smithi070.stdout:(8/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 1.5 MB/s | 1.5 MB 00:01 2024-04-26T12:12:43.074 INFO:teuthology.orchestra.run.smithi070.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 232 kB/s | 25 kB 00:00 2024-04-26T12:12:43.175 INFO:teuthology.orchestra.run.smithi113.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.9 MB/s | 848 kB 00:00 2024-04-26T12:12:43.283 INFO:teuthology.orchestra.run.smithi113.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 1.3 MB/s | 142 kB 00:00 2024-04-26T12:12:43.841 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:43.842 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:43.850 INFO:teuthology.orchestra.run.smithi113.stdout:(4/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 3.7 MB/s | 2.1 MB 00:00 2024-04-26T12:12:43.907 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T12:12:43.914 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-26T12:12:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-26T12:12:43.915 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-26T12:12:43.915 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T12:12:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:12:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:12:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:12:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:12:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:12:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:12:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:12:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:12:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:12:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:12:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:12:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:12:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:12:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:12:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:12:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:12:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:12:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:12:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:12:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:12:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:12:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:12:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:12:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:12:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:12:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:12:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:12:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:12:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:12:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:12:43.922 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-04-26T12:12:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:12:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:12:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:12:43.923 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-26T12:12:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:12:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:12:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:12:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:12:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:12:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:12:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:12:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:12:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:12:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:12:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:12:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:12:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:12:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:12:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:12:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:12:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:12:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:12:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:12:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:12:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:12:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:12:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:12:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:12:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:12:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:12:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:12:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:12:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:12:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:12:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:12:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:12:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:12:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:12:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:12:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:12:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:12:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:12:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:12:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:12:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:12:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:12:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:12:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:12:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:12:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:12:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:12:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:12:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:12:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:12:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:12:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:12:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:12:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:12:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:12:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:12:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:12:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:12:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:12:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:12:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:12:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:12:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:12:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:12:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:12:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:12:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:12:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:12:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:12:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:12:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:12:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:12:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:12:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:12:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:12:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:12:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:12:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:12:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:12:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:12:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:12:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:12:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:12:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:12:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:12:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:12:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:12:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:12:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:12:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:12:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:12:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:12:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:12:43.940 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T12:12:43.940 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-26T12:12:43.941 INFO:teuthology.orchestra.run.smithi172.stdout:Install 123 Packages 2024-04-26T12:12:43.941 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 4 Packages 2024-04-26T12:12:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:12:43.942 INFO:teuthology.orchestra.run.smithi070.stdout:(10/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el 7.6 MB/s | 7.7 MB 00:01 2024-04-26T12:12:43.943 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 189 M 2024-04-26T12:12:43.943 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T12:12:44.008 INFO:teuthology.orchestra.run.smithi070.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 415 kB/s | 31 kB 00:00 2024-04-26T12:12:44.092 INFO:teuthology.orchestra.run.smithi113.stdout:(5/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 6.0 MB/s | 1.5 MB 00:00 2024-04-26T12:12:44.167 INFO:teuthology.orchestra.run.smithi070.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 4.4 MB/s | 710 kB 00:00 2024-04-26T12:12:44.282 INFO:teuthology.orchestra.run.smithi070.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.4 MB/s | 166 kB 00:00 2024-04-26T12:12:44.375 INFO:teuthology.orchestra.run.smithi070.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 1.3 MB/s | 126 kB 00:00 2024-04-26T12:12:44.674 INFO:teuthology.orchestra.run.smithi172.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 17 kB/s | 6.5 kB 00:00 2024-04-26T12:12:44.850 INFO:teuthology.orchestra.run.smithi113.stdout:(6/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 6.2 MB/s | 4.7 MB 00:00 2024-04-26T12:12:45.034 INFO:teuthology.orchestra.run.smithi070.stdout:(15/127): libradosstriper1-18.2.2-1256.gdc093b5 720 kB/s | 474 kB 00:00 2024-04-26T12:12:45.491 INFO:teuthology.orchestra.run.smithi172.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.0 MB/s | 848 kB 00:00 2024-04-26T12:12:45.559 INFO:teuthology.orchestra.run.smithi070.stdout:(16/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 5.8 MB/s | 17 MB 00:02 2024-04-26T12:12:45.651 INFO:teuthology.orchestra.run.smithi070.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 492 kB/s | 45 kB 00:00 2024-04-26T12:12:45.666 INFO:teuthology.orchestra.run.smithi172.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 816 kB/s | 142 kB 00:00 2024-04-26T12:12:45.734 INFO:teuthology.orchestra.run.smithi113.stdout:(7/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 1.5 MB/s | 5.1 MB 00:03 2024-04-26T12:12:45.745 INFO:teuthology.orchestra.run.smithi070.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.4 MB/s | 129 kB 00:00 2024-04-26T12:12:45.843 INFO:teuthology.orchestra.run.smithi070.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 1.6 MB/s | 162 kB 00:00 2024-04-26T12:12:45.943 INFO:teuthology.orchestra.run.smithi070.stdout:(20/127): python3-rados-18.2.2-1256.gdc093b5e.e 3.1 MB/s | 320 kB 00:00 2024-04-26T12:12:46.627 INFO:teuthology.orchestra.run.smithi070.stdout:(21/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 436 kB/s | 298 kB 00:00 2024-04-26T12:12:46.749 INFO:teuthology.orchestra.run.smithi172.stdout:(4/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 1.9 MB/s | 2.1 MB 00:01 2024-04-26T12:12:46.833 INFO:teuthology.orchestra.run.smithi172.stdout:(5/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 2.0 MB/s | 5.1 MB 00:02 2024-04-26T12:12:46.878 INFO:teuthology.orchestra.run.smithi070.stdout:(22/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 398 kB/s | 99 kB 00:00 2024-04-26T12:12:47.052 INFO:teuthology.orchestra.run.smithi070.stdout:(23/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 495 kB/s | 87 kB 00:00 2024-04-26T12:12:47.224 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 1.0 kB/s | 16 kB 00:16 2024-04-26T12:12:47.486 INFO:teuthology.orchestra.run.smithi070.stdout:(24/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 1.8 MB/s | 4.5 MB 00:02 2024-04-26T12:12:47.533 INFO:teuthology.orchestra.run.smithi172.stdout:(6/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 1.9 MB/s | 1.5 MB 00:00 2024-04-26T12:12:47.578 INFO:teuthology.orchestra.run.smithi070.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 1.8 MB/s | 172 kB 00:00 2024-04-26T12:12:47.637 INFO:teuthology.orchestra.run.smithi070.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 418 kB/s | 24 kB 00:00 2024-04-26T12:12:47.700 INFO:teuthology.orchestra.run.smithi172.stdout:(7/127): ceph-common-18.2.2-1256.gdc093b5e.el9. 5.4 MB/s | 18 MB 00:03 2024-04-26T12:12:47.746 INFO:teuthology.orchestra.run.smithi070.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.2 MB/s | 138 kB 00:00 2024-04-26T12:12:48.211 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-26T12:12:48.675 INFO:teuthology.orchestra.run.smithi172.stdout:(8/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el9 7.9 MB/s | 7.7 MB 00:00 2024-04-26T12:12:48.759 INFO:teuthology.orchestra.run.smithi172.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 303 kB/s | 25 kB 00:00 2024-04-26T12:12:48.904 INFO:teuthology.orchestra.run.smithi070.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 1.6 MB/s | 3.0 MB 00:01 2024-04-26T12:12:49.617 INFO:teuthology.orchestra.run.smithi172.stdout:(10/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x8 1.7 MB/s | 4.7 MB 00:02 2024-04-26T12:12:49.709 INFO:teuthology.orchestra.run.smithi172.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 340 kB/s | 31 kB 00:00 2024-04-26T12:12:49.721 INFO:teuthology.orchestra.run.smithi070.stdout:(29/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 1.8 MB/s | 3.5 MB 00:01 2024-04-26T12:12:49.888 INFO:teuthology.orchestra.run.smithi070.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 1.4 MB/s | 246 kB 00:00 2024-04-26T12:12:49.972 INFO:teuthology.orchestra.run.smithi070.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 592 kB/s | 49 kB 00:00 2024-04-26T12:12:50.025 INFO:teuthology.orchestra.run.smithi113.stdout:(8/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x86 3.2 MB/s | 17 MB 00:05 2024-04-26T12:12:50.047 INFO:teuthology.orchestra.run.smithi070.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 205 kB/s | 15 kB 00:00 2024-04-26T12:12:50.101 INFO:teuthology.orchestra.run.smithi172.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 1.8 MB/s | 710 kB 00:00 2024-04-26T12:12:50.125 INFO:teuthology.orchestra.run.smithi113.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 252 kB/s | 25 kB 00:00 2024-04-26T12:12:50.197 INFO:teuthology.orchestra.run.smithi070.stdout:(33/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 1.7 MB/s | 264 kB 00:00 2024-04-26T12:12:50.293 INFO:teuthology.orchestra.run.smithi172.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 869 kB/s | 166 kB 00:00 2024-04-26T12:12:50.372 INFO:teuthology.orchestra.run.smithi070.stdout:(34/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 1.3 MB/s | 224 kB 00:00 2024-04-26T12:12:50.401 INFO:teuthology.orchestra.run.smithi172.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 1.1 MB/s | 126 kB 00:00 2024-04-26T12:12:50.467 INFO:teuthology.orchestra.run.smithi113.stdout:(10/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el 1.6 MB/s | 7.7 MB 00:04 2024-04-26T12:12:50.489 INFO:teuthology.orchestra.run.smithi070.stdout:(35/127): fuse-2.9.9-15.el9.x86_64.rpm 690 kB/s | 80 kB 00:00 2024-04-26T12:12:50.556 INFO:teuthology.orchestra.run.smithi070.stdout:(36/127): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2024-04-26T12:12:50.590 INFO:teuthology.orchestra.run.smithi070.stdout:(37/127): libquadmath-11.4.1-3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2024-04-26T12:12:50.592 INFO:teuthology.orchestra.run.smithi113.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 249 kB/s | 31 kB 00:00 2024-04-26T12:12:50.632 INFO:teuthology.orchestra.run.smithi070.stdout:(38/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-26T12:12:50.669 INFO:teuthology.orchestra.run.smithi172.stdout:(15/127): libradosstriper1-18.2.2-1256.gdc093b5 1.7 MB/s | 474 kB 00:00 2024-04-26T12:12:50.699 INFO:teuthology.orchestra.run.smithi070.stdout:(39/127): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-26T12:12:50.732 INFO:teuthology.orchestra.run.smithi070.stdout:(40/127): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-26T12:12:50.766 INFO:teuthology.orchestra.run.smithi070.stdout:(41/127): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-26T12:12:50.800 INFO:teuthology.orchestra.run.smithi070.stdout:(42/127): python3-requests-2.25.1-8.el9.noarch. 3.7 MB/s | 125 kB 00:00 2024-04-26T12:12:50.841 INFO:teuthology.orchestra.run.smithi070.stdout:(43/127): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-04-26T12:12:50.892 INFO:teuthology.orchestra.run.smithi070.stdout:(44/127): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-04-26T12:12:50.951 INFO:teuthology.orchestra.run.smithi070.stdout:(45/127): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-26T12:12:51.017 INFO:teuthology.orchestra.run.smithi070.stdout:(46/127): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-26T12:12:51.059 INFO:teuthology.orchestra.run.smithi113.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 1.5 MB/s | 710 kB 00:00 2024-04-26T12:12:51.059 INFO:teuthology.orchestra.run.smithi070.stdout:(47/127): elfutils-libelf-devel-0.190-2.el9.x86 517 kB/s | 21 kB 00:00 2024-04-26T12:12:51.101 INFO:teuthology.orchestra.run.smithi070.stdout:(48/127): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-04-26T12:12:51.135 INFO:teuthology.orchestra.run.smithi070.stdout:(49/127): flexiblas-3.0.4-8.el9.x86_64.rpm 988 kB/s | 33 kB 00:00 2024-04-26T12:12:51.219 INFO:teuthology.orchestra.run.smithi070.stdout:(50/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-04-26T12:12:51.252 INFO:teuthology.orchestra.run.smithi070.stdout:(51/127): flexiblas-openblas-openmp-3.0.4-8.el9 549 kB/s | 18 kB 00:00 2024-04-26T12:12:51.276 INFO:teuthology.orchestra.run.smithi113.stdout:(13/127): ceph-common-18.2.2-1256.gdc093b5e.el9 2.1 MB/s | 18 MB 00:08 2024-04-26T12:12:51.286 INFO:teuthology.orchestra.run.smithi070.stdout:(52/127): libaio-devel-0.3.111-13.el9.x86_64.rp 336 kB/s | 11 kB 00:00 2024-04-26T12:12:51.301 INFO:teuthology.orchestra.run.smithi113.stdout:(14/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 688 kB/s | 166 kB 00:00 2024-04-26T12:12:51.370 INFO:teuthology.orchestra.run.smithi070.stdout:(53/127): ceph-mgr-diskprediction-local-18.2.2- 3.0 MB/s | 7.4 MB 00:02 2024-04-26T12:12:51.376 INFO:teuthology.orchestra.run.smithi113.stdout:(15/127): librados-devel-18.2.2-1256.gdc093b5e. 1.2 MB/s | 126 kB 00:00 2024-04-26T12:12:51.395 INFO:teuthology.orchestra.run.smithi070.stdout:(54/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-26T12:12:51.420 INFO:teuthology.orchestra.run.smithi070.stdout:(55/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-26T12:12:51.454 INFO:teuthology.orchestra.run.smithi070.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-26T12:12:51.487 INFO:teuthology.orchestra.run.smithi070.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 582 kB 00:00 2024-04-26T12:12:51.504 INFO:teuthology.orchestra.run.smithi070.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 520 kB/s | 25 kB 00:00 2024-04-26T12:12:51.521 INFO:teuthology.orchestra.run.smithi070.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-26T12:12:51.555 INFO:teuthology.orchestra.run.smithi070.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-26T12:12:51.568 INFO:teuthology.orchestra.run.smithi113.stdout:(16/127): libradosstriper1-18.2.2-1256.gdc093b5 1.7 MB/s | 474 kB 00:00 2024-04-26T12:12:51.597 INFO:teuthology.orchestra.run.smithi070.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 472 kB/s | 35 kB 00:00 2024-04-26T12:12:51.689 INFO:teuthology.orchestra.run.smithi070.stdout:(62/127): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-04-26T12:12:51.693 INFO:teuthology.orchestra.run.smithi113.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 360 kB/s | 45 kB 00:00 2024-04-26T12:12:51.766 INFO:teuthology.orchestra.run.smithi070.stdout:(63/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-04-26T12:12:51.794 INFO:teuthology.orchestra.run.smithi113.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.3 MB/s | 129 kB 00:00 2024-04-26T12:12:51.873 INFO:teuthology.orchestra.run.smithi070.stdout:(64/127): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 6.0 MB 00:00 2024-04-26T12:12:51.894 INFO:teuthology.orchestra.run.smithi113.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 1.6 MB/s | 162 kB 00:00 2024-04-26T12:12:51.898 INFO:teuthology.orchestra.run.smithi070.stdout:(65/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-26T12:12:51.923 INFO:teuthology.orchestra.run.smithi070.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-26T12:12:51.948 INFO:teuthology.orchestra.run.smithi070.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 517 kB/s | 26 kB 00:00 2024-04-26T12:12:51.974 INFO:teuthology.orchestra.run.smithi070.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-26T12:12:51.999 INFO:teuthology.orchestra.run.smithi070.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T12:12:52.024 INFO:teuthology.orchestra.run.smithi070.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-04-26T12:12:52.078 INFO:teuthology.orchestra.run.smithi113.stdout:(20/127): python3-rados-18.2.2-1256.gdc093b5e.e 1.7 MB/s | 320 kB 00:00 2024-04-26T12:12:52.141 INFO:teuthology.orchestra.run.smithi070.stdout:(71/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-04-26T12:12:52.167 INFO:teuthology.orchestra.run.smithi070.stdout:(72/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-04-26T12:12:52.192 INFO:teuthology.orchestra.run.smithi070.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-26T12:12:52.217 INFO:teuthology.orchestra.run.smithi070.stdout:(74/127): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T12:12:52.243 INFO:teuthology.orchestra.run.smithi070.stdout:(75/127): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-04-26T12:12:52.268 INFO:teuthology.orchestra.run.smithi070.stdout:(76/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T12:12:52.278 INFO:teuthology.orchestra.run.smithi113.stdout:(21/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 1.5 MB/s | 298 kB 00:00 2024-04-26T12:12:52.293 INFO:teuthology.orchestra.run.smithi070.stdout:(77/127): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-26T12:12:52.318 INFO:teuthology.orchestra.run.smithi070.stdout:(78/127): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T12:12:52.343 INFO:teuthology.orchestra.run.smithi070.stdout:(79/127): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T12:12:52.403 INFO:teuthology.orchestra.run.smithi113.stdout:(22/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 797 kB/s | 99 kB 00:00 2024-04-26T12:12:52.594 INFO:teuthology.orchestra.run.smithi070.stdout:(80/127): python3-toml-0.10.2-6.el9.noarch.rpm 167 kB/s | 42 kB 00:00 2024-04-26T12:12:52.679 INFO:teuthology.orchestra.run.smithi113.stdout:(23/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 314 kB/s | 87 kB 00:00 2024-04-26T12:12:52.844 INFO:teuthology.orchestra.run.smithi070.stdout:(81/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-26T12:12:52.869 INFO:teuthology.orchestra.run.smithi070.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-04-26T12:12:52.895 INFO:teuthology.orchestra.run.smithi070.stdout:(83/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-26T12:12:52.920 INFO:teuthology.orchestra.run.smithi070.stdout:(84/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-26T12:12:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:(85/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 862 kB/s | 45 kB 00:00 2024-04-26T12:12:52.952 INFO:teuthology.orchestra.run.smithi172.stdout:(16/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 2.0 MB/s | 4.5 MB 00:02 2024-04-26T12:12:53.060 INFO:teuthology.orchestra.run.smithi172.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 417 kB/s | 45 kB 00:00 2024-04-26T12:12:53.136 INFO:teuthology.orchestra.run.smithi172.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.7 MB/s | 129 kB 00:00 2024-04-26T12:12:53.138 INFO:teuthology.orchestra.run.smithi113.stdout:(24/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 2.5 MB/s | 4.5 MB 00:01 2024-04-26T12:12:53.238 INFO:teuthology.orchestra.run.smithi113.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 1.7 MB/s | 172 kB 00:00 2024-04-26T12:12:53.298 INFO:teuthology.orchestra.run.smithi070.stdout:(86/127): fmt-8.1.1-5.el9.x86_64.rpm 293 kB/s | 111 kB 00:00 2024-04-26T12:12:53.321 INFO:teuthology.orchestra.run.smithi113.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 293 kB/s | 24 kB 00:00 2024-04-26T12:12:53.344 INFO:teuthology.orchestra.run.smithi172.stdout:(19/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 2.8 MB/s | 17 MB 00:05 2024-04-26T12:12:53.370 INFO:teuthology.orchestra.run.smithi172.stdout:(20/127): python3-cephfs-18.2.2-1256.gdc093b5e. 694 kB/s | 162 kB 00:00 2024-04-26T12:12:53.375 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-04-26T12:12:53.405 INFO:teuthology.orchestra.run.smithi113.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.6 MB/s | 138 kB 00:00 2024-04-26T12:12:53.406 INFO:teuthology.orchestra.run.smithi070.stdout:(87/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 673 kB/s | 309 kB 00:00 2024-04-26T12:12:53.490 INFO:teuthology.orchestra.run.smithi070.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-04-26T12:12:53.495 INFO:teuthology.orchestra.run.smithi172.stdout:(21/127): python3-rados-18.2.2-1256.gdc093b5e.e 2.1 MB/s | 320 kB 00:00 2024-04-26T12:12:53.531 INFO:teuthology.orchestra.run.smithi172.stdout:(22/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 1.8 MB/s | 298 kB 00:00 2024-04-26T12:12:53.565 INFO:teuthology.orchestra.run.smithi070.stdout:(89/127): liboath-2.6.7-2.el9.x86_64.rpm 649 kB/s | 49 kB 00:00 2024-04-26T12:12:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:(23/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.0 MB/s | 99 kB 00:00 2024-04-26T12:12:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:(24/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 938 kB/s | 87 kB 00:00 2024-04-26T12:12:53.648 INFO:teuthology.orchestra.run.smithi070.stdout:(90/127): libunwind-1.6.2-1.el9.x86_64.rpm 808 kB/s | 67 kB 00:00 2024-04-26T12:12:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 1.7 MB/s | 172 kB 00:00 2024-04-26T12:12:53.732 INFO:teuthology.orchestra.run.smithi070.stdout:(91/127): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-26T12:12:53.824 INFO:teuthology.orchestra.run.smithi070.stdout:(92/127): python3-asyncssh-2.13.2-5.el9.noarch. 5.9 MB/s | 548 kB 00:00 2024-04-26T12:12:53.849 INFO:teuthology.orchestra.run.smithi070.stdout:(93/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-04-26T12:12:53.891 INFO:teuthology.orchestra.run.smithi070.stdout:(94/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 649 kB/s | 43 kB 00:00 2024-04-26T12:12:53.916 INFO:teuthology.orchestra.run.smithi070.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 481 kB/s | 32 kB 00:00 2024-04-26T12:12:53.967 INFO:teuthology.orchestra.run.smithi070.stdout:(96/127): python3-certifi-2021.10.8-2.el9.noarc 199 kB/s | 15 kB 00:00 2024-04-26T12:12:54.000 INFO:teuthology.orchestra.run.smithi070.stdout:(97/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.0 MB/s | 172 kB 00:00 2024-04-26T12:12:54.042 INFO:teuthology.orchestra.run.smithi070.stdout:(98/127): python3-cherrypy-18.6.1-2.el9.noarch. 4.7 MB/s | 358 kB 00:00 2024-04-26T12:12:54.072 INFO:teuthology.orchestra.run.smithi113.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 2.1 MB/s | 3.0 MB 00:01 2024-04-26T12:12:54.082 INFO:teuthology.orchestra.run.smithi172.stdout:(26/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 7.5 MB/s | 40 MB 00:05 2024-04-26T12:12:54.084 INFO:teuthology.orchestra.run.smithi070.stdout:(99/127): python3-google-auth-2.29.0-1.el9.noar 2.4 MB/s | 206 kB 00:00 2024-04-26T12:12:54.107 INFO:teuthology.orchestra.run.smithi172.stdout:(27/127): ceph-grafana-dashboards-18.2.2-1256.g 64 kB/s | 24 kB 00:00 2024-04-26T12:12:54.118 INFO:teuthology.orchestra.run.smithi070.stdout:(100/127): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-26T12:12:54.149 INFO:teuthology.orchestra.run.smithi172.stdout:(28/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.0 MB/s | 138 kB 00:00 2024-04-26T12:12:54.159 INFO:teuthology.orchestra.run.smithi070.stdout:(101/127): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-26T12:12:54.193 INFO:teuthology.orchestra.run.smithi070.stdout:(102/127): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-04-26T12:12:54.235 INFO:teuthology.orchestra.run.smithi070.stdout:(103/127): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-04-26T12:12:54.269 INFO:teuthology.orchestra.run.smithi070.stdout:(104/127): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T12:12:54.344 INFO:teuthology.orchestra.run.smithi070.stdout:(105/127): python3-logutils-0.3.5-21.el9.noarch 617 kB/s | 46 kB 00:00 2024-04-26T12:12:54.377 INFO:teuthology.orchestra.run.smithi070.stdout:(106/127): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-04-26T12:12:54.422 INFO:teuthology.orchestra.run.smithi070.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-26T12:12:54.439 INFO:teuthology.orchestra.run.smithi113.stdout:(29/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 3.4 MB/s | 3.5 MB 00:01 2024-04-26T12:12:54.453 INFO:teuthology.orchestra.run.smithi070.stdout:(108/127): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-04-26T12:12:54.495 INFO:teuthology.orchestra.run.smithi070.stdout:(109/127): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-26T12:12:54.529 INFO:teuthology.orchestra.run.smithi070.stdout:(110/127): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T12:12:54.571 INFO:teuthology.orchestra.run.smithi070.stdout:(111/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T12:12:54.589 INFO:teuthology.orchestra.run.smithi113.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 1.6 MB/s | 246 kB 00:00 2024-04-26T12:12:54.591 INFO:teuthology.orchestra.run.smithi172.stdout:(29/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 3.0 MB/s | 3.0 MB 00:01 2024-04-26T12:12:54.604 INFO:teuthology.orchestra.run.smithi070.stdout:(112/127): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-04-26T12:12:54.646 INFO:teuthology.orchestra.run.smithi070.stdout:(113/127): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-26T12:12:54.680 INFO:teuthology.orchestra.run.smithi070.stdout:(114/127): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-04-26T12:12:54.681 INFO:teuthology.orchestra.run.smithi113.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 538 kB/s | 49 kB 00:00 2024-04-26T12:12:54.722 INFO:teuthology.orchestra.run.smithi070.stdout:(115/127): python3-tempora-5.0.0-2.el9.noarch.r 476 kB/s | 36 kB 00:00 2024-04-26T12:12:54.733 INFO:teuthology.orchestra.run.smithi172.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 1.7 MB/s | 246 kB 00:00 2024-04-26T12:12:54.755 INFO:teuthology.orchestra.run.smithi070.stdout:(116/127): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-04-26T12:12:54.765 INFO:teuthology.orchestra.run.smithi113.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 184 kB/s | 15 kB 00:00 2024-04-26T12:12:54.814 INFO:teuthology.orchestra.run.smithi070.stdout:(117/127): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-26T12:12:54.817 INFO:teuthology.orchestra.run.smithi172.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 593 kB/s | 49 kB 00:00 2024-04-26T12:12:54.840 INFO:teuthology.orchestra.run.smithi070.stdout:(118/127): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-26T12:12:54.890 INFO:teuthology.orchestra.run.smithi070.stdout:(119/127): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-26T12:12:54.909 INFO:teuthology.orchestra.run.smithi172.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 167 kB/s | 15 kB 00:00 2024-04-26T12:12:54.915 INFO:teuthology.orchestra.run.smithi070.stdout:(120/127): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-04-26T12:12:54.915 INFO:teuthology.orchestra.run.smithi113.stdout:(33/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 1.7 MB/s | 264 kB 00:00 2024-04-26T12:12:55.015 INFO:teuthology.orchestra.run.smithi113.stdout:(34/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 2.2 MB/s | 224 kB 00:00 2024-04-26T12:12:55.023 INFO:teuthology.orchestra.run.smithi070.stdout:(121/127): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-26T12:12:55.066 INFO:teuthology.orchestra.run.smithi070.stdout:(122/127): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T12:12:55.117 INFO:teuthology.orchestra.run.smithi172.stdout:(33/127): ceph-mgr-diskprediction-local-18.2.2- 7.6 MB/s | 7.4 MB 00:00 2024-04-26T12:12:55.124 INFO:teuthology.orchestra.run.smithi113.stdout:(35/127): fuse-2.9.9-15.el9.x86_64.rpm 744 kB/s | 80 kB 00:00 2024-04-26T12:12:55.143 INFO:teuthology.orchestra.run.smithi172.stdout:(34/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 1.1 MB/s | 264 kB 00:00 2024-04-26T12:12:55.199 INFO:teuthology.orchestra.run.smithi113.stdout:(36/127): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-26T12:12:55.209 INFO:teuthology.orchestra.run.smithi172.stdout:(35/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 2.4 MB/s | 224 kB 00:00 2024-04-26T12:12:55.268 INFO:teuthology.orchestra.run.smithi113.stdout:(37/127): libquadmath-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2024-04-26T12:12:55.268 INFO:teuthology.orchestra.run.smithi172.stdout:(36/127): fuse-2.9.9-15.el9.x86_64.rpm 642 kB/s | 80 kB 00:00 2024-04-26T12:12:55.308 INFO:teuthology.orchestra.run.smithi113.stdout:(38/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.2 MB/s | 253 kB 00:00 2024-04-26T12:12:55.327 INFO:teuthology.orchestra.run.smithi172.stdout:(37/127): libgfortran-11.4.1-3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2024-04-26T12:12:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:(38/127): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-26T12:12:55.375 INFO:teuthology.orchestra.run.smithi113.stdout:(39/127): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-26T12:12:55.377 INFO:teuthology.orchestra.run.smithi172.stdout:(39/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-26T12:12:55.409 INFO:teuthology.orchestra.run.smithi113.stdout:(40/127): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-26T12:12:55.419 INFO:teuthology.orchestra.run.smithi172.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-26T12:12:55.442 INFO:teuthology.orchestra.run.smithi113.stdout:(41/127): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-26T12:12:55.444 INFO:teuthology.orchestra.run.smithi172.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T12:12:55.461 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:55.462 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T12:12:55.478 INFO:teuthology.orchestra.run.smithi172.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-26T12:12:55.484 INFO:teuthology.orchestra.run.smithi113.stdout:(42/127): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-04-26T12:12:55.504 INFO:teuthology.orchestra.run.smithi172.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-26T12:12:55.527 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-26T12:12:55.527 INFO:teuthology.orchestra.run.smithi113.stdout:(43/127): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-04-26T12:12:55.529 INFO:teuthology.orchestra.run.smithi172.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T12:12:55.534 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-04-26T12:12:55.534 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-26T12:12:55.534 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T12:12:55.535 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T12:12:55.536 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-26T12:12:55.537 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:12:55.538 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:12:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:12:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T12:12:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:12:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:12:55.539 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:12:55.540 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:12:55.541 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:12:55.542 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:12:55.543 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:12:55.544 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout:Install 123 Packages 2024-04-26T12:12:55.545 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 4 Packages 2024-04-26T12:12:55.546 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:12:55.546 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 189 M 2024-04-26T12:12:55.546 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-26T12:12:55.554 INFO:teuthology.orchestra.run.smithi172.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-26T12:12:55.577 INFO:teuthology.orchestra.run.smithi113.stdout:(44/127): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-26T12:12:55.596 INFO:teuthology.orchestra.run.smithi172.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-26T12:12:55.622 INFO:teuthology.orchestra.run.smithi172.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-26T12:12:55.624 INFO:teuthology.orchestra.run.smithi070.stdout:(123/127): librados2-18.2.2-1256.gdc093b5e.el9. 5.5 MB/s | 3.3 MB 00:00 2024-04-26T12:12:55.627 INFO:teuthology.orchestra.run.smithi113.stdout:(45/127): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 943 kB 00:00 2024-04-26T12:12:55.655 INFO:teuthology.orchestra.run.smithi172.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 366 kB/s | 21 kB 00:00 2024-04-26T12:12:55.669 INFO:teuthology.orchestra.run.smithi113.stdout:(46/127): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-04-26T12:12:55.680 INFO:teuthology.orchestra.run.smithi172.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-26T12:12:55.691 INFO:teuthology.orchestra.run.smithi070.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-26T12:12:55.694 INFO:teuthology.orchestra.run.smithi113.stdout:(47/127): elfutils-libelf-devel-0.190-2.el9.x86 863 kB/s | 21 kB 00:00 2024-04-26T12:12:55.736 INFO:teuthology.orchestra.run.smithi113.stdout:(48/127): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-26T12:12:55.739 INFO:teuthology.orchestra.run.smithi172.stdout:(50/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 2.2 MB/s | 3.5 MB 00:01 2024-04-26T12:12:55.765 INFO:teuthology.orchestra.run.smithi172.stdout:(51/127): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-04-26T12:12:55.778 INFO:teuthology.orchestra.run.smithi113.stdout:(49/127): flexiblas-3.0.4-8.el9.x86_64.rpm 786 kB/s | 33 kB 00:00 2024-04-26T12:12:55.800 INFO:teuthology.orchestra.run.smithi070.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-04-26T12:12:55.823 INFO:teuthology.orchestra.run.smithi172.stdout:(52/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-04-26T12:12:55.848 INFO:teuthology.orchestra.run.smithi172.stdout:(53/127): flexiblas-openblas-openmp-3.0.4-8.el9 226 kB/s | 18 kB 00:00 2024-04-26T12:12:55.873 INFO:teuthology.orchestra.run.smithi172.stdout:(54/127): libaio-devel-0.3.111-13.el9.x86_64.rp 106 kB/s | 11 kB 00:00 2024-04-26T12:12:55.879 INFO:teuthology.orchestra.run.smithi113.stdout:(50/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-04-26T12:12:55.891 INFO:teuthology.orchestra.run.smithi070.stdout:(126/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 3.6 MB/s | 3.0 MB 00:00 2024-04-26T12:12:55.898 INFO:teuthology.orchestra.run.smithi172.stdout:(55/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-26T12:12:55.904 INFO:teuthology.orchestra.run.smithi113.stdout:(51/127): flexiblas-openblas-openmp-3.0.4-8.el9 730 kB/s | 18 kB 00:00 2024-04-26T12:12:55.924 INFO:teuthology.orchestra.run.smithi172.stdout:(56/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 910 kB/s | 45 kB 00:00 2024-04-26T12:12:55.937 INFO:teuthology.orchestra.run.smithi113.stdout:(52/127): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-04-26T12:12:55.949 INFO:teuthology.orchestra.run.smithi172.stdout:(57/127): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-04-26T12:12:55.971 INFO:teuthology.orchestra.run.smithi113.stdout:(53/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 160 kB 00:00 2024-04-26T12:12:55.974 INFO:teuthology.orchestra.run.smithi172.stdout:(58/127): libtool-2.4.6-45.el9.x86_64.rpm 7.7 MB/s | 582 kB 00:00 2024-04-26T12:12:56.000 INFO:teuthology.orchestra.run.smithi172.stdout:(59/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 518 kB/s | 25 kB 00:00 2024-04-26T12:12:56.005 INFO:teuthology.orchestra.run.smithi113.stdout:(54/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-26T12:12:56.025 INFO:teuthology.orchestra.run.smithi172.stdout:(60/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 639 kB/s | 47 kB 00:00 2024-04-26T12:12:56.050 INFO:teuthology.orchestra.run.smithi172.stdout:(61/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-26T12:12:56.056 INFO:teuthology.orchestra.run.smithi113.stdout:(55/127): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-26T12:12:56.075 INFO:teuthology.orchestra.run.smithi172.stdout:(62/127): openblas-0.3.21-2.el9.x86_64.rpm 713 kB/s | 35 kB 00:00 2024-04-26T12:12:56.114 INFO:teuthology.orchestra.run.smithi113.stdout:(56/127): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 582 kB 00:00 2024-04-26T12:12:56.172 INFO:teuthology.orchestra.run.smithi113.stdout:(57/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 438 kB/s | 25 kB 00:00 2024-04-26T12:12:56.209 INFO:teuthology.orchestra.run.smithi172.stdout:(63/127): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-26T12:12:56.214 INFO:teuthology.orchestra.run.smithi113.stdout:(58/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-26T12:12:56.256 INFO:teuthology.orchestra.run.smithi113.stdout:(59/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-04-26T12:12:56.298 INFO:teuthology.orchestra.run.smithi113.stdout:(60/127): openblas-0.3.21-2.el9.x86_64.rpm 847 kB/s | 35 kB 00:00 2024-04-26T12:12:56.301 INFO:teuthology.orchestra.run.smithi172.stdout:(64/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-26T12:12:56.343 INFO:teuthology.orchestra.run.smithi069.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 38 kB/s | 6.5 kB 00:00 2024-04-26T12:12:56.376 INFO:teuthology.orchestra.run.smithi172.stdout:(65/127): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-26T12:12:56.401 INFO:teuthology.orchestra.run.smithi172.stdout:(66/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.3 MB/s | 244 kB 00:00 2024-04-26T12:12:56.426 INFO:teuthology.orchestra.run.smithi172.stdout:(67/127): python3-jinja2-2.11.3-5.el9.noarch.rp 2.0 MB/s | 248 kB 00:00 2024-04-26T12:12:56.432 INFO:teuthology.orchestra.run.smithi113.stdout:(61/127): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-04-26T12:12:56.452 INFO:teuthology.orchestra.run.smithi172.stdout:(68/127): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-04-26T12:12:56.477 INFO:teuthology.orchestra.run.smithi172.stdout:(69/127): python3-jsonpointer-2.0-4.el9.noarch. 256 kB/s | 19 kB 00:00 2024-04-26T12:12:56.502 INFO:teuthology.orchestra.run.smithi172.stdout:(70/127): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-26T12:12:56.527 INFO:teuthology.orchestra.run.smithi172.stdout:(71/127): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-04-26T12:12:56.553 INFO:teuthology.orchestra.run.smithi172.stdout:(72/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-04-26T12:12:56.566 INFO:teuthology.orchestra.run.smithi113.stdout:(62/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-04-26T12:12:56.586 INFO:teuthology.orchestra.run.smithi172.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 3.9 MB/s | 222 kB 00:00 2024-04-26T12:12:56.627 INFO:teuthology.orchestra.run.smithi069.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 2.9 MB/s | 848 kB 00:00 2024-04-26T12:12:56.653 INFO:teuthology.orchestra.run.smithi172.stdout:(74/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-26T12:12:56.658 INFO:teuthology.orchestra.run.smithi113.stdout:(63/127): ceph-mgr-diskprediction-local-18.2.2- 2.9 MB/s | 7.4 MB 00:02 2024-04-26T12:12:56.677 INFO:teuthology.orchestra.run.smithi069.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 2.8 MB/s | 142 kB 00:00 2024-04-26T12:12:56.678 INFO:teuthology.orchestra.run.smithi172.stdout:(75/127): python3-packaging-20.9-5.el9.noarch.r 627 kB/s | 77 kB 00:00 2024-04-26T12:12:56.723 INFO:teuthology.orchestra.run.smithi172.stdout:(76/127): python3-prettytable-0.7.2-27.el9.noar 313 kB/s | 42 kB 00:00 2024-04-26T12:12:56.746 INFO:teuthology.orchestra.run.smithi172.stdout:(77/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-26T12:12:56.758 INFO:teuthology.orchestra.run.smithi113.stdout:(64/127): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-04-26T12:12:56.771 INFO:teuthology.orchestra.run.smithi172.stdout:(78/127): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-04-26T12:12:56.784 INFO:teuthology.orchestra.run.smithi113.stdout:(65/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-04-26T12:12:56.796 INFO:teuthology.orchestra.run.smithi172.stdout:(79/127): python3-pytz-2021.1-5.el9.noarch.rpm 712 kB/s | 51 kB 00:00 2024-04-26T12:12:56.809 INFO:teuthology.orchestra.run.smithi113.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-26T12:12:56.821 INFO:teuthology.orchestra.run.smithi172.stdout:(80/127): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T12:12:56.834 INFO:teuthology.orchestra.run.smithi113.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-26T12:12:56.847 INFO:teuthology.orchestra.run.smithi172.stdout:(81/127): python3-toml-0.10.2-6.el9.noarch.rpm 847 kB/s | 42 kB 00:00 2024-04-26T12:12:56.859 INFO:teuthology.orchestra.run.smithi113.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-26T12:12:56.880 INFO:teuthology.orchestra.run.smithi172.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-04-26T12:12:56.884 INFO:teuthology.orchestra.run.smithi113.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-26T12:12:56.906 INFO:teuthology.orchestra.run.smithi172.stdout:(83/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-26T12:12:56.910 INFO:teuthology.orchestra.run.smithi113.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-26T12:12:56.931 INFO:teuthology.orchestra.run.smithi172.stdout:(84/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-04-26T12:12:56.965 INFO:teuthology.orchestra.run.smithi172.stdout:(85/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 799 kB/s | 45 kB 00:00 2024-04-26T12:12:56.968 INFO:teuthology.orchestra.run.smithi113.stdout:(71/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-04-26T12:12:57.111 INFO:teuthology.orchestra.run.smithi069.stdout:(4/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 4.8 MB/s | 2.1 MB 00:00 2024-04-26T12:12:57.119 INFO:teuthology.orchestra.run.smithi113.stdout:(72/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-04-26T12:12:57.144 INFO:teuthology.orchestra.run.smithi113.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-04-26T12:12:57.178 INFO:teuthology.orchestra.run.smithi113.stdout:(74/127): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-04-26T12:12:57.194 INFO:teuthology.orchestra.run.smithi113.stdout:(75/127): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T12:12:57.220 INFO:teuthology.orchestra.run.smithi113.stdout:(76/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-04-26T12:12:57.240 INFO:teuthology.orchestra.run.smithi172.stdout:(86/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-04-26T12:12:57.253 INFO:teuthology.orchestra.run.smithi113.stdout:(77/127): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-04-26T12:12:57.279 INFO:teuthology.orchestra.run.smithi113.stdout:(78/127): python3-pytz-2021.1-5.el9.noarch.rpm 877 kB/s | 51 kB 00:00 2024-04-26T12:12:57.304 INFO:teuthology.orchestra.run.smithi113.stdout:(79/127): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T12:12:57.346 INFO:teuthology.orchestra.run.smithi113.stdout:(80/127): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-04-26T12:12:57.369 INFO:teuthology.orchestra.run.smithi069.stdout:(5/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 5.6 MB/s | 1.5 MB 00:00 2024-04-26T12:12:57.396 INFO:teuthology.orchestra.run.smithi113.stdout:(81/127): socat-1.7.4.1-5.el9.x86_64.rpm 6.2 MB/s | 305 kB 00:00 2024-04-26T12:12:57.438 INFO:teuthology.orchestra.run.smithi113.stdout:(82/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.3 MB/s | 94 kB 00:00 2024-04-26T12:12:57.474 INFO:teuthology.orchestra.run.smithi172.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 205 kB/s | 111 kB 00:00 2024-04-26T12:12:57.480 INFO:teuthology.orchestra.run.smithi113.stdout:(83/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T12:12:57.522 INFO:teuthology.orchestra.run.smithi113.stdout:(84/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-26T12:12:57.557 INFO:teuthology.orchestra.run.smithi172.stdout:(88/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 523 kB/s | 309 kB 00:00 2024-04-26T12:12:57.624 INFO:teuthology.orchestra.run.smithi172.stdout:(89/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 173 kB/s | 26 kB 00:00 2024-04-26T12:12:57.689 INFO:teuthology.orchestra.run.smithi113.stdout:(85/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-26T12:12:57.691 INFO:teuthology.orchestra.run.smithi172.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 365 kB/s | 49 kB 00:00 2024-04-26T12:12:57.758 INFO:teuthology.orchestra.run.smithi172.stdout:(91/127): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-04-26T12:12:57.783 INFO:teuthology.orchestra.run.smithi172.stdout:(92/127): libunwind-1.6.2-1.el9.x86_64.rpm 427 kB/s | 67 kB 00:00 2024-04-26T12:12:57.817 INFO:teuthology.orchestra.run.smithi172.stdout:(93/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 839 kB 00:00 2024-04-26T12:12:57.875 INFO:teuthology.orchestra.run.smithi172.stdout:(94/127): python3-asyncssh-2.13.2-5.el9.noarch. 5.9 MB/s | 548 kB 00:00 2024-04-26T12:12:57.900 INFO:teuthology.orchestra.run.smithi172.stdout:(95/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 377 kB/s | 43 kB 00:00 2024-04-26T12:12:57.917 INFO:teuthology.orchestra.run.smithi172.stdout:(96/127): python3-cachetools-4.2.4-1.el9.noarch 320 kB/s | 32 kB 00:00 2024-04-26T12:12:57.943 INFO:teuthology.orchestra.run.smithi172.stdout:(97/127): python3-certifi-2021.10.8-2.el9.noarc 224 kB/s | 15 kB 00:00 2024-04-26T12:12:57.993 INFO:teuthology.orchestra.run.smithi172.stdout:(98/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.2 MB/s | 172 kB 00:00 2024-04-26T12:12:58.018 INFO:teuthology.orchestra.run.smithi172.stdout:(99/127): python3-cherrypy-18.6.1-2.el9.noarch. 3.5 MB/s | 358 kB 00:00 2024-04-26T12:12:58.035 INFO:teuthology.orchestra.run.smithi172.stdout:(100/127): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-26T12:12:58.047 INFO:teuthology.orchestra.run.smithi113.stdout:(86/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 5.0 MB/s | 40 MB 00:07 2024-04-26T12:12:58.060 INFO:teuthology.orchestra.run.smithi172.stdout:(101/127): python3-jaraco-8.2.1-3.el9.noarch.rp 163 kB/s | 11 kB 00:00 2024-04-26T12:12:58.094 INFO:teuthology.orchestra.run.smithi172.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-04-26T12:12:58.111 INFO:teuthology.orchestra.run.smithi172.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-26T12:12:58.120 INFO:teuthology.orchestra.run.smithi069.stdout:(6/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 6.2 MB/s | 4.7 MB 00:00 2024-04-26T12:12:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2024-04-26T12:12:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-04-26T12:12:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:(106/127): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-26T12:12:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:(107/127): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-04-26T12:12:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:(108/127): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-04-26T12:12:58.271 INFO:teuthology.orchestra.run.smithi172.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-04-26T12:12:58.295 INFO:teuthology.orchestra.run.smithi069.stdout:(7/127): ceph-common-18.2.2-1256.gdc093b5e.el9. 8.6 MB/s | 18 MB 00:02 2024-04-26T12:12:58.296 INFO:teuthology.orchestra.run.smithi172.stdout:(110/127): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-26T12:12:58.322 INFO:teuthology.orchestra.run.smithi172.stdout:(111/127): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T12:12:58.348 INFO:teuthology.orchestra.run.smithi113.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 134 kB/s | 111 kB 00:00 2024-04-26T12:12:58.355 INFO:teuthology.orchestra.run.smithi172.stdout:(112/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-04-26T12:12:58.389 INFO:teuthology.orchestra.run.smithi172.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-04-26T12:12:58.414 INFO:teuthology.orchestra.run.smithi172.stdout:(114/127): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-26T12:12:58.431 INFO:teuthology.orchestra.run.smithi113.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 313 kB/s | 26 kB 00:00 2024-04-26T12:12:58.439 INFO:teuthology.orchestra.run.smithi172.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-04-26T12:12:58.465 INFO:teuthology.orchestra.run.smithi172.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 476 kB/s | 36 kB 00:00 2024-04-26T12:12:58.473 INFO:teuthology.orchestra.run.smithi113.stdout:(89/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 394 kB/s | 309 kB 00:00 2024-04-26T12:12:58.490 INFO:teuthology.orchestra.run.smithi172.stdout:(117/127): python3-typing-extensions-4.4.0-2.el 679 kB/s | 51 kB 00:00 2024-04-26T12:12:58.515 INFO:teuthology.orchestra.run.smithi113.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-04-26T12:12:58.516 INFO:teuthology.orchestra.run.smithi172.stdout:(118/127): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T12:12:58.540 INFO:teuthology.orchestra.run.smithi172.stdout:(119/127): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-26T12:12:58.557 INFO:teuthology.orchestra.run.smithi113.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 803 kB/s | 67 kB 00:00 2024-04-26T12:12:58.566 INFO:teuthology.orchestra.run.smithi172.stdout:(120/127): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-26T12:12:58.591 INFO:teuthology.orchestra.run.smithi172.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-26T12:12:58.616 INFO:teuthology.orchestra.run.smithi172.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-26T12:12:58.667 INFO:teuthology.orchestra.run.smithi172.stdout:(123/127): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T12:12:58.716 INFO:teuthology.orchestra.run.smithi070.stdout:(127/127): ceph-test-18.2.2-1256.gdc093b5e.el9. 2.5 MB/s | 40 MB 00:15 2024-04-26T12:12:58.725 INFO:teuthology.orchestra.run.smithi172.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-26T12:12:58.726 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:12:58.726 INFO:teuthology.orchestra.run.smithi070.stdout:Total 10 MB/s | 189 MB 00:18 2024-04-26T12:12:58.726 INFO:teuthology.orchestra.run.smithi113.stdout:(92/127): python3-asyncssh-2.13.2-5.el9.noarch. 3.2 MB/s | 548 kB 00:00 2024-04-26T12:12:58.758 INFO:teuthology.orchestra.run.smithi113.stdout:(93/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-04-26T12:12:58.801 INFO:teuthology.orchestra.run.smithi172.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-04-26T12:12:58.915 INFO:teuthology.orchestra.run.smithi113.stdout:(94/127): libarrow-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-04-26T12:12:58.978 INFO:teuthology.orchestra.run.smithi069.stdout:(8/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el9 11 MB/s | 7.7 MB 00:00 2024-04-26T12:12:59.045 INFO:teuthology.orchestra.run.smithi069.stdout:(9/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 1.8 MB/s | 5.1 MB 00:02 2024-04-26T12:12:59.067 INFO:teuthology.orchestra.run.smithi113.stdout:(95/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 127 kB/s | 43 kB 00:00 2024-04-26T12:12:59.070 INFO:teuthology.orchestra.run.smithi069.stdout:(10/127): ceph-selinux-18.2.2-1256.gdc093b5e.el 274 kB/s | 25 kB 00:00 2024-04-26T12:12:59.092 INFO:teuthology.orchestra.run.smithi113.stdout:(96/127): python3-cachetools-4.2.4-1.el9.noarch 96 kB/s | 32 kB 00:00 2024-04-26T12:12:59.117 INFO:teuthology.orchestra.run.smithi113.stdout:(97/127): python3-certifi-2021.10.8-2.el9.noarc 74 kB/s | 15 kB 00:00 2024-04-26T12:12:59.120 INFO:teuthology.orchestra.run.smithi069.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 619 kB/s | 31 kB 00:00 2024-04-26T12:12:59.176 INFO:teuthology.orchestra.run.smithi113.stdout:(98/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.0 MB/s | 172 kB 00:00 2024-04-26T12:12:59.201 INFO:teuthology.orchestra.run.smithi113.stdout:(99/127): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-04-26T12:12:59.226 INFO:teuthology.orchestra.run.smithi113.stdout:(100/127): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-04-26T12:12:59.252 INFO:teuthology.orchestra.run.smithi113.stdout:(101/127): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-26T12:12:59.263 INFO:teuthology.orchestra.run.smithi069.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 4.9 MB/s | 710 kB 00:00 2024-04-26T12:12:59.302 INFO:teuthology.orchestra.run.smithi113.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 236 kB/s | 18 kB 00:00 2024-04-26T12:12:59.327 INFO:teuthology.orchestra.run.smithi113.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-04-26T12:12:59.329 INFO:teuthology.orchestra.run.smithi069.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.4 MB/s | 166 kB 00:00 2024-04-26T12:12:59.352 INFO:teuthology.orchestra.run.smithi113.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-26T12:12:59.378 INFO:teuthology.orchestra.run.smithi113.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T12:12:59.388 INFO:teuthology.orchestra.run.smithi069.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 2.1 MB/s | 126 kB 00:00 2024-04-26T12:12:59.429 INFO:teuthology.orchestra.run.smithi113.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-04-26T12:12:59.453 INFO:teuthology.orchestra.run.smithi113.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-26T12:12:59.487 INFO:teuthology.orchestra.run.smithi113.stdout:(108/127): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-04-26T12:12:59.512 INFO:teuthology.orchestra.run.smithi113.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 690 kB/s | 58 kB 00:00 2024-04-26T12:12:59.537 INFO:teuthology.orchestra.run.smithi113.stdout:(110/127): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-26T12:12:59.563 INFO:teuthology.orchestra.run.smithi113.stdout:(111/127): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T12:12:59.563 INFO:teuthology.orchestra.run.smithi069.stdout:(15/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 11 MB/s | 17 MB 00:01 2024-04-26T12:12:59.588 INFO:teuthology.orchestra.run.smithi113.stdout:(112/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T12:12:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:(16/127): libradosstriper1-18.2.2-1256.gdc093b5 2.3 MB/s | 474 kB 00:00 2024-04-26T12:12:59.609 INFO:teuthology.orchestra.run.smithi172.stdout:(126/127): librados2-18.2.2-1256.gdc093b5e.el9. 3.2 MB/s | 3.3 MB 00:01 2024-04-26T12:12:59.611 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-04-26T12:12:59.613 INFO:teuthology.orchestra.run.smithi113.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-04-26T12:12:59.638 INFO:teuthology.orchestra.run.smithi113.stdout:(114/127): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-26T12:12:59.639 INFO:teuthology.orchestra.run.smithi069.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 893 kB/s | 45 kB 00:00 2024-04-26T12:12:59.664 INFO:teuthology.orchestra.run.smithi113.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-04-26T12:12:59.689 INFO:teuthology.orchestra.run.smithi113.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-04-26T12:12:59.706 INFO:teuthology.orchestra.run.smithi069.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.9 MB/s | 129 kB 00:00 2024-04-26T12:12:59.714 INFO:teuthology.orchestra.run.smithi113.stdout:(117/127): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-04-26T12:12:59.740 INFO:teuthology.orchestra.run.smithi113.stdout:(118/127): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T12:12:59.743 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-04-26T12:12:59.743 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-04-26T12:12:59.765 INFO:teuthology.orchestra.run.smithi113.stdout:(119/127): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-26T12:12:59.773 INFO:teuthology.orchestra.run.smithi069.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 2.4 MB/s | 162 kB 00:00 2024-04-26T12:12:59.807 INFO:teuthology.orchestra.run.smithi113.stdout:(120/127): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-04-26T12:12:59.832 INFO:teuthology.orchestra.run.smithi113.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-26T12:12:59.856 INFO:teuthology.orchestra.run.smithi069.stdout:(20/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 15 MB/s | 4.5 MB 00:00 2024-04-26T12:12:59.866 INFO:teuthology.orchestra.run.smithi113.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-26T12:12:59.882 INFO:teuthology.orchestra.run.smithi069.stdout:(21/127): python3-rados-18.2.2-1256.gdc093b5e.e 2.9 MB/s | 320 kB 00:00 2024-04-26T12:12:59.907 INFO:teuthology.orchestra.run.smithi069.stdout:(22/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 5.8 MB/s | 298 kB 00:00 2024-04-26T12:12:59.932 INFO:teuthology.orchestra.run.smithi069.stdout:(23/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.9 MB/s | 99 kB 00:00 2024-04-26T12:12:59.941 INFO:teuthology.orchestra.run.smithi113.stdout:(123/127): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-26T12:12:59.950 INFO:teuthology.orchestra.run.smithi069.stdout:(24/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 2.0 MB/s | 87 kB 00:00 2024-04-26T12:13:00.000 INFO:teuthology.orchestra.run.smithi113.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-26T12:13:00.016 INFO:teuthology.orchestra.run.smithi069.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 2.5 MB/s | 172 kB 00:00 2024-04-26T12:13:00.075 INFO:teuthology.orchestra.run.smithi113.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-04-26T12:13:00.083 INFO:teuthology.orchestra.run.smithi069.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 366 kB/s | 24 kB 00:00 2024-04-26T12:13:00.150 INFO:teuthology.orchestra.run.smithi069.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.0 MB/s | 138 kB 00:00 2024-04-26T12:13:00.242 INFO:teuthology.orchestra.run.smithi069.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 9.7 MB/s | 3.0 MB 00:00 2024-04-26T12:13:00.500 INFO:teuthology.orchestra.run.smithi113.stdout:(126/127): librados2-18.2.2-1256.gdc093b5e.el9. 4.9 MB/s | 3.3 MB 00:00 2024-04-26T12:13:00.542 INFO:teuthology.orchestra.run.smithi069.stdout:(29/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 9.0 MB/s | 3.5 MB 00:00 2024-04-26T12:13:00.626 INFO:teuthology.orchestra.run.smithi069.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 2.9 MB/s | 246 kB 00:00 2024-04-26T12:13:00.685 INFO:teuthology.orchestra.run.smithi069.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 849 kB/s | 49 kB 00:00 2024-04-26T12:13:00.744 INFO:teuthology.orchestra.run.smithi069.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 260 kB/s | 15 kB 00:00 2024-04-26T12:13:00.811 INFO:teuthology.orchestra.run.smithi069.stdout:(33/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 3.9 MB/s | 264 kB 00:00 2024-04-26T12:13:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:(34/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 3.3 MB/s | 224 kB 00:00 2024-04-26T12:13:00.961 INFO:teuthology.orchestra.run.smithi069.stdout:(35/127): ceph-mgr-diskprediction-local-18.2.2- 10 MB/s | 7.4 MB 00:00 2024-04-26T12:13:01.042 INFO:teuthology.orchestra.run.smithi113.stdout:(127/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 2.6 MB/s | 3.0 MB 00:01 2024-04-26T12:13:01.049 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:13:01.049 INFO:teuthology.orchestra.run.smithi113.stdout:Total 8.9 MB/s | 189 MB 00:21 2024-04-26T12:13:01.078 INFO:teuthology.orchestra.run.smithi069.stdout:(36/127): fuse-2.9.9-15.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-04-26T12:13:01.145 INFO:teuthology.orchestra.run.smithi069.stdout:(37/127): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2024-04-26T12:13:01.171 INFO:teuthology.orchestra.run.smithi069.stdout:(38/127): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-26T12:13:01.196 INFO:teuthology.orchestra.run.smithi069.stdout:(39/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-04-26T12:13:01.237 INFO:teuthology.orchestra.run.smithi069.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-26T12:13:01.262 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-04-26T12:13:01.262 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-04-26T12:13:01.263 INFO:teuthology.orchestra.run.smithi069.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T12:13:01.288 INFO:teuthology.orchestra.run.smithi069.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-26T12:13:01.313 INFO:teuthology.orchestra.run.smithi069.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T12:13:01.339 INFO:teuthology.orchestra.run.smithi069.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T12:13:01.364 INFO:teuthology.orchestra.run.smithi069.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-04-26T12:13:01.406 INFO:teuthology.orchestra.run.smithi069.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-26T12:13:01.440 INFO:teuthology.orchestra.run.smithi069.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-26T12:13:01.457 INFO:teuthology.orchestra.run.smithi069.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 429 kB/s | 21 kB 00:00 2024-04-26T12:13:01.482 INFO:teuthology.orchestra.run.smithi069.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-04-26T12:13:01.499 INFO:teuthology.orchestra.run.smithi069.stdout:(50/127): flexiblas-3.0.4-8.el9.x86_64.rpm 779 kB/s | 33 kB 00:00 2024-04-26T12:13:01.532 INFO:teuthology.orchestra.run.smithi069.stdout:(51/127): flexiblas-openblas-openmp-3.0.4-8.el9 552 kB/s | 18 kB 00:00 2024-04-26T12:13:01.600 INFO:teuthology.orchestra.run.smithi069.stdout:(52/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-26T12:13:01.625 INFO:teuthology.orchestra.run.smithi069.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 122 kB/s | 11 kB 00:00 2024-04-26T12:13:01.634 INFO:teuthology.orchestra.run.smithi172.stdout:(127/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 1.0 MB/s | 3.0 MB 00:03 2024-04-26T12:13:01.640 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:13:01.640 INFO:teuthology.orchestra.run.smithi172.stdout:Total 11 MB/s | 189 MB 00:17 2024-04-26T12:13:01.650 INFO:teuthology.orchestra.run.smithi069.stdout:(54/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-26T12:13:01.675 INFO:teuthology.orchestra.run.smithi069.stdout:(55/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-04-26T12:13:01.709 INFO:teuthology.orchestra.run.smithi069.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-26T12:13:01.734 INFO:teuthology.orchestra.run.smithi069.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 582 kB 00:00 2024-04-26T12:13:01.760 INFO:teuthology.orchestra.run.smithi069.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 513 kB/s | 25 kB 00:00 2024-04-26T12:13:01.785 INFO:teuthology.orchestra.run.smithi069.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-04-26T12:13:01.810 INFO:teuthology.orchestra.run.smithi069.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-26T12:13:01.835 INFO:teuthology.orchestra.run.smithi069.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 708 kB/s | 35 kB 00:00 2024-04-26T12:13:01.901 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2024-04-26T12:13:02.033 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2024-04-26T12:13:02.033 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2024-04-26T12:13:02.094 INFO:teuthology.orchestra.run.smithi069.stdout:(62/127): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-26T12:13:02.161 INFO:teuthology.orchestra.run.smithi069.stdout:(63/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-26T12:13:02.269 INFO:teuthology.orchestra.run.smithi069.stdout:(64/127): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-04-26T12:13:02.295 INFO:teuthology.orchestra.run.smithi069.stdout:(65/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-26T12:13:02.320 INFO:teuthology.orchestra.run.smithi069.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-26T12:13:02.345 INFO:teuthology.orchestra.run.smithi069.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-04-26T12:13:02.371 INFO:teuthology.orchestra.run.smithi069.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-26T12:13:02.396 INFO:teuthology.orchestra.run.smithi069.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-26T12:13:02.421 INFO:teuthology.orchestra.run.smithi069.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-04-26T12:13:02.471 INFO:teuthology.orchestra.run.smithi069.stdout:(71/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-04-26T12:13:02.522 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T12:13:02.547 INFO:teuthology.orchestra.run.smithi069.stdout:(72/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-04-26T12:13:02.580 INFO:teuthology.orchestra.run.smithi069.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-04-26T12:13:02.606 INFO:teuthology.orchestra.run.smithi069.stdout:(74/127): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-26T12:13:02.631 INFO:teuthology.orchestra.run.smithi069.stdout:(75/127): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-04-26T12:13:02.654 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T12:13:02.654 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T12:13:02.681 INFO:teuthology.orchestra.run.smithi069.stdout:(76/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-26T12:13:02.707 INFO:teuthology.orchestra.run.smithi069.stdout:(77/127): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-26T12:13:02.724 INFO:teuthology.orchestra.run.smithi069.stdout:(78/127): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-04-26T12:13:02.749 INFO:teuthology.orchestra.run.smithi069.stdout:(79/127): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-04-26T12:13:02.782 INFO:teuthology.orchestra.run.smithi069.stdout:(80/127): python3-toml-0.10.2-6.el9.noarch.rpm 1.3 MB/s | 42 kB 00:00 2024-04-26T12:13:02.825 INFO:teuthology.orchestra.run.smithi069.stdout:(81/127): socat-1.7.4.1-5.el9.x86_64.rpm 7.5 MB/s | 305 kB 00:00 2024-04-26T12:13:02.867 INFO:teuthology.orchestra.run.smithi069.stdout:(82/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.3 MB/s | 94 kB 00:00 2024-04-26T12:13:02.900 INFO:teuthology.orchestra.run.smithi069.stdout:(83/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.0 MB/s | 64 kB 00:00 2024-04-26T12:13:02.942 INFO:teuthology.orchestra.run.smithi069.stdout:(84/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-26T12:13:03.126 INFO:teuthology.orchestra.run.smithi069.stdout:(85/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-26T12:13:03.476 INFO:teuthology.orchestra.run.smithi069.stdout:(86/127): fmt-8.1.1-5.el9.x86_64.rpm 208 kB/s | 111 kB 00:00 2024-04-26T12:13:03.561 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2024-04-26T12:13:03.562 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2024-04-26T12:13:03.601 INFO:teuthology.orchestra.run.smithi069.stdout:(87/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 686 kB/s | 309 kB 00:00 2024-04-26T12:13:03.776 INFO:teuthology.orchestra.run.smithi069.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 148 kB/s | 26 kB 00:00 2024-04-26T12:13:03.893 INFO:teuthology.orchestra.run.smithi069.stdout:(89/127): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-26T12:13:03.910 INFO:teuthology.orchestra.run.smithi069.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 367 kB/s | 49 kB 00:00 2024-04-26T12:13:03.961 INFO:teuthology.orchestra.run.smithi069.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-26T12:13:03.994 INFO:teuthology.orchestra.run.smithi069.stdout:(92/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-04-26T12:13:04.036 INFO:teuthology.orchestra.run.smithi069.stdout:(93/127): python3-asyncssh-2.13.2-5.el9.noarch. 7.2 MB/s | 548 kB 00:00 2024-04-26T12:13:04.061 INFO:teuthology.orchestra.run.smithi069.stdout:(94/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 648 kB/s | 43 kB 00:00 2024-04-26T12:13:04.103 INFO:teuthology.orchestra.run.smithi069.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 482 kB/s | 32 kB 00:00 2024-04-26T12:13:04.129 INFO:teuthology.orchestra.run.smithi069.stdout:(96/127): python3-certifi-2021.10.8-2.el9.noarc 223 kB/s | 15 kB 00:00 2024-04-26T12:13:04.169 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T12:13:04.170 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T12:13:04.179 INFO:teuthology.orchestra.run.smithi069.stdout:(97/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.2 MB/s | 172 kB 00:00 2024-04-26T12:13:04.204 INFO:teuthology.orchestra.run.smithi069.stdout:(98/127): python3-cherrypy-18.6.1-2.el9.noarch. 4.7 MB/s | 358 kB 00:00 2024-04-26T12:13:04.254 INFO:teuthology.orchestra.run.smithi069.stdout:(99/127): python3-google-auth-2.29.0-1.el9.noar 2.7 MB/s | 206 kB 00:00 2024-04-26T12:13:04.279 INFO:teuthology.orchestra.run.smithi069.stdout:(100/127): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-26T12:13:04.321 INFO:teuthology.orchestra.run.smithi069.stdout:(101/127): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-04-26T12:13:04.346 INFO:teuthology.orchestra.run.smithi069.stdout:(102/127): python3-jaraco-collections-3.0.0-8.e 345 kB/s | 23 kB 00:00 2024-04-26T12:13:04.388 INFO:teuthology.orchestra.run.smithi069.stdout:(103/127): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-04-26T12:13:04.422 INFO:teuthology.orchestra.run.smithi069.stdout:(104/127): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-04-26T12:13:04.539 INFO:teuthology.orchestra.run.smithi069.stdout:(105/127): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-04-26T12:13:04.564 INFO:teuthology.orchestra.run.smithi069.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 326 kB/s | 46 kB 00:00 2024-04-26T12:13:04.615 INFO:teuthology.orchestra.run.smithi069.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-26T12:13:04.640 INFO:teuthology.orchestra.run.smithi069.stdout:(108/127): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-04-26T12:13:04.690 INFO:teuthology.orchestra.run.smithi069.stdout:(109/127): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-26T12:13:04.716 INFO:teuthology.orchestra.run.smithi069.stdout:(110/127): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T12:13:04.758 INFO:teuthology.orchestra.run.smithi069.stdout:(111/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-26T12:13:04.783 INFO:teuthology.orchestra.run.smithi069.stdout:(112/127): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-04-26T12:13:04.833 INFO:teuthology.orchestra.run.smithi069.stdout:(113/127): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-26T12:13:04.858 INFO:teuthology.orchestra.run.smithi069.stdout:(114/127): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-04-26T12:13:04.900 INFO:teuthology.orchestra.run.smithi069.stdout:(115/127): python3-tempora-5.0.0-2.el9.noarch.r 536 kB/s | 36 kB 00:00 2024-04-26T12:13:04.934 INFO:teuthology.orchestra.run.smithi069.stdout:(116/127): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-04-26T12:13:04.975 INFO:teuthology.orchestra.run.smithi069.stdout:(117/127): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T12:13:04.992 INFO:teuthology.orchestra.run.smithi069.stdout:(118/127): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-26T12:13:05.051 INFO:teuthology.orchestra.run.smithi069.stdout:(119/127): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-26T12:13:05.076 INFO:teuthology.orchestra.run.smithi069.stdout:(120/127): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-04-26T12:13:05.126 INFO:teuthology.orchestra.run.smithi069.stdout:(121/127): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-26T12:13:05.202 INFO:teuthology.orchestra.run.smithi069.stdout:(122/127): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-26T12:13:05.444 INFO:teuthology.orchestra.run.smithi069.stdout:(123/127): librados2-18.2.2-1256.gdc093b5e.el9. 10 MB/s | 3.3 MB 00:00 2024-04-26T12:13:05.511 INFO:teuthology.orchestra.run.smithi069.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-26T12:13:05.594 INFO:teuthology.orchestra.run.smithi069.stdout:(125/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 7.7 MB/s | 3.0 MB 00:00 2024-04-26T12:13:05.636 INFO:teuthology.orchestra.run.smithi069.stdout:(126/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-04-26T12:13:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-04-26T12:13:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:13:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:13:06.688 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:13:06.737 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:13:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:13:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:13:07.126 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:13:07.230 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:07.496 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:07.538 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:07.566 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:07.666 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:07.692 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:07.845 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:13:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:13:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:13:07.987 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:13:08.015 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:13:08.083 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:13:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:13:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:13:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:13:08.278 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:13:08.314 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:13:08.349 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:13:08.414 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:13:08.547 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:13:08.600 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:13:08.850 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2024-04-26T12:13:08.937 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:13:08.975 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:13:09.037 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:13:09.071 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:13:09.097 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:13:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:13:09.139 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:13:09.169 INFO:teuthology.orchestra.run.smithi069.stdout:(127/127): ceph-test-18.2.2-1256.gdc093b5e.el9. 3.9 MB/s | 40 MB 00:10 2024-04-26T12:13:09.177 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:13:09.177 INFO:teuthology.orchestra.run.smithi069.stdout:Total 14 MB/s | 189 MB 00:13 2024-04-26T12:13:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:13:09.222 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T12:13:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:13:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:13:09.329 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:13:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:13:09.443 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:13:09.463 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:13:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:13:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:13:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:13:09.538 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:13:09.564 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:13:09.572 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:09.599 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:13:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:13:09.683 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:13:09.707 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:13:09.781 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:13:09.822 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:09.850 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:13:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:13:09.917 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:13:09.934 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:13:09.959 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:13:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:13:10.023 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:10.062 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-26T12:13:10.085 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:10.122 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:13:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:10.156 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:13:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:13:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:10.193 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-26T12:13:10.194 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-26T12:13:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:13:10.221 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:13:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:13:10.255 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:13:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:10.283 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:13:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:13:10.352 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:13:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:13:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:13:10.406 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:13:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:13:10.436 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:13:10.452 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:13:10.471 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:13:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:13:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:13:10.547 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:13:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:13:10.577 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:13:10.590 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:13:10.614 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:13:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:13:10.633 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:13:10.649 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:13:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:13:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:13:10.708 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:13:10.713 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:13:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:13:10.748 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:13:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:13:10.776 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:13:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:13:10.844 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:13:10.844 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:13:10.906 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:13:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:13:10.918 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:13:10.954 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:13:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:13:10.989 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:13:11.064 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:13:11.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:13:11.143 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:13:11.217 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:13:11.351 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:13:11.404 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:13:11.452 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:13:11.540 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:13:11.578 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:13:11.616 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:13:11.658 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:13:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:13:11.707 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-26T12:13:11.707 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-26T12:13:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:13:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:13:11.816 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:13:11.854 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:13:11.866 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:13:11.931 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:13:11.947 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:13:11.972 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:13:12.007 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:13:12.011 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:13:12.046 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:13:12.066 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:13:12.084 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:13:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:13:12.126 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:13:12.139 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:13:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:13:12.171 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:13:12.206 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:13:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:13:12.262 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:13:12.271 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:13:12.315 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:13:12.326 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:13:12.358 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:13:12.434 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:13:12.471 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:13:12.495 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:13:12.527 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:13:12.534 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:13:12.575 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:13:12.600 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:13:12.639 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:13:12.671 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:13:12.675 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:13:12.700 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:13:12.722 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:13:12.732 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:13:12.757 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:13:12.768 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:13:12.785 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:13:12.810 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:13:12.818 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:13:12.846 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:13:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:13:12.883 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:13:12.913 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:13:12.946 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:13:12.947 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:13:12.981 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:13:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:13:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:13.022 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:13:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:13:13.057 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:13:13.092 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:13:13.122 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:13:13.147 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:13:13.170 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:13:13.226 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:13:13.247 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:13:13.252 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:13:13.279 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:13:13.310 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:13:13.312 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:13:13.340 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:13:13.378 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:13:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:13:13.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:13:13.475 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:13:13.517 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:13:13.560 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:13:13.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:13:13.642 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:13:13.741 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:13:13.788 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:13:14.049 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:13:14.107 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:13:14.141 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:13:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:13:14.243 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:13:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:13:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:13:14.317 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:13:14.335 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:13:14.495 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:13:14.514 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:13:14.523 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:13:14.560 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:13:14.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:13:14.601 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:13:14.633 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:13:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:13:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:13:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:13:14.839 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:13:14.983 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:13:15.026 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:13:15.103 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:13:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:13:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:15.268 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:13:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:13:15.389 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:15.756 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:13:15.874 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:16.633 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:13:16.719 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:13:16.747 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:13:16.780 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:13:16.800 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-26T12:13:16.881 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T12:13:16.922 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T12:13:16.975 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T12:13:17.009 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T12:13:17.034 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T12:13:17.077 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T12:13:17.079 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:13:17.093 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:13:17.118 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:17.180 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:13:17.200 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:13:17.200 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:17.225 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:13:17.231 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:13:17.266 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:13:17.406 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T12:13:17.518 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:17.522 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:13:17.566 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:17.619 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:17.637 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:17.652 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:17.668 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:13:17.668 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:13:17.696 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:17.703 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:13:17.726 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:17.745 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:17.759 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:17.776 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:17.783 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:17.797 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:13:17.804 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:17.905 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:17.930 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:18.055 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T12:13:18.092 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T12:13:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:13:18.127 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T12:13:18.133 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:18.191 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T12:13:18.203 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:13:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T12:13:18.262 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T12:13:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:18.330 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T12:13:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:18.386 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T12:13:18.415 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T12:13:18.448 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:18.448 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:13:18.449 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:13:18.449 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:18.450 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T12:13:18.479 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:18.525 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T12:13:18.561 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T12:13:18.604 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T12:13:18.677 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T12:13:18.811 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T12:13:18.881 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T12:13:19.400 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T12:13:19.485 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T12:13:19.523 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T12:13:19.561 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T12:13:19.603 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T12:13:19.748 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T12:13:19.803 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T12:13:19.914 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T12:13:19.915 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:19.954 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:19.957 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T12:13:20.013 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T12:13:20.086 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T12:13:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T12:13:20.186 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T12:13:20.234 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T12:13:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:20.278 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T12:13:20.307 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:20.320 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T12:13:20.458 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T12:13:20.477 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:20.505 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T12:13:20.515 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:20.546 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T12:13:20.613 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:20.613 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:13:20.613 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:13:20.614 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:20.642 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T12:13:20.642 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:20.680 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T12:13:20.720 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T12:13:20.745 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T12:13:20.772 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T12:13:20.805 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T12:13:20.827 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:20.833 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T12:13:20.869 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:20.870 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T12:13:20.901 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T12:13:20.934 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T12:13:20.967 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:20.967 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:13:20.967 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:13:20.967 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:20.968 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T12:13:20.996 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:21.009 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T12:13:21.044 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T12:13:21.079 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T12:13:21.151 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T12:13:21.250 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T12:13:21.297 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T12:13:22.025 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T12:13:22.069 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T12:13:22.103 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T12:13:22.202 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T12:13:22.236 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T12:13:22.415 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T12:13:22.535 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T12:13:22.613 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T12:13:23.251 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T12:13:23.366 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T12:13:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T12:13:24.699 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T12:13:24.732 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T12:13:25.032 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T12:13:25.178 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:25.269 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T12:13:25.299 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T12:13:25.336 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T12:13:25.736 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T12:13:25.772 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:25.843 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T12:13:25.866 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T12:13:27.951 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:27.987 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:28.504 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T12:13:28.549 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:28.656 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T12:13:28.656 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:13:28.656 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:13:28.656 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:28.692 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-04-26T12:13:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-04-26T12:13:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:29.545 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:29.545 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:13:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:30.974 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:31.000 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:31.000 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:31.000 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:13:31.001 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:31.001 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:31.001 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:31.199 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:31.222 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:31.222 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:31.222 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:13:31.222 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:31.222 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:31.222 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:31.690 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:31.690 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:31.690 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:13:31.690 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:31.690 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:31.690 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /sys 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /proc 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /mnt 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /var/tmp 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /home 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /root 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /tmp 2024-04-26T12:13:31.782 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:31.788 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:13:31.850 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:13:31.908 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:13:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-04-26T12:13:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-04-26T12:13:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-04-26T12:13:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-04-26T12:13:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-04-26T12:13:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-04-26T12:13:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-04-26T12:13:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:31.951 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:31.967 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:31.967 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:31.967 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:13:31.967 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:13:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:32.129 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:32.129 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:13:32.129 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:13:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:13:32.302 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:32.484 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:13:32.517 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:13:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:13:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:33.001 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:33.029 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:13:33.094 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:13:33.123 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:33.413 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:33.438 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:33.438 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:33.438 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:13:33.438 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:33.438 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:33.438 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:33.592 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:33.617 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:33.618 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:33.618 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:13:33.618 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:33.618 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:33.618 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:33.638 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:33.661 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:33.661 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:33.661 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:13:33.661 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:33.661 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:33.661 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:33.817 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:13:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:34.098 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:34.120 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:34.120 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:34.120 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:13:34.120 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:34.120 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:34.120 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:34.170 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:34.208 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:34.228 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:13:34.276 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:34.285 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:13:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:34.299 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:34.299 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:13:34.299 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:34.299 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:34.299 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:34.340 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:13:34.415 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:13:34.472 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:13:34.526 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:13:34.535 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:13:34.573 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:13:34.651 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:13:34.725 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:13:34.741 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:34.777 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:13:34.855 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:13:34.889 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:34.931 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:13:34.945 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:34.972 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:13:34.999 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:13:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:35.119 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:13:35.159 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:13:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:35.187 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:13:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:35.317 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:35.454 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:35.476 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:13:35.482 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:35.503 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:35.510 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:13:35.526 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:35.526 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:35.527 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:13:35.527 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:35.527 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:35.527 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:35.570 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:35.574 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:13:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:35.604 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:35.608 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:35.636 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:35.664 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:13:35.676 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:13:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:13:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:13:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:13:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:36.495 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:36.495 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:13:36.495 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:36.495 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:36.540 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:36.562 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:36.562 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:36.562 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:13:36.562 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:36.643 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:36.681 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:36.828 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:36.857 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:36.877 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:36.879 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:36.879 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:36.879 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:13:36.879 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:36.880 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:36.880 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:37.648 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:37.673 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:37.776 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:37.847 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:37.877 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:37.929 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:13:37.967 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:37.979 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:37.989 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:37.990 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:37.990 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:13:37.990 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:37.990 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:37.990 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:38.034 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:38.045 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:38.141 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:13:38.144 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:13:38.172 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:38.191 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:13:38.194 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:38.194 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:38.195 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:13:38.195 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:38.195 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:38.195 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:38.239 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:38.250 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:38.346 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:13:38.395 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:13:38.899 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:13:38.929 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:38.951 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:38.951 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:13:38.951 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:38.951 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:38.996 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:39.018 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:39.018 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:39.018 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:13:39.018 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:39.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:13:39.133 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:39.156 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:39.156 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:39.156 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:13:39.156 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:39.156 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:39.156 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:39.215 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:39.237 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:39.238 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:39.238 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:13:39.238 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:39.314 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:39.335 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:39.336 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:39.336 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:13:39.336 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:39.336 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:39.336 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:39.534 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:39.557 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:39.557 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:39.557 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:13:39.557 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:39.557 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:39.557 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:39.787 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T12:13:39.787 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2024-04-26T12:13:39.787 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2024-04-26T12:13:39.787 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2024-04-26T12:13:39.787 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2024-04-26T12:13:39.787 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2024-04-26T12:13:39.788 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /root 2024-04-26T12:13:39.788 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2024-04-26T12:13:39.788 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:39.959 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:39.975 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T12:13:39.975 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:39.975 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:13:39.976 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:13:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:13:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:13:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:13:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:13:41.437 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:41.462 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T12:13:41.462 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:41.463 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:13:41.463 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:41.463 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:13:41.463 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:41.532 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:13:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:13:41.662 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:13:41.686 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T12:13:41.686 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:41.686 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:13:41.686 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:41.686 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:13:41.686 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:41.765 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:13:41.805 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:13:41.806 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:42.061 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:42.130 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:42.153 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T12:13:42.153 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:42.153 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:13:42.153 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:42.153 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:13:42.153 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:42.252 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T12:13:42.300 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T12:13:42.356 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T12:13:42.540 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T12:13:42.589 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T12:13:42.658 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T12:13:42.746 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:42.910 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:42.955 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T12:13:42.991 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:13:42.996 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T12:13:43.032 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T12:13:43.032 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:13:43.074 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:13:43.106 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:13:43.132 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:13:43.212 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:13:43.254 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:13:43.295 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:13:43.327 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:13:43.353 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:13:43.487 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:43.514 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T12:13:43.542 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T12:13:43.605 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T12:13:43.628 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:43.977 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:13:44.074 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:13:44.124 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:13:44.182 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:13:44.207 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:13:44.236 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:13:44.236 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:44.270 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:13:44.311 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:13:44.320 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:44.345 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:44.345 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:44.393 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:13:44.425 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:13:44.425 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:44.442 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:44.492 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:44.510 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:44.516 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:44.516 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:44.603 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:44.661 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T12:13:44.672 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:44.696 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:45.659 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T12:13:45.680 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:45.782 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T12:13:45.936 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T12:13:45.966 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:45.989 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T12:13:45.989 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:45.989 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:13:45.989 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:45.989 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:13:45.989 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:46.033 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:46.045 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T12:13:46.138 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T12:13:46.190 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T12:13:46.894 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T12:13:46.919 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:46.942 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T12:13:46.942 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:46.942 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:13:46.942 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:46.942 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:13:46.942 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:46.986 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:47.009 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T12:13:47.009 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:47.009 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:13:47.010 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:13:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:13:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:13:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:13:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:13:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:13:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:13:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:13:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:13:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:13:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:13:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:13:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:13:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:13:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:13:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:13:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:13:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:13:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:13:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:13:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:13:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:13:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:13:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:13:47.295 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:47.318 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T12:13:47.318 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:13:47.318 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:13:47.318 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:47.318 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:13:47.318 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:49.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:49.062 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:49.062 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-04-26T12:13:49.062 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.062 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.062 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:49.062 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.063 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.064 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.065 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.066 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:13:49.067 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:13:49.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:49.069 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.071 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:13:49.072 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-04-26T12:13:49.426 DEBUG:teuthology.parallel:result is None 2024-04-26T12:13:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:13:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:13:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:13:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:13:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:13:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:13:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:13:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:13:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:13:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:13:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:13:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:13:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:49.612 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:13:49.613 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:13:49.614 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:13:49.614 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:13:49.614 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:13:49.614 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:13:49.623 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:13:49.623 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:13:49.623 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:13:49.623 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:13:49.624 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:13:49.625 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:13:49.626 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:13:49.627 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:49.628 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:13:49.629 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:13:49.630 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:13:49.631 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:13:49.631 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:13:49.631 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:13:49.631 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:49.631 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:13:51.017 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T12:13:51.066 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T12:13:51.106 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T12:13:51.138 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T12:13:51.165 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T12:13:51.417 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout:Upgraded: 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout:Installed: 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.418 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.419 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:13:51.420 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.421 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:13:51.422 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:13:51.423 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:13:51.424 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:13:51.425 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:13:51.426 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:13:51.427 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:13:51.428 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:13:51.428 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:13:51.428 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-04-26T12:13:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:51.583 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-04-26T12:13:51.583 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.584 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.585 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:13:51.586 INFO:teuthology.orchestra.run.smithi172.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.587 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:13:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:13:51.589 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:51.590 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:13:51.591 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:13:51.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:13:51.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:13:51.594 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T12:13:51.821 DEBUG:teuthology.parallel:result is None 2024-04-26T12:13:51.967 DEBUG:teuthology.parallel:result is None 2024-04-26T12:13:52.015 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T12:13:52.114 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T12:13:52.156 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T12:13:52.238 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T12:13:52.268 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T12:13:52.268 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:52.344 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T12:13:52.385 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:52.385 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:52.462 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T12:13:52.532 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T12:13:57.532 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T12:13:57.533 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T12:13:57.534 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T12:13:57.534 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T12:13:57.534 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T12:13:57.543 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T12:13:57.543 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T12:13:57.543 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T12:13:57.543 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T12:13:57.543 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T12:13:57.544 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T12:13:57.545 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T12:13:57.546 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T12:13:57.547 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T12:13:57.548 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T12:13:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T12:13:57.550 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T12:13:57.551 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T12:13:57.551 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T12:13:57.551 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T12:13:57.551 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T12:13:57.551 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T12:13:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T12:13:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:59.417 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2024-04-26T12:13:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:13:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T12:13:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:13:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:13:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:13:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:13:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:13:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T12:13:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:13:59.428 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-26T12:13:59.814 DEBUG:teuthology.parallel:result is None 2024-04-26T12:13:59.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:13:59.963 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:13:59.984 INFO:teuthology.orchestra.run.smithi069.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:13:59.985 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:13:59.985 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:13:59.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:14:00.129 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:14:00.157 INFO:teuthology.orchestra.run.smithi070.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:14:00.157 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:14:00.158 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:14:00.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:14:00.399 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:14:00.425 INFO:teuthology.orchestra.run.smithi113.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:14:00.425 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:14:00.425 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:14:00.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:14:00.566 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:14:00.592 INFO:teuthology.orchestra.run.smithi172.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T12:14:00.592 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T12:14:00.592 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:14:00.594 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:14:00.595 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:00.595 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:14:00.622 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:00.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:14:00.654 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:00.654 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:14:00.685 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:00.685 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:14:00.716 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:14:00.716 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:00.716 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:14:00.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:14:00.804 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:00.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:14:00.832 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:14:00.900 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:00.900 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:14:00.928 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:14:00.996 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:00.996 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:14:01.024 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:14:01.093 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:14:01.093 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:01.093 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:14:01.116 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:14:01.180 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:01.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:14:01.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:14:01.275 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:01.275 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:14:01.303 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:14:01.370 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:01.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:14:01.398 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:14:01.465 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:14:01.465 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:01.465 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:14:01.490 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:14:01.553 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:01.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:14:01.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:14:01.644 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:01.644 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:14:01.672 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:14:01.740 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:01.740 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:14:01.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:14:01.835 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:14:01.917 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:14:01.917 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /var/log/ceph 2024-04-26T12:14:01.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-04-26T12:14:01.922 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 777 /var/log/ceph 2024-04-26T12:14:01.925 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-04-26T12:14:01.952 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:14:01.952 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:14:01.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:14:01.988 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:14:01.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:14:02.018 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:14:02.018 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:14:02.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:14:02.053 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:14:02.059 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:14:02.094 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:14:02.094 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:14:02.094 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674210', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi069.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaNAUt6GuelCRjv1dVkjGYFvdyPMzmppkUcUiQQPUtnPF5P2Ly4lY2JuF2thyyD7vYdMiOwH9YCUwer279NnBw=', 'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDES9ND8XySIjmk9rbd0xqSJlgKRkLH5SMcN9+5YSIuH3/b8eKdHdMsOCInzV4VJfRtFpzvvIEA+sfrCwCDAUb4=', 'smithi113.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6SBHf61L2KmyskMFFMeS3TTsIorAupTnBwQcH41RdC1npfdL4c47PGs+HKtPgtF/d6/MFr1O7hmH0urSSnlKE=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ+zURNpc8zWUBRLLJhg+B64K/K+Jz3m8dysn/6hiWnBr6mxnYYitx1OGMFLfJ2A4PEpW7D8Wzg5zV7rfWjRxFk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:14:02.095 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:14:02.110 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:14:02.118 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:14:02.126 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:14:02.142 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:14:02.165 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:14:02.172 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:14:02.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:14:02.209 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:02.209 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:14:02.248 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:14:02.249 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 12:13:42.472312769 +0000 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 12:11:57.405201276 +0000 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 12:11:57.405201276 +0000 2024-04-26T12:14:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 12:11:57.405201276 +0000 2024-04-26T12:14:02.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:14:02.365 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T12:14:02.365 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T12:14:02.365 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.5576e-05 s, 6.0 MB/s 2024-04-26T12:14:02.366 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:14:02.423 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-04-26T12:14:02.477 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:14:02.477 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:02.478 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T12:14:02.478 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:02.478 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:02.478 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 12:13:42.473312739 +0000 2024-04-26T12:14:02.478 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 12:11:57.730191655 +0000 2024-04-26T12:14:02.478 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 12:11:57.730191655 +0000 2024-04-26T12:14:02.478 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 12:11:57.730191655 +0000 2024-04-26T12:14:02.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:14:02.540 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T12:14:02.540 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T12:14:02.540 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000106835 s, 4.8 MB/s 2024-04-26T12:14:02.541 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:14:02.596 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 12:13:42.473312739 +0000 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 12:11:58.053182092 +0000 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 12:11:58.053182092 +0000 2024-04-26T12:14:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 12:11:58.053182092 +0000 2024-04-26T12:14:02.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:14:02.713 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T12:14:02.713 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T12:14:02.713 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000100129 s, 5.1 MB/s 2024-04-26T12:14:02.714 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:14:02.769 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-04-26 12:13:42.474312710 +0000 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-04-26 12:11:58.389172145 +0000 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-04-26 12:11:58.389172145 +0000 2024-04-26T12:14:02.826 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-04-26 12:11:58.389172145 +0000 2024-04-26T12:14:02.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:14:02.887 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-04-26T12:14:02.887 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-04-26T12:14:02.888 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.4595e-05 s, 5.4 MB/s 2024-04-26T12:14:02.888 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:14:02.944 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:14:02.945 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:02.945 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:14:02.963 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:14:02.963 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_1 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-26 12:13:44.875209521 +0000 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-26 12:12:00.521146901 +0000 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-26 12:12:00.521146901 +0000 2024-04-26T12:14:03.022 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-26 12:12:00.521146901 +0000 2024-04-26T12:14:03.023 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:14:03.088 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-26T12:14:03.088 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-26T12:14:03.088 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000225745 s, 2.3 MB/s 2024-04-26T12:14:03.090 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:14:03.147 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_2 2024-04-26T12:14:03.204 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:14:03.204 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:03.204 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T12:14:03.205 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:03.205 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:03.205 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-26 12:13:44.876209503 +0000 2024-04-26T12:14:03.205 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-26 12:12:00.869138685 +0000 2024-04-26T12:14:03.205 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-26 12:12:00.869138685 +0000 2024-04-26T12:14:03.205 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-26 12:12:00.869138685 +0000 2024-04-26T12:14:03.205 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:14:03.269 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-26T12:14:03.269 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-26T12:14:03.269 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000224904 s, 2.3 MB/s 2024-04-26T12:14:03.271 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:14:03.327 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_3 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-26 12:13:44.876209503 +0000 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-26 12:12:01.213130563 +0000 2024-04-26T12:14:03.383 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-26 12:12:01.213130563 +0000 2024-04-26T12:14:03.384 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-26 12:12:01.213130563 +0000 2024-04-26T12:14:03.384 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:14:03.446 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-26T12:14:03.446 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-26T12:14:03.446 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000211534 s, 2.4 MB/s 2024-04-26T12:14:03.447 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:14:03.503 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_4 2024-04-26T12:14:03.559 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:14:03.559 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:03.559 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T12:14:03.559 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:03.559 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:03.559 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-26 12:13:44.876209503 +0000 2024-04-26T12:14:03.560 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-26 12:12:01.557122442 +0000 2024-04-26T12:14:03.560 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-26 12:12:01.557122442 +0000 2024-04-26T12:14:03.560 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-26 12:12:01.557122442 +0000 2024-04-26T12:14:03.560 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:14:03.622 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-26T12:14:03.622 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-26T12:14:03.622 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000240364 s, 2.1 MB/s 2024-04-26T12:14:03.623 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:14:03.679 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:14:03.679 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:03.679 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:14:03.697 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:14:03.697 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-04-26T12:14:03.753 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-26 12:13:45.037343923 +0000 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-26 12:12:00.577935643 +0000 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-26 12:12:00.577935643 +0000 2024-04-26T12:14:03.754 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-26 12:12:00.577935643 +0000 2024-04-26T12:14:03.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:14:03.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-26T12:14:03.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-26T12:14:03.817 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000269977 s, 1.9 MB/s 2024-04-26T12:14:03.818 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:14:03.874 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-04-26T12:14:03.929 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:14:03.929 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:03.929 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T12:14:03.929 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:03.929 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:03.930 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-26 12:13:45.037343923 +0000 2024-04-26T12:14:03.930 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-26 12:12:00.912927281 +0000 2024-04-26T12:14:03.930 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-26 12:12:00.912927281 +0000 2024-04-26T12:14:03.930 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-26 12:12:00.912927281 +0000 2024-04-26T12:14:03.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:14:03.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-26T12:14:03.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-26T12:14:03.992 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000174482 s, 2.9 MB/s 2024-04-26T12:14:03.993 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:14:04.048 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-26 12:13:45.037343923 +0000 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-26 12:12:01.245918968 +0000 2024-04-26T12:14:04.103 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-26 12:12:01.245918968 +0000 2024-04-26T12:14:04.104 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-26 12:12:01.245918968 +0000 2024-04-26T12:14:04.104 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:14:04.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-26T12:14:04.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-26T12:14:04.165 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000215352 s, 2.4 MB/s 2024-04-26T12:14:04.166 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:14:04.221 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-26 12:13:45.038343899 +0000 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-26 12:12:01.572910806 +0000 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-26 12:12:01.572910806 +0000 2024-04-26T12:14:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-26 12:12:01.572910806 +0000 2024-04-26T12:14:04.277 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:14:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-26T12:14:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-26T12:14:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000181739 s, 2.8 MB/s 2024-04-26T12:14:04.339 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:14:04.394 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:14:04.395 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:14:04.395 INFO:tasks.ceph:Generating config... 2024-04-26T12:14:04.396 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:14:04.396 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:14:04.396 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:14:04.396 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:14:04.396 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:14:04.396 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:14:04.396 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T12:14:04.396 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T12:14:04.396 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:14:04.396 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-04-26T12:14:04.397 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:14:04.398 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:14:04.398 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:14:04.462 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:14:04.465 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:14:04.509 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:14:04.533 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.69'), ('mon.b', '[v2:172.21.15.69:3301,v1:172.21.15.69:6790]'), ('mon.c', '[v2:172.21.15.69:3302,v1:172.21.15.69:6791]')] 2024-04-26T12:14:04.533 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790],[v2:172.21.15.69:3302,v1:172.21.15.69:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-26T12:14:04.534 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:04.534 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:14:04.590 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.69 --addv b '[v2:172.21.15.69:3301,v1:172.21.15.69:6790]' --addv c '[v2:172.21.15.69:3302,v1:172.21.15.69:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:04.675 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:04.675 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: generated fsid 38aaef92-b73b-4053-b2f0-6b2ea75fb544 2024-04-26T12:14:04.675 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = pacific 2024-04-26T12:14:04.675 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 0 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:fsid 38aaef92-b73b-4053-b2f0-6b2ea75fb544 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:last_changed 2024-04-26T12:14:04.675220+0000 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:created 2024-04-26T12:14:04.675220+0000 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:min_mon_release 16 (pacific) 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:election_strategy: 1 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:1: [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] mon.b 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:2: [v2:172.21.15.69:3302/0,v1:172.21.15.69:6791/0] mon.c 2024-04-26T12:14:04.676 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T12:14:04.677 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:14:04.692 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 38aaef92-b73b-4053-b2f0-6b2ea75fb544... 2024-04-26T12:14:04.692 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:14:04.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:14:04.737 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:14:04.740 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:14:04.772 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2024-04-26T12:14:04.772 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2024-04-26T12:14:04.772 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:14:04.772 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2024-04-26T12:14:04.772 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.772 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2024-04-26T12:14:04.773 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2024-04-26T12:14:04.774 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790],[v2:172.21.15.69:3302,v1:172.21.15.69:6791]" 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = 38aaef92-b73b-4053-b2f0-6b2ea75fb544 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.775 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2024-04-26T12:14:04.776 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2024-04-26T12:14:04.777 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: osd max markdown count = 1000 2024-04-26T12:14:04.778 INFO:teuthology.orchestra.run.smithi069.stdout: osd memory target = 1610612736 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2024-04-26T12:14:04.779 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.780 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2024-04-26T12:14:04.781 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:14:04.782 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:14:04.782 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2024-04-26T12:14:04.782 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2024-04-26T12:14:04.782 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2024-04-26T12:14:04.782 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2024-04-26T12:14:04.782 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2024-04-26T12:14:04.782 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:14:04.783 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2024-04-26T12:14:04.783 INFO:teuthology.orchestra.run.smithi113.stdout: chdir = "" 2024-04-26T12:14:04.783 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:14:04.783 INFO:teuthology.orchestra.run.smithi113.stdout: auth supported = cephx 2024-04-26T12:14:04.783 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.783 INFO:teuthology.orchestra.run.smithi113.stdout: filestore xattr use omap = true 2024-04-26T12:14:04.783 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: mon clock drift allowed = 1.000 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: osd crush chooseleaf type = 0 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: auth debug = true 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on old message = true 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on bug = true 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: mon pg warn max object skew = 0 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:14:04.784 INFO:teuthology.orchestra.run.smithi113.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default size = 2 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow primary affinity = true 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow pg remap = true 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on no sortbitwise = false 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on too few osds = false 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: mon_allow_pool_size_one = true 2024-04-26T12:14:04.785 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: osd default data pool replay window = 5 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: mon allow pool delete = true 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: mon cluster log file level = debug 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: debug asserts on shutdown = true 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: mon health detail to clog = false 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: mon host = "172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790],[v2:172.21.15.69:3302,v1:172.21.15.69:6791]" 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = 38aaef92-b73b-4053-b2f0-6b2ea75fb544 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.786 INFO:teuthology.orchestra.run.smithi113.stdout:[osd] 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd journal size = 100 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub load threshold = 5.0 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub max interval = 600 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd recover clone overlap = true 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd recovery max chunk = 1048576 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug shutdown = true 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug op order = true 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug verify stray on activate = true 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.787 INFO:teuthology.orchestra.run.smithi113.stdout: osd open classes on start = true 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug pg log writeout = true 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: osd map max advance = 10 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: journal zero on create = true 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: filestore apply finisher threads = 3 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: bdev debug aio = true 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug misdirected ops = true 2024-04-26T12:14:04.788 INFO:teuthology.orchestra.run.smithi113.stdout: bdev async discard = True 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: bdev enable discard = True 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore block size = 96636764160 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore fsck on mount = True 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluefs = 1/20 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluestore = 1/20 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: debug osd = 20 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: debug rocksdb = 4/10 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.9 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:14:04.789 INFO:teuthology.orchestra.run.smithi113.stdout: osd max markdown count = 1000 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: osd memory target = 1610612736 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: osd objectstore = bluestore 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr] 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: debug mgr = 20 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: mgr/telemetry/nag = false 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.790 INFO:teuthology.orchestra.run.smithi113.stdout:[mon] 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: debug paxos = 20 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: mon data avail warn = 5 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: mon mgr mkfs grace = 240 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd reporter subtree level = osd 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd prime pg temp = true 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:14:04.791 INFO:teuthology.orchestra.run.smithi113.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: # 1m isn't quite enough 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout:[client] 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: rgw cache enabled = true 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable ops log = true 2024-04-26T12:14:04.792 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable usage log = true 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.a] 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.b] 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.c] 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-04-26T12:14:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:14:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790],[v2:172.21.15.69:3302,v1:172.21.15.69:6791]" 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 38aaef92-b73b-4053-b2f0-6b2ea75fb544 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.796 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-04-26T12:14:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:14:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: osd max markdown count = 1000 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: osd memory target = 1610612736 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-04-26T12:14:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:14:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-04-26T12:14:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-26T12:14:04.803 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.804 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:14:04.805 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790],[v2:172.21.15.69:3302,v1:172.21.15.69:6791]" 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 38aaef92-b73b-4053-b2f0-6b2ea75fb544 2024-04-26T12:14:04.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-26T12:14:04.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-26T12:14:04.808 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:14:04.809 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: osd max markdown count = 1000 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: osd memory target = 1610612736 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-26T12:14:04.810 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:14:04.811 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-26T12:14:04.812 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-26T12:14:04.813 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:14:04.815 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:14:04.816 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:14:04.907 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:14:04.907 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:04.907 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:14:04.922 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:04.922 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:14:04.977 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi069.front.sepia.ceph.com 2024-04-26T12:14:04.977 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:04.977 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:14:04.977 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:14:05.049 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:05.049 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:05.104 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T12:14:05.104 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:05.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:14:05.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:14:05.143 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:05.144 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:05.200 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:14:05.201 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:05.201 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:14:05.201 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:14:05.239 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:05.239 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:05.297 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T12:14:05.298 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:05.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:14:05.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:14:05.331 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:05.331 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:05.386 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:14:05.386 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:14:05.387 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:14:05.435 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:14:05.438 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:14:05.484 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:14:05.487 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:14:05.487 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:14:05.534 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:14:05.537 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T12:14:05.560 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:14:05.560 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:14:05.639 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:14:05.650 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:14:05.651 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:14:05.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:14:05.679 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:14:05.679 INFO:tasks.ceph:role: osd.0 2024-04-26T12:14:05.679 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T12:14:05.679 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:14:05.745 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:14:05.745 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:14:05.745 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:14:05.746 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:14:05.746 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:14:05.746 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:14:05.746 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:14:05.746 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:14:05.746 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:14:05.746 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:14:05.778 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-04-26T12:14:05.780 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-04-26T12:14:05.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:14:05.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:14:05.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T12:14:06.054+0000 7fb0705cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:14:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T12:14:06.054+0000 7fb0705cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:14:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T12:14:06.054+0000 7fb0705cb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:14:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T12:14:06.054+0000 7fb0705cb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:14:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T12:14:06.054+0000 7fb0705cb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:14:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-04-26T12:14:06.055+0000 7fb0705cb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:14:08.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:14:08.942 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:14:08.970 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:14:08.970 INFO:tasks.ceph:role: osd.1 2024-04-26T12:14:08.970 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:14:08.970 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:14:09.044 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:14:09.045 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:14:09.575 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-04-26T12:14:09.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-04-26T12:14:09.578 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:14:09.674 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:14:09.709 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:09.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-26T12:14:09.805+0000 7fccfa486640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:14:09.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-26T12:14:09.808+0000 7fccfa486640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:14:09.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-26T12:14:09.808+0000 7fccfa486640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:14:09.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-26T12:14:09.808+0000 7fccfa486640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:14:09.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-26T12:14:09.808+0000 7fccfa486640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:14:09.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-26T12:14:09.815+0000 7fccfa486640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:14:12.668 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:14:12.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:14:12.726 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:14:12.726 INFO:tasks.ceph:role: osd.2 2024-04-26T12:14:12.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T12:14:12.726 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:14:12.801 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:14:12.801 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:14:12.801 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:14:12.801 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:14:12.802 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:14:12.802 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:14:12.802 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:14:12.802 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:14:12.802 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:14:12.802 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:14:13.311 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-26T12:14:13.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-26T12:14:13.313 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T12:14:13.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:14:13.474 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:13.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-26T12:14:13.574+0000 7fcd31750640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:14:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-26T12:14:13.574+0000 7fcd31750640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:14:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-26T12:14:13.574+0000 7fcd31750640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:14:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-26T12:14:13.574+0000 7fcd31750640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:14:13.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-26T12:14:13.574+0000 7fcd31750640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:14:13.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-26T12:14:13.577+0000 7fcd31750640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:14:16.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:14:16.460 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:14:16.460 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:16.460 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:14:16.488 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:16.488 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T12:14:16.555 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:16.555 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T12:14:16.620 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:16.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:14:16.649 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:16.649 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:14:16.677 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:16.677 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:14:16.706 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-26T12:14:16.706 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:14:16.722 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:14:16.723 DEBUG:teuthology.orchestra.run.smithi069:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.x] 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCNmitmWL7uGRAAcPQCewTLldjE958FTKr+xw== 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.y] 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCNmitme37jHBAAU6Bgfj/RifCACrUztEhEng== 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCNmitmQ/raHxAAJIdn9WmwG/b0h6ZbwvQZlA== 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.0] 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCOmitmUYVNAxAAbQ1oGPQKBEHbvlTg+bEwNg== 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.1] 2024-04-26T12:14:16.786 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCRmitmf84ZMBAAZyCxF7Fs/n4KEf3H+6dF0A== 2024-04-26T12:14:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.2] 2024-04-26T12:14:16.787 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCVmitmocxFIhAATJAix95rW97/QGvnfAKcew== 2024-04-26T12:14:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2024-04-26T12:14:16.787 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQCNmitmWK0TJhAAlwZ2vz4sYX7/wxAeDEH3EA== 2024-04-26T12:14:16.788 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:14:16.879 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:14:16.928 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T12:14:16.979 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:14:17.026 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:14:17.074 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:14:17.123 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:14:17.173 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:14:17.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:14:17.196 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:14:17.289 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:14:17.312 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T12:14:17.376 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:14:17.470 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T12:14:17.494 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T12:14:17.558 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:14:17.651 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T12:14:17.675 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:14:17.730 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:14:17.731 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:14:17.731 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:14:17.773 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:14:17.773 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T12:14:17.773 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T12:14:17.776 INFO:tasks.ceph.mon.b:Started 2024-04-26T12:14:17.776 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T12:14:17.776 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T12:14:17.778 INFO:tasks.ceph.mon.c:Started 2024-04-26T12:14:17.778 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:14:17.778 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:14:17.778 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:14:17.780 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:14:17.781 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T12:14:17.781 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T12:14:17.783 INFO:tasks.ceph.mgr.y:Started 2024-04-26T12:14:17.783 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:14:17.783 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:14:28.387 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:28.385+0000 7f4eb3110040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:14:28.468 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:28.388+0000 7fa048810040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:14:28.469 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2024-04-26T12:14:28.469 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:14:28.470 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:14:28.470 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-04-26T12:14:28.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:14:28.499 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-26T12:14:28.499 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:14:28.527 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T12:14:28.527 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:14:28.541 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:28.540+0000 7fa048810040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:14:28.543 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:28.541+0000 7f4eb3110040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:14:28.556 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 89200742-a13d-457a-aef2-b2a7ff7adfa9 0 2024-04-26T12:14:28.596 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:28.595+0000 7fa048810040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:14:28.598 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:28.597+0000 7f4eb3110040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:14:28.785 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-04-26T12:14:28.797 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new ea84835a-16c2-4100-a546-95ddfec7c9ae 1 2024-04-26T12:14:28.851 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:28.850+0000 7f4eb3110040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:14:28.852 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:28.850+0000 7fa048810040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:14:28.899 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:28.897+0000 7fa048810040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:14:28.899 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:28.897+0000 7f4eb3110040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:14:28.972 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-26T12:14:28.983 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new ee2ef2ba-d976-41f8-811d-8b1131867aac 2 2024-04-26T12:14:29.163 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-04-26T12:14:29.173 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:14:29.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:14:29.176 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:14:29.176 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:14:29.177 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:14:29.179 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:14:29.179 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:14:29.179 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:14:29.181 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:14:29.182 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:29.355 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:29.355 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:29.155786+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:29.365 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:14:29.366 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:14:29.646 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:29.644+0000 7fa048810040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:14:29.646 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:29.644+0000 7f4eb3110040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:14:29.667 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:29.737 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:29.735+0000 7f4eb3110040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:14:29.737 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:29.735+0000 7fa048810040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:14:29.766 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:14:29.764+0000 7fdc1900c640 -1 Falling back to public interface 2024-04-26T12:14:29.773 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:14:29.772+0000 7f055840f640 -1 Falling back to public interface 2024-04-26T12:14:29.774 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:14:29.772+0000 7f5f13212640 -1 Falling back to public interface 2024-04-26T12:14:29.782 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:29.780+0000 7fa048810040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:14:29.782 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:29.781+0000 7f4eb3110040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:14:29.827 INFO:teuthology.misc.health.smithi069.stdout: 2024-04-26T12:14:29.827 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":5,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:29.155786+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:29.837 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T12:14:29.954 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:29.952+0000 7f4eb3110040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:14:29.954 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:29.952+0000 7fa048810040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:14:30.005 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:30.003+0000 7f4eb3110040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:14:30.005 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:30.003+0000 7fa048810040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:14:30.059 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:30.057+0000 7fa048810040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:14:30.059 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:30.058+0000 7f4eb3110040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:14:30.174 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:30.173+0000 7fa048810040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:14:30.175 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:30.173+0000 7f4eb3110040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:14:30.569 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:30.567+0000 7fa048810040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:14:30.569 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:30.568+0000 7f4eb3110040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:14:30.834 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:30.832+0000 7f4eb3110040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:14:30.834 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:30.832+0000 7fa048810040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:14:30.888 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:30.886+0000 7f4eb3110040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:14:30.888 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:30.887+0000 7fa048810040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:14:31.008 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.006+0000 7fa048810040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:14:31.008 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.006+0000 7f4eb3110040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:14:31.289 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.287+0000 7fa048810040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:14:31.289 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.288+0000 7f4eb3110040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:14:31.338 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.336+0000 7fa048810040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:14:31.338 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.337+0000 7f4eb3110040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:14:31.500 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.498+0000 7f4eb3110040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:14:31.500 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.498+0000 7fa048810040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:14:31.640 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.638+0000 7fa048810040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:14:31.640 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.639+0000 7f4eb3110040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:14:31.691 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.690+0000 7fa048810040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:14:31.691 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.690+0000 7f4eb3110040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:14:31.764 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.762+0000 7f4eb3110040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:14:31.764 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.762+0000 7fa048810040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:14:31.810 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:31.809+0000 7fa048810040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:14:31.811 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:31.809+0000 7f4eb3110040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:14:32.300 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:32.298+0000 7f4eb3110040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:14:32.300 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:32.298+0000 7fa048810040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:14:32.418 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:32.416+0000 7fa048810040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:14:32.418 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-04-26T12:14:32.416+0000 7f4eb3110040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:14:33.189 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:14:33.188+0000 7f5f13212640 -1 osd.0 0 log_to_monitors true 2024-04-26T12:14:33.194 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:14:33.193+0000 7fdc1900c640 -1 osd.2 0 log_to_monitors true 2024-04-26T12:14:33.209 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:14:33.208+0000 7f055840f640 -1 osd.1 0 log_to_monitors true 2024-04-26T12:14:33.432 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:33.431+0000 7f9fe91d9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T12:14:33.433 INFO:tasks.ceph.mgr.y.smithi069.stderr:2024-04-26T12:14:33.431+0000 7f9fe91d9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T12:14:35.210 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:14:35.209+0000 7f05534f8640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:14:35.225 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:14:35.224+0000 7f054bb2b640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:14:35.244 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:14:35.243+0000 7f5f0e3b3640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:14:35.255 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:14:35.254+0000 7f5f069e6640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:14:35.440 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:14:35.439+0000 7fdc15a48640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:14:35.454 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:14:35.453+0000 7fdc0c840640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:14:36.141 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:36.423 INFO:teuthology.misc.health.smithi069.stdout: 2024-04-26T12:14:36.423 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":8,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:36.211532+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:36.434 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T12:14:36.435 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:14:36.435 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:14:37.220 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'rbd' created 2024-04-26T12:14:37.233 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:14:38.226 INFO:teuthology.orchestra.run.smithi069.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:14:38.239 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:14:38.239 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T12:14:38.240 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T12:14:38.242 INFO:tasks.ceph.mds.a:Started 2024-04-26T12:14:38.242 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T12:14:38.242 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:38.314 INFO:tasks.ceph.mds.a.smithi069.stdout:starting mds.a at 2024-04-26T12:14:38.532 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:38.533 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":10,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:38.214028+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:38.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:14:36.451914+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:14:36.730304+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:14:38.545 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:14:38.897 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-26T12:14:38.910 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:14:39.194 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2024-04-26T12:14:39.206 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:14:39.530 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:39.531 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6803/2901824101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":2901824101},{"type":"v1","addr":"172.21.15.69:6803","nonce":2901824101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T12:14:39.531 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 2 2024-04-26T12:14:39.543 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:39.819 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:39.819 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":11,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:39.217465+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:39.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:14:36.451914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:14:36.730304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:14:39.832 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:14:40.108 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-26T12:14:40.121 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:14:40.400 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2024-04-26T12:14:40.413 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T12:14:40.688 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 2, 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": "rbd" 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-26T12:14:40.689 INFO:teuthology.orchestra.run.smithi069.stdout:] 2024-04-26T12:14:40.702 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T12:14:40.702 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T12:14:41.513 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2024-04-26T12:14:41.526 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T12:14:42.520 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2024-04-26T12:14:42.535 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T12:14:42.858 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T12:14:42.872 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:43.149 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:43.149 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":14,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:42.847701+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:43.163 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:43.444 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:43.444 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":14,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:42.847701+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:43.457 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T12:14:43.869 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T12:14:43.869 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T12:14:44.885 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T12:14:44.885 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:14:45.201 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:45.201 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:14:42.847976+0000","modified":"2024-04-26T12:14:44.858997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6803/2901824101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":2901824101},{"type":"v1","addr":"172.21.15.69:6803","nonce":2901824101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:14:45.202 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-04-26T12:14:45.214 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:45.493 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:45.493 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:43.852134+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:45.506 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T12:14:45.506 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:45.789 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:45.791 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:14:45.800 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T12:14:44.424449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95808,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019712,"statfs":{"total":289910292480,"available":289812185088,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.913971"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221790+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:39.221790+0000","last_peered":"2024-04-26T12:14:39.221790+0000","last_clean":"2024-04-26T12:14:39.221790+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:39.221790+0000","last_undegraded":"2024-04-26T12:14:39.221790+0000","last_fullsized":"2024-04-26T12:14:39.221790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221796+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221796+0000","last_peered":"2024-04-26T12:14:39.221796+0000","last_clean":"2024-04-26T12:14:39.221796+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:39.221796+0000","last_undegraded":"2024-04-26T12:14:39.221796+0000","last_fullsized":"2024-04-26T12:14:39.221796+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221786+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:39.221786+0000","last_peered":"2024-04-26T12:14:39.221786+0000","last_clean":"2024-04-26T12:14:39.221786+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:39.221786+0000","last_undegraded":"2024-04-26T12:14:39.221786+0000","last_fullsized":"2024-04-26T12:14:39.221786+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198859+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:40.198859+0000","last_peered":"2024-04-26T12:14:40.198859+0000","last_clean":"2024-04-26T12:14:40.198859+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:40.198859+0000","last_undegraded":"2024-04-26T12:14:40.198859+0000","last_fullsized":"2024-04-26T12:14:40.198859+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198861+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:40.198861+0000","last_peered":"2024-04-26T12:14:40.198861+0000","last_clean":"2024-04-26T12:14:40.198861+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:40.198861+0000","last_undegraded":"2024-04-26T12:14:40.198861+0000","last_fullsized":"2024-04-26T12:14:40.198861+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198885+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:40.198885+0000","last_peered":"2024-04-26T12:14:40.198885+0000","last_clean":"2024-04-26T12:14:40.198885+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:40.198885+0000","last_undegraded":"2024-04-26T12:14:40.198885+0000","last_fullsized":"2024-04-26T12:14:40.198885+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221767+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:39.221767+0000","last_peered":"2024-04-26T12:14:39.221767+0000","last_clean":"2024-04-26T12:14:39.221767+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:39.221767+0000","last_undegraded":"2024-04-26T12:14:39.221767+0000","last_fullsized":"2024-04-26T12:14:39.221767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35312,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336528,"statfs":{"total":96636764160,"available":96600604672,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:45.807 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:46.125 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:46.126 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:14:46.136 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T12:14:44.424449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95808,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019712,"statfs":{"total":289910292480,"available":289812185088,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.913971"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221790+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:39.221790+0000","last_peered":"2024-04-26T12:14:39.221790+0000","last_clean":"2024-04-26T12:14:39.221790+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:39.221790+0000","last_undegraded":"2024-04-26T12:14:39.221790+0000","last_fullsized":"2024-04-26T12:14:39.221790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221796+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221796+0000","last_peered":"2024-04-26T12:14:39.221796+0000","last_clean":"2024-04-26T12:14:39.221796+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:39.221796+0000","last_undegraded":"2024-04-26T12:14:39.221796+0000","last_fullsized":"2024-04-26T12:14:39.221796+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221786+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:39.221786+0000","last_peered":"2024-04-26T12:14:39.221786+0000","last_clean":"2024-04-26T12:14:39.221786+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:39.221786+0000","last_undegraded":"2024-04-26T12:14:39.221786+0000","last_fullsized":"2024-04-26T12:14:39.221786+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198859+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:40.198859+0000","last_peered":"2024-04-26T12:14:40.198859+0000","last_clean":"2024-04-26T12:14:40.198859+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:40.198859+0000","last_undegraded":"2024-04-26T12:14:40.198859+0000","last_fullsized":"2024-04-26T12:14:40.198859+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198861+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:40.198861+0000","last_peered":"2024-04-26T12:14:40.198861+0000","last_clean":"2024-04-26T12:14:40.198861+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:40.198861+0000","last_undegraded":"2024-04-26T12:14:40.198861+0000","last_fullsized":"2024-04-26T12:14:40.198861+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198885+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:40.198885+0000","last_peered":"2024-04-26T12:14:40.198885+0000","last_clean":"2024-04-26T12:14:40.198885+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:40.198885+0000","last_undegraded":"2024-04-26T12:14:40.198885+0000","last_fullsized":"2024-04-26T12:14:40.198885+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221767+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:39.221767+0000","last_peered":"2024-04-26T12:14:39.221767+0000","last_clean":"2024-04-26T12:14:39.221767+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:39.221767+0000","last_undegraded":"2024-04-26T12:14:39.221767+0000","last_fullsized":"2024-04-26T12:14:39.221767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35312,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336528,"statfs":{"total":96636764160,"available":96600604672,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:46.140 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:46.457 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:46.458 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:14:46.468 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:14:46.424768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95808,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019712,"statfs":{"total":289910292480,"available":289812185088,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914290"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221790+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:39.221790+0000","last_peered":"2024-04-26T12:14:39.221790+0000","last_clean":"2024-04-26T12:14:39.221790+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:39.221790+0000","last_undegraded":"2024-04-26T12:14:39.221790+0000","last_fullsized":"2024-04-26T12:14:39.221790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221796+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221796+0000","last_peered":"2024-04-26T12:14:39.221796+0000","last_clean":"2024-04-26T12:14:39.221796+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:39.221796+0000","last_undegraded":"2024-04-26T12:14:39.221796+0000","last_fullsized":"2024-04-26T12:14:39.221796+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221786+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:39.221786+0000","last_peered":"2024-04-26T12:14:39.221786+0000","last_clean":"2024-04-26T12:14:39.221786+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:39.221786+0000","last_undegraded":"2024-04-26T12:14:39.221786+0000","last_fullsized":"2024-04-26T12:14:39.221786+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198859+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:40.198859+0000","last_peered":"2024-04-26T12:14:40.198859+0000","last_clean":"2024-04-26T12:14:40.198859+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:40.198859+0000","last_undegraded":"2024-04-26T12:14:40.198859+0000","last_fullsized":"2024-04-26T12:14:40.198859+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198861+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:40.198861+0000","last_peered":"2024-04-26T12:14:40.198861+0000","last_clean":"2024-04-26T12:14:40.198861+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:40.198861+0000","last_undegraded":"2024-04-26T12:14:40.198861+0000","last_fullsized":"2024-04-26T12:14:40.198861+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198885+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:40.198885+0000","last_peered":"2024-04-26T12:14:40.198885+0000","last_clean":"2024-04-26T12:14:40.198885+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:40.198885+0000","last_undegraded":"2024-04-26T12:14:40.198885+0000","last_fullsized":"2024-04-26T12:14:40.198885+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221767+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:39.221767+0000","last_peered":"2024-04-26T12:14:39.221767+0000","last_clean":"2024-04-26T12:14:39.221767+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:39.221767+0000","last_undegraded":"2024-04-26T12:14:39.221767+0000","last_fullsized":"2024-04-26T12:14:39.221767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35312,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336528,"statfs":{"total":96636764160,"available":96600604672,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-26T12:14:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-26T12:14:46.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-26T12:14:46.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-26T12:14:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-26T12:14:46.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-26T12:14:46.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-26T12:14:46.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-26T12:14:46.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-26T12:14:46.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-26T12:14:46.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-26T12:14:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-26T12:14:46.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-26T12:14:46.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-26T12:14:46.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-26T12:14:46.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-26T12:14:46.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:42.510472+0000', 'last_change': '2024-04-26T12:14:42.510472+0000', 'last_active': '2024-04-26T12:14:42.510472+0000', 'last_peered': '2024-04-26T12:14:42.510472+0000', 'last_clean': '2024-04-26T12:14:42.510472+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:42.510472+0000', 'last_undegraded': '2024-04-26T12:14:42.510472+0000', 'last_fullsized': '2024-04-26T12:14:42.510472+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:42.510472+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-26T12:14:46.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T12:14:41.505865+0000', 'last_change': '2024-04-26T12:14:41.505865+0000', 'last_active': '2024-04-26T12:14:41.505865+0000', 'last_peered': '2024-04-26T12:14:41.505865+0000', 'last_clean': '2024-04-26T12:14:41.505865+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T12:14:41.505865+0000', 'last_undegraded': '2024-04-26T12:14:41.505865+0000', 'last_fullsized': '2024-04-26T12:14:41.505865+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'last_clean_scrub_stamp': '2024-04-26T12:14:41.505865+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T12:14:46.491 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:14:46.851 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:46.851 INFO:teuthology.orchestra.run.smithi069.stdout:{"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":18,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1714133676,"num_in_osds":3,"osd_in_since":1714133669,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":98107392,"bytes_avail":289812185088,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4186}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T12:14:27.921966+0000","services":{}},"progress_events":{}} 2024-04-26T12:14:46.864 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T12:14:46.865 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:47.148 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:47.149 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:14:47.159 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:14:46.424768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95808,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019712,"statfs":{"total":289910292480,"available":289812185088,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914290"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221790+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:39.221790+0000","last_peered":"2024-04-26T12:14:39.221790+0000","last_clean":"2024-04-26T12:14:39.221790+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:39.221790+0000","last_undegraded":"2024-04-26T12:14:39.221790+0000","last_fullsized":"2024-04-26T12:14:39.221790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221796+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221796+0000","last_peered":"2024-04-26T12:14:39.221796+0000","last_clean":"2024-04-26T12:14:39.221796+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:39.221796+0000","last_undegraded":"2024-04-26T12:14:39.221796+0000","last_fullsized":"2024-04-26T12:14:39.221796+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221786+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:39.221786+0000","last_peered":"2024-04-26T12:14:39.221786+0000","last_clean":"2024-04-26T12:14:39.221786+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:39.221786+0000","last_undegraded":"2024-04-26T12:14:39.221786+0000","last_fullsized":"2024-04-26T12:14:39.221786+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198859+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:40.198859+0000","last_peered":"2024-04-26T12:14:40.198859+0000","last_clean":"2024-04-26T12:14:40.198859+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:40.198859+0000","last_undegraded":"2024-04-26T12:14:40.198859+0000","last_fullsized":"2024-04-26T12:14:40.198859+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198861+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:40.198861+0000","last_peered":"2024-04-26T12:14:40.198861+0000","last_clean":"2024-04-26T12:14:40.198861+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:40.198861+0000","last_undegraded":"2024-04-26T12:14:40.198861+0000","last_fullsized":"2024-04-26T12:14:40.198861+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221802+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:39.221802+0000","last_peered":"2024-04-26T12:14:39.221802+0000","last_clean":"2024-04-26T12:14:39.221802+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:39.221802+0000","last_undegraded":"2024-04-26T12:14:39.221802+0000","last_fullsized":"2024-04-26T12:14:39.221802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.198885+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:40.198885+0000","last_peered":"2024-04-26T12:14:40.198885+0000","last_clean":"2024-04-26T12:14:40.198885+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:40.198885+0000","last_undegraded":"2024-04-26T12:14:40.198885+0000","last_fullsized":"2024-04-26T12:14:40.198885+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:14:39.221767+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:39.221767+0000","last_peered":"2024-04-26T12:14:39.221767+0000","last_clean":"2024-04-26T12:14:39.221767+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:39.221767+0000","last_undegraded":"2024-04-26T12:14:39.221767+0000","last_fullsized":"2024-04-26T12:14:39.221767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:42.510472+0000","last_change":"2024-04-26T12:14:42.510472+0000","last_active":"2024-04-26T12:14:42.510472+0000","last_peered":"2024-04-26T12:14:42.510472+0000","last_clean":"2024-04-26T12:14:42.510472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:42.510472+0000","last_undegraded":"2024-04-26T12:14:42.510472+0000","last_fullsized":"2024-04-26T12:14:42.510472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:14:41.505865+0000","last_change":"2024-04-26T12:14:41.505865+0000","last_active":"2024-04-26T12:14:41.505865+0000","last_peered":"2024-04-26T12:14:41.505865+0000","last_clean":"2024-04-26T12:14:41.505865+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:14:41.505865+0000","last_undegraded":"2024-04-26T12:14:41.505865+0000","last_fullsized":"2024-04-26T12:14:41.505865+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35312,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336528,"statfs":{"total":96636764160,"available":96600604672,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:48.326 INFO:tasks.ceph.mds.a.smithi069.stderr:2024-04-26T12:14:48.325+0000 7f5df4e21640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T12:14:50.164 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:50.460 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:50.461 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:14:50.470 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T12:14:50.425545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94972,"kb_used_data":1600,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020548,"statfs":{"total":289910292480,"available":289813041152,"internally_reserved":0,"allocated":1638400,"data_stored":1318998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.907930"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867707+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:14:43.867707+0000","last_peered":"2024-04-26T12:14:43.867707+0000","last_clean":"2024-04-26T12:14:43.867707+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:14:43.867707+0000","last_undegraded":"2024-04-26T12:14:43.867707+0000","last_fullsized":"2024-04-26T12:14:43.867707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867546+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:14:43.867546+0000","last_peered":"2024-04-26T12:14:43.867546+0000","last_clean":"2024-04-26T12:14:43.867546+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:14:43.867546+0000","last_undegraded":"2024-04-26T12:14:43.867546+0000","last_fullsized":"2024-04-26T12:14:43.867546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867948+0000","last_change":"2024-04-26T12:14:42.872215+0000","last_active":"2024-04-26T12:14:43.867948+0000","last_peered":"2024-04-26T12:14:43.867948+0000","last_clean":"2024-04-26T12:14:43.867948+0000","last_became_active":"2024-04-26T12:14:42.871084+0000","last_became_peered":"2024-04-26T12:14:42.871084+0000","last_unstale":"2024-04-26T12:14:43.867948+0000","last_undegraded":"2024-04-26T12:14:43.867948+0000","last_fullsized":"2024-04-26T12:14:43.867948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:54.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867375+0000","last_change":"2024-04-26T12:14:42.869954+0000","last_active":"2024-04-26T12:14:43.867375+0000","last_peered":"2024-04-26T12:14:43.867375+0000","last_clean":"2024-04-26T12:14:43.867375+0000","last_became_active":"2024-04-26T12:14:42.869262+0000","last_became_peered":"2024-04-26T12:14:42.869262+0000","last_unstale":"2024-04-26T12:14:43.867375+0000","last_undegraded":"2024-04-26T12:14:43.867375+0000","last_fullsized":"2024-04-26T12:14:43.867375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:41.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867412+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:14:43.867412+0000","last_peered":"2024-04-26T12:14:43.867412+0000","last_clean":"2024-04-26T12:14:43.867412+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:14:43.867412+0000","last_undegraded":"2024-04-26T12:14:43.867412+0000","last_fullsized":"2024-04-26T12:14:43.867412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867032+0000","last_change":"2024-04-26T12:14:42.870198+0000","last_active":"2024-04-26T12:14:43.867032+0000","last_peered":"2024-04-26T12:14:43.867032+0000","last_clean":"2024-04-26T12:14:43.867032+0000","last_became_active":"2024-04-26T12:14:42.869783+0000","last_became_peered":"2024-04-26T12:14:42.869783+0000","last_unstale":"2024-04-26T12:14:43.867032+0000","last_undegraded":"2024-04-26T12:14:43.867032+0000","last_fullsized":"2024-04-26T12:14:43.867032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:03.272719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867135+0000","last_change":"2024-04-26T12:14:42.867620+0000","last_active":"2024-04-26T12:14:43.867135+0000","last_peered":"2024-04-26T12:14:43.867135+0000","last_clean":"2024-04-26T12:14:43.867135+0000","last_became_active":"2024-04-26T12:14:42.866727+0000","last_became_peered":"2024-04-26T12:14:42.866727+0000","last_unstale":"2024-04-26T12:14:43.867135+0000","last_undegraded":"2024-04-26T12:14:43.867135+0000","last_fullsized":"2024-04-26T12:14:43.867135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866936+0000","last_change":"2024-04-26T12:14:42.871957+0000","last_active":"2024-04-26T12:14:43.866936+0000","last_peered":"2024-04-26T12:14:43.866936+0000","last_clean":"2024-04-26T12:14:43.866936+0000","last_became_active":"2024-04-26T12:14:42.870987+0000","last_became_peered":"2024-04-26T12:14:42.870987+0000","last_unstale":"2024-04-26T12:14:43.866936+0000","last_undegraded":"2024-04-26T12:14:43.866936+0000","last_fullsized":"2024-04-26T12:14:43.866936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.657803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.868677+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:14:42.868677+0000","last_peered":"2024-04-26T12:14:42.868677+0000","last_clean":"2024-04-26T12:14:42.868677+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:14:42.868677+0000","last_undegraded":"2024-04-26T12:14:42.868677+0000","last_fullsized":"2024-04-26T12:14:42.868677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867722+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:14:43.867722+0000","last_peered":"2024-04-26T12:14:43.867722+0000","last_clean":"2024-04-26T12:14:43.867722+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:14:43.867722+0000","last_undegraded":"2024-04-26T12:14:43.867722+0000","last_fullsized":"2024-04-26T12:14:43.867722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867635+0000","last_change":"2024-04-26T12:14:42.870737+0000","last_active":"2024-04-26T12:14:43.867635+0000","last_peered":"2024-04-26T12:14:43.867635+0000","last_clean":"2024-04-26T12:14:43.867635+0000","last_became_active":"2024-04-26T12:14:42.870218+0000","last_became_peered":"2024-04-26T12:14:42.870218+0000","last_unstale":"2024-04-26T12:14:43.867635+0000","last_undegraded":"2024-04-26T12:14:43.867635+0000","last_fullsized":"2024-04-26T12:14:43.867635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:47.108520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867459+0000","last_change":"2024-04-26T12:14:42.870694+0000","last_active":"2024-04-26T12:14:43.867459+0000","last_peered":"2024-04-26T12:14:43.867459+0000","last_clean":"2024-04-26T12:14:43.867459+0000","last_became_active":"2024-04-26T12:14:42.870325+0000","last_became_peered":"2024-04-26T12:14:42.870325+0000","last_unstale":"2024-04-26T12:14:43.867459+0000","last_undegraded":"2024-04-26T12:14:43.867459+0000","last_fullsized":"2024-04-26T12:14:43.867459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867047+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:14:43.867047+0000","last_peered":"2024-04-26T12:14:43.867047+0000","last_clean":"2024-04-26T12:14:43.867047+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:14:43.867047+0000","last_undegraded":"2024-04-26T12:14:43.867047+0000","last_fullsized":"2024-04-26T12:14:43.867047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867184+0000","last_change":"2024-04-26T12:14:42.868400+0000","last_active":"2024-04-26T12:14:43.867184+0000","last_peered":"2024-04-26T12:14:43.867184+0000","last_clean":"2024-04-26T12:14:43.867184+0000","last_became_active":"2024-04-26T12:14:42.867646+0000","last_became_peered":"2024-04-26T12:14:42.867646+0000","last_unstale":"2024-04-26T12:14:43.867184+0000","last_undegraded":"2024-04-26T12:14:43.867184+0000","last_fullsized":"2024-04-26T12:14:43.867184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867236+0000","last_change":"2024-04-26T12:14:42.867157+0000","last_active":"2024-04-26T12:14:43.867236+0000","last_peered":"2024-04-26T12:14:43.867236+0000","last_clean":"2024-04-26T12:14:43.867236+0000","last_became_active":"2024-04-26T12:14:42.865840+0000","last_became_peered":"2024-04-26T12:14:42.865840+0000","last_unstale":"2024-04-26T12:14:43.867236+0000","last_undegraded":"2024-04-26T12:14:43.867236+0000","last_fullsized":"2024-04-26T12:14:43.867236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866901+0000","last_change":"2024-04-26T12:14:42.871915+0000","last_active":"2024-04-26T12:14:43.866901+0000","last_peered":"2024-04-26T12:14:43.866901+0000","last_clean":"2024-04-26T12:14:43.866901+0000","last_became_active":"2024-04-26T12:14:42.870604+0000","last_became_peered":"2024-04-26T12:14:42.870604+0000","last_unstale":"2024-04-26T12:14:43.866901+0000","last_undegraded":"2024-04-26T12:14:43.866901+0000","last_fullsized":"2024-04-26T12:14:43.866901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.873343+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:14:42.873343+0000","last_peered":"2024-04-26T12:14:42.873343+0000","last_clean":"2024-04-26T12:14:42.873343+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:42.873343+0000","last_undegraded":"2024-04-26T12:14:42.873343+0000","last_fullsized":"2024-04-26T12:14:42.873343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867812+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:14:43.867812+0000","last_peered":"2024-04-26T12:14:43.867812+0000","last_clean":"2024-04-26T12:14:43.867812+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:14:43.867812+0000","last_undegraded":"2024-04-26T12:14:43.867812+0000","last_fullsized":"2024-04-26T12:14:43.867812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.868615+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:14:42.868615+0000","last_peered":"2024-04-26T12:14:42.868615+0000","last_clean":"2024-04-26T12:14:42.868615+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:14:42.868615+0000","last_undegraded":"2024-04-26T12:14:42.868615+0000","last_fullsized":"2024-04-26T12:14:42.868615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867547+0000","last_change":"2024-04-26T12:14:42.869830+0000","last_active":"2024-04-26T12:14:43.867547+0000","last_peered":"2024-04-26T12:14:43.867547+0000","last_clean":"2024-04-26T12:14:43.867547+0000","last_became_active":"2024-04-26T12:14:42.869225+0000","last_became_peered":"2024-04-26T12:14:42.869225+0000","last_unstale":"2024-04-26T12:14:43.867547+0000","last_undegraded":"2024-04-26T12:14:43.867547+0000","last_fullsized":"2024-04-26T12:14:43.867547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:53.111870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867710+0000","last_change":"2024-04-26T12:14:42.868630+0000","last_active":"2024-04-26T12:14:43.867710+0000","last_peered":"2024-04-26T12:14:43.867710+0000","last_clean":"2024-04-26T12:14:43.867710+0000","last_became_active":"2024-04-26T12:14:42.867548+0000","last_became_peered":"2024-04-26T12:14:42.867548+0000","last_unstale":"2024-04-26T12:14:43.867710+0000","last_undegraded":"2024-04-26T12:14:43.867710+0000","last_fullsized":"2024-04-26T12:14:43.867710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866911+0000","last_change":"2024-04-26T12:14:42.870882+0000","last_active":"2024-04-26T12:14:43.866911+0000","last_peered":"2024-04-26T12:14:43.866911+0000","last_clean":"2024-04-26T12:14:43.866911+0000","last_became_active":"2024-04-26T12:14:42.870623+0000","last_became_peered":"2024-04-26T12:14:42.870623+0000","last_unstale":"2024-04-26T12:14:43.866911+0000","last_undegraded":"2024-04-26T12:14:43.866911+0000","last_fullsized":"2024-04-26T12:14:43.866911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.868666+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:42.868666+0000","last_peered":"2024-04-26T12:14:42.868666+0000","last_clean":"2024-04-26T12:14:42.868666+0000","last_became_active":"2024-04-26T12:14:42.867223+0000","last_became_peered":"2024-04-26T12:14:42.867223+0000","last_unstale":"2024-04-26T12:14:42.868666+0000","last_undegraded":"2024-04-26T12:14:42.868666+0000","last_fullsized":"2024-04-26T12:14:42.868666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866690+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:14:43.866690+0000","last_peered":"2024-04-26T12:14:43.866690+0000","last_clean":"2024-04-26T12:14:43.866690+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:14:43.866690+0000","last_undegraded":"2024-04-26T12:14:43.866690+0000","last_fullsized":"2024-04-26T12:14:43.866690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867693+0000","last_change":"2024-04-26T12:14:42.874005+0000","last_active":"2024-04-26T12:14:43.867693+0000","last_peered":"2024-04-26T12:14:43.867693+0000","last_clean":"2024-04-26T12:14:43.867693+0000","last_became_active":"2024-04-26T12:14:42.873631+0000","last_became_peered":"2024-04-26T12:14:42.873631+0000","last_unstale":"2024-04-26T12:14:43.867693+0000","last_undegraded":"2024-04-26T12:14:43.867693+0000","last_fullsized":"2024-04-26T12:14:43.867693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.874293+0000","last_change":"2024-04-26T12:14:42.873571+0000","last_active":"2024-04-26T12:14:42.874293+0000","last_peered":"2024-04-26T12:14:42.874293+0000","last_clean":"2024-04-26T12:14:42.874293+0000","last_became_active":"2024-04-26T12:14:42.873286+0000","last_became_peered":"2024-04-26T12:14:42.873286+0000","last_unstale":"2024-04-26T12:14:42.874293+0000","last_undegraded":"2024-04-26T12:14:42.874293+0000","last_fullsized":"2024-04-26T12:14:42.874293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868004+0000","last_change":"2024-04-26T12:14:42.870555+0000","last_active":"2024-04-26T12:14:43.868004+0000","last_peered":"2024-04-26T12:14:43.868004+0000","last_clean":"2024-04-26T12:14:43.868004+0000","last_became_active":"2024-04-26T12:14:42.869400+0000","last_became_peered":"2024-04-26T12:14:42.869400+0000","last_unstale":"2024-04-26T12:14:43.868004+0000","last_undegraded":"2024-04-26T12:14:43.868004+0000","last_fullsized":"2024-04-26T12:14:43.868004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:23.492068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867621+0000","last_change":"2024-04-26T12:14:42.874272+0000","last_active":"2024-04-26T12:14:43.867621+0000","last_peered":"2024-04-26T12:14:43.867621+0000","last_clean":"2024-04-26T12:14:43.867621+0000","last_became_active":"2024-04-26T12:14:42.873934+0000","last_became_peered":"2024-04-26T12:14:42.873934+0000","last_unstale":"2024-04-26T12:14:43.867621+0000","last_undegraded":"2024-04-26T12:14:43.867621+0000","last_fullsized":"2024-04-26T12:14:43.867621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:05.149736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.868011+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:14:42.868011+0000","last_peered":"2024-04-26T12:14:42.868011+0000","last_clean":"2024-04-26T12:14:42.868011+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:14:42.868011+0000","last_undegraded":"2024-04-26T12:14:42.868011+0000","last_fullsized":"2024-04-26T12:14:42.868011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867101+0000","last_change":"2024-04-26T12:14:42.867054+0000","last_active":"2024-04-26T12:14:43.867101+0000","last_peered":"2024-04-26T12:14:43.867101+0000","last_clean":"2024-04-26T12:14:43.867101+0000","last_became_active":"2024-04-26T12:14:42.866676+0000","last_became_peered":"2024-04-26T12:14:42.866676+0000","last_unstale":"2024-04-26T12:14:43.867101+0000","last_undegraded":"2024-04-26T12:14:43.867101+0000","last_fullsized":"2024-04-26T12:14:43.867101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.868655+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:14:42.868655+0000","last_peered":"2024-04-26T12:14:42.868655+0000","last_clean":"2024-04-26T12:14:42.868655+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:14:42.868655+0000","last_undegraded":"2024-04-26T12:14:42.868655+0000","last_fullsized":"2024-04-26T12:14:42.868655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867023+0000","last_change":"2024-04-26T12:14:42.871222+0000","last_active":"2024-04-26T12:14:43.867023+0000","last_peered":"2024-04-26T12:14:43.867023+0000","last_clean":"2024-04-26T12:14:43.867023+0000","last_became_active":"2024-04-26T12:14:42.870454+0000","last_became_peered":"2024-04-26T12:14:42.870454+0000","last_unstale":"2024-04-26T12:14:43.867023+0000","last_undegraded":"2024-04-26T12:14:43.867023+0000","last_fullsized":"2024-04-26T12:14:43.867023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867584+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:14:43.867584+0000","last_peered":"2024-04-26T12:14:43.867584+0000","last_clean":"2024-04-26T12:14:43.867584+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:14:43.867584+0000","last_undegraded":"2024-04-26T12:14:43.867584+0000","last_fullsized":"2024-04-26T12:14:43.867584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867972+0000","last_change":"2024-04-26T12:14:42.527996+0000","last_active":"2024-04-26T12:14:43.867972+0000","last_peered":"2024-04-26T12:14:43.867972+0000","last_clean":"2024-04-26T12:14:43.867972+0000","last_became_active":"2024-04-26T12:14:42.527615+0000","last_became_peered":"2024-04-26T12:14:42.527615+0000","last_unstale":"2024-04-26T12:14:43.867972+0000","last_undegraded":"2024-04-26T12:14:43.867972+0000","last_fullsized":"2024-04-26T12:14:43.867972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867703+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:14:43.867703+0000","last_peered":"2024-04-26T12:14:43.867703+0000","last_clean":"2024-04-26T12:14:43.867703+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:14:43.867703+0000","last_undegraded":"2024-04-26T12:14:43.867703+0000","last_fullsized":"2024-04-26T12:14:43.867703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.857021+0000","last_change":"2024-04-26T12:14:42.529666+0000","last_active":"2024-04-26T12:14:42.857021+0000","last_peered":"2024-04-26T12:14:42.857021+0000","last_clean":"2024-04-26T12:14:42.857021+0000","last_became_active":"2024-04-26T12:14:42.529366+0000","last_became_peered":"2024-04-26T12:14:42.529366+0000","last_unstale":"2024-04-26T12:14:42.857021+0000","last_undegraded":"2024-04-26T12:14:42.857021+0000","last_fullsized":"2024-04-26T12:14:42.857021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.874281+0000","last_change":"2024-04-26T12:14:42.873577+0000","last_active":"2024-04-26T12:14:42.874281+0000","last_peered":"2024-04-26T12:14:42.874281+0000","last_clean":"2024-04-26T12:14:42.874281+0000","last_became_active":"2024-04-26T12:14:42.873183+0000","last_became_peered":"2024-04-26T12:14:42.873183+0000","last_unstale":"2024-04-26T12:14:42.874281+0000","last_undegraded":"2024-04-26T12:14:42.874281+0000","last_fullsized":"2024-04-26T12:14:42.874281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867161+0000","last_change":"2024-04-26T12:14:42.533710+0000","last_active":"2024-04-26T12:14:43.867161+0000","last_peered":"2024-04-26T12:14:43.867161+0000","last_clean":"2024-04-26T12:14:43.867161+0000","last_became_active":"2024-04-26T12:14:42.533436+0000","last_became_peered":"2024-04-26T12:14:42.533436+0000","last_unstale":"2024-04-26T12:14:43.867161+0000","last_undegraded":"2024-04-26T12:14:43.867161+0000","last_fullsized":"2024-04-26T12:14:43.867161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.872783+0000","last_change":"2024-04-26T12:14:42.871019+0000","last_active":"2024-04-26T12:14:42.872783+0000","last_peered":"2024-04-26T12:14:42.872783+0000","last_clean":"2024-04-26T12:14:42.872783+0000","last_became_active":"2024-04-26T12:14:42.870630+0000","last_became_peered":"2024-04-26T12:14:42.870630+0000","last_unstale":"2024-04-26T12:14:42.872783+0000","last_undegraded":"2024-04-26T12:14:42.872783+0000","last_fullsized":"2024-04-26T12:14:42.872783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867164+0000","last_change":"2024-04-26T12:14:42.533517+0000","last_active":"2024-04-26T12:14:43.867164+0000","last_peered":"2024-04-26T12:14:43.867164+0000","last_clean":"2024-04-26T12:14:43.867164+0000","last_became_active":"2024-04-26T12:14:42.532693+0000","last_became_peered":"2024-04-26T12:14:42.532693+0000","last_unstale":"2024-04-26T12:14:43.867164+0000","last_undegraded":"2024-04-26T12:14:43.867164+0000","last_fullsized":"2024-04-26T12:14:43.867164+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868125+0000","last_change":"2024-04-26T12:14:42.532602+0000","last_active":"2024-04-26T12:14:43.868125+0000","last_peered":"2024-04-26T12:14:43.868125+0000","last_clean":"2024-04-26T12:14:43.868125+0000","last_became_active":"2024-04-26T12:14:42.531944+0000","last_became_peered":"2024-04-26T12:14:42.531944+0000","last_unstale":"2024-04-26T12:14:43.868125+0000","last_undegraded":"2024-04-26T12:14:43.868125+0000","last_fullsized":"2024-04-26T12:14:43.868125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866726+0000","last_change":"2024-04-26T12:14:42.871236+0000","last_active":"2024-04-26T12:14:43.866726+0000","last_peered":"2024-04-26T12:14:43.866726+0000","last_clean":"2024-04-26T12:14:43.866726+0000","last_became_active":"2024-04-26T12:14:42.871041+0000","last_became_peered":"2024-04-26T12:14:42.871041+0000","last_unstale":"2024-04-26T12:14:43.866726+0000","last_undegraded":"2024-04-26T12:14:43.866726+0000","last_fullsized":"2024-04-26T12:14:43.866726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:26.643464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867860+0000","last_change":"2024-04-26T12:14:42.534442+0000","last_active":"2024-04-26T12:14:43.867860+0000","last_peered":"2024-04-26T12:14:43.867860+0000","last_clean":"2024-04-26T12:14:43.867860+0000","last_became_active":"2024-04-26T12:14:42.534150+0000","last_became_peered":"2024-04-26T12:14:42.534150+0000","last_unstale":"2024-04-26T12:14:43.867860+0000","last_undegraded":"2024-04-26T12:14:43.867860+0000","last_fullsized":"2024-04-26T12:14:43.867860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:37.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868126+0000","last_change":"2024-04-26T12:14:42.530595+0000","last_active":"2024-04-26T12:14:43.868126+0000","last_peered":"2024-04-26T12:14:43.868126+0000","last_clean":"2024-04-26T12:14:43.868126+0000","last_became_active":"2024-04-26T12:14:42.529757+0000","last_became_peered":"2024-04-26T12:14:42.529757+0000","last_unstale":"2024-04-26T12:14:43.868126+0000","last_undegraded":"2024-04-26T12:14:43.868126+0000","last_fullsized":"2024-04-26T12:14:43.868126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867296+0000","last_change":"2024-04-26T12:14:42.869311+0000","last_active":"2024-04-26T12:14:43.867296+0000","last_peered":"2024-04-26T12:14:43.867296+0000","last_clean":"2024-04-26T12:14:43.867296+0000","last_became_active":"2024-04-26T12:14:42.868477+0000","last_became_peered":"2024-04-26T12:14:42.868477+0000","last_unstale":"2024-04-26T12:14:43.867296+0000","last_undegraded":"2024-04-26T12:14:43.867296+0000","last_fullsized":"2024-04-26T12:14:43.867296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867818+0000","last_change":"2024-04-26T12:14:42.528134+0000","last_active":"2024-04-26T12:14:43.867818+0000","last_peered":"2024-04-26T12:14:43.867818+0000","last_clean":"2024-04-26T12:14:43.867818+0000","last_became_active":"2024-04-26T12:14:42.527701+0000","last_became_peered":"2024-04-26T12:14:42.527701+0000","last_unstale":"2024-04-26T12:14:43.867818+0000","last_undegraded":"2024-04-26T12:14:43.867818+0000","last_fullsized":"2024-04-26T12:14:43.867818+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.873362+0000","last_change":"2024-04-26T12:14:42.872162+0000","last_active":"2024-04-26T12:14:42.873362+0000","last_peered":"2024-04-26T12:14:42.873362+0000","last_clean":"2024-04-26T12:14:42.873362+0000","last_became_active":"2024-04-26T12:14:42.871777+0000","last_became_peered":"2024-04-26T12:14:42.871777+0000","last_unstale":"2024-04-26T12:14:42.873362+0000","last_undegraded":"2024-04-26T12:14:42.873362+0000","last_fullsized":"2024-04-26T12:14:42.873362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.873535+0000","last_change":"2024-04-26T12:14:42.530739+0000","last_active":"2024-04-26T12:14:42.873535+0000","last_peered":"2024-04-26T12:14:42.873535+0000","last_clean":"2024-04-26T12:14:42.873535+0000","last_became_active":"2024-04-26T12:14:42.530380+0000","last_became_peered":"2024-04-26T12:14:42.530380+0000","last_unstale":"2024-04-26T12:14:42.873535+0000","last_undegraded":"2024-04-26T12:14:42.873535+0000","last_fullsized":"2024-04-26T12:14:42.873535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867734+0000","last_change":"2024-04-26T12:14:42.869606+0000","last_active":"2024-04-26T12:14:43.867734+0000","last_peered":"2024-04-26T12:14:43.867734+0000","last_clean":"2024-04-26T12:14:43.867734+0000","last_became_active":"2024-04-26T12:14:42.868445+0000","last_became_peered":"2024-04-26T12:14:42.868445+0000","last_unstale":"2024-04-26T12:14:43.867734+0000","last_undegraded":"2024-04-26T12:14:43.867734+0000","last_fullsized":"2024-04-26T12:14:43.867734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867653+0000","last_change":"2024-04-26T12:14:42.529285+0000","last_active":"2024-04-26T12:14:43.867653+0000","last_peered":"2024-04-26T12:14:43.867653+0000","last_clean":"2024-04-26T12:14:43.867653+0000","last_became_active":"2024-04-26T12:14:42.528618+0000","last_became_peered":"2024-04-26T12:14:42.528618+0000","last_unstale":"2024-04-26T12:14:43.867653+0000","last_undegraded":"2024-04-26T12:14:43.867653+0000","last_fullsized":"2024-04-26T12:14:43.867653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:10.595598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868242+0000","last_change":"2024-04-26T12:14:42.870080+0000","last_active":"2024-04-26T12:14:43.868242+0000","last_peered":"2024-04-26T12:14:43.868242+0000","last_clean":"2024-04-26T12:14:43.868242+0000","last_became_active":"2024-04-26T12:14:42.867542+0000","last_became_peered":"2024-04-26T12:14:42.867542+0000","last_unstale":"2024-04-26T12:14:43.868242+0000","last_undegraded":"2024-04-26T12:14:43.868242+0000","last_fullsized":"2024-04-26T12:14:43.868242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867192+0000","last_change":"2024-04-26T12:14:42.533248+0000","last_active":"2024-04-26T12:14:43.867192+0000","last_peered":"2024-04-26T12:14:43.867192+0000","last_clean":"2024-04-26T12:14:43.867192+0000","last_became_active":"2024-04-26T12:14:42.532987+0000","last_became_peered":"2024-04-26T12:14:42.532987+0000","last_unstale":"2024-04-26T12:14:43.867192+0000","last_undegraded":"2024-04-26T12:14:43.867192+0000","last_fullsized":"2024-04-26T12:14:43.867192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:03.860297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867786+0000","last_change":"2024-04-26T12:14:42.866349+0000","last_active":"2024-04-26T12:14:43.867786+0000","last_peered":"2024-04-26T12:14:43.867786+0000","last_clean":"2024-04-26T12:14:43.867786+0000","last_became_active":"2024-04-26T12:14:42.865989+0000","last_became_peered":"2024-04-26T12:14:42.865989+0000","last_unstale":"2024-04-26T12:14:43.867786+0000","last_undegraded":"2024-04-26T12:14:43.867786+0000","last_fullsized":"2024-04-26T12:14:43.867786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.868665+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:42.868665+0000","last_peered":"2024-04-26T12:14:42.868665+0000","last_clean":"2024-04-26T12:14:42.868665+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:14:42.868665+0000","last_undegraded":"2024-04-26T12:14:42.868665+0000","last_fullsized":"2024-04-26T12:14:42.868665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862558+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:42.862558+0000","last_peered":"2024-04-26T12:14:42.862558+0000","last_clean":"2024-04-26T12:14:42.862558+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:42.862558+0000","last_undegraded":"2024-04-26T12:14:42.862558+0000","last_fullsized":"2024-04-26T12:14:42.862558+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862638+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862638+0000","last_peered":"2024-04-26T12:14:42.862638+0000","last_clean":"2024-04-26T12:14:42.862638+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:42.862638+0000","last_undegraded":"2024-04-26T12:14:42.862638+0000","last_fullsized":"2024-04-26T12:14:42.862638+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858666+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:14:42.858666+0000","last_peered":"2024-04-26T12:14:42.858666+0000","last_clean":"2024-04-26T12:14:42.858666+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:14:42.858666+0000","last_undegraded":"2024-04-26T12:14:42.858666+0000","last_fullsized":"2024-04-26T12:14:42.858666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868139+0000","last_change":"2024-04-26T12:14:42.869728+0000","last_active":"2024-04-26T12:14:43.868139+0000","last_peered":"2024-04-26T12:14:43.868139+0000","last_clean":"2024-04-26T12:14:43.868139+0000","last_became_active":"2024-04-26T12:14:42.867567+0000","last_became_peered":"2024-04-26T12:14:42.867567+0000","last_unstale":"2024-04-26T12:14:43.868139+0000","last_undegraded":"2024-04-26T12:14:43.868139+0000","last_fullsized":"2024-04-26T12:14:43.868139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862186+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:42.862186+0000","last_peered":"2024-04-26T12:14:42.862186+0000","last_clean":"2024-04-26T12:14:42.862186+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:42.862186+0000","last_undegraded":"2024-04-26T12:14:42.862186+0000","last_fullsized":"2024-04-26T12:14:42.862186+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858823+0000","last_change":"2024-04-26T12:14:42.529005+0000","last_active":"2024-04-26T12:14:42.858823+0000","last_peered":"2024-04-26T12:14:42.858823+0000","last_clean":"2024-04-26T12:14:42.858823+0000","last_became_active":"2024-04-26T12:14:42.528648+0000","last_became_peered":"2024-04-26T12:14:42.528648+0000","last_unstale":"2024-04-26T12:14:42.858823+0000","last_undegraded":"2024-04-26T12:14:42.858823+0000","last_fullsized":"2024-04-26T12:14:42.858823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867695+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:14:43.867695+0000","last_peered":"2024-04-26T12:14:43.867695+0000","last_clean":"2024-04-26T12:14:43.867695+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:14:43.867695+0000","last_undegraded":"2024-04-26T12:14:43.867695+0000","last_fullsized":"2024-04-26T12:14:43.867695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.520142+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:42.520142+0000","last_peered":"2024-04-26T12:14:42.520142+0000","last_clean":"2024-04-26T12:14:42.520142+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:42.520142+0000","last_undegraded":"2024-04-26T12:14:42.520142+0000","last_fullsized":"2024-04-26T12:14:42.520142+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866866+0000","last_change":"2024-04-26T12:14:42.534422+0000","last_active":"2024-04-26T12:14:43.866866+0000","last_peered":"2024-04-26T12:14:43.866866+0000","last_clean":"2024-04-26T12:14:43.866866+0000","last_became_active":"2024-04-26T12:14:42.534055+0000","last_became_peered":"2024-04-26T12:14:42.534055+0000","last_unstale":"2024-04-26T12:14:43.866866+0000","last_undegraded":"2024-04-26T12:14:43.866866+0000","last_fullsized":"2024-04-26T12:14:43.866866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:07.197258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.873366+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:14:42.873366+0000","last_peered":"2024-04-26T12:14:42.873366+0000","last_clean":"2024-04-26T12:14:42.873366+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:42.873366+0000","last_undegraded":"2024-04-26T12:14:42.873366+0000","last_fullsized":"2024-04-26T12:14:42.873366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862986+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862986+0000","last_peered":"2024-04-26T12:14:42.862986+0000","last_clean":"2024-04-26T12:14:42.862986+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:42.862986+0000","last_undegraded":"2024-04-26T12:14:42.862986+0000","last_fullsized":"2024-04-26T12:14:42.862986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868018+0000","last_change":"2024-04-26T12:14:42.528091+0000","last_active":"2024-04-26T12:14:43.868018+0000","last_peered":"2024-04-26T12:14:43.868018+0000","last_clean":"2024-04-26T12:14:43.868018+0000","last_became_active":"2024-04-26T12:14:42.527707+0000","last_became_peered":"2024-04-26T12:14:42.527707+0000","last_unstale":"2024-04-26T12:14:43.868018+0000","last_undegraded":"2024-04-26T12:14:43.868018+0000","last_fullsized":"2024-04-26T12:14:43.868018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.868623+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:14:42.868623+0000","last_peered":"2024-04-26T12:14:42.868623+0000","last_clean":"2024-04-26T12:14:42.868623+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:14:42.868623+0000","last_undegraded":"2024-04-26T12:14:42.868623+0000","last_fullsized":"2024-04-26T12:14:42.868623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868182+0000","last_change":"2024-04-26T12:14:42.530310+0000","last_active":"2024-04-26T12:14:43.868182+0000","last_peered":"2024-04-26T12:14:43.868182+0000","last_clean":"2024-04-26T12:14:43.868182+0000","last_became_active":"2024-04-26T12:14:42.529543+0000","last_became_peered":"2024-04-26T12:14:42.529543+0000","last_unstale":"2024-04-26T12:14:43.868182+0000","last_undegraded":"2024-04-26T12:14:43.868182+0000","last_fullsized":"2024-04-26T12:14:43.868182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.519286+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:42.519286+0000","last_peered":"2024-04-26T12:14:42.519286+0000","last_clean":"2024-04-26T12:14:42.519286+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:42.519286+0000","last_undegraded":"2024-04-26T12:14:42.519286+0000","last_fullsized":"2024-04-26T12:14:42.519286+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867097+0000","last_change":"2024-04-26T12:14:42.870740+0000","last_active":"2024-04-26T12:14:43.867097+0000","last_peered":"2024-04-26T12:14:43.867097+0000","last_clean":"2024-04-26T12:14:43.867097+0000","last_became_active":"2024-04-26T12:14:42.870426+0000","last_became_peered":"2024-04-26T12:14:42.870426+0000","last_unstale":"2024-04-26T12:14:43.867097+0000","last_undegraded":"2024-04-26T12:14:43.867097+0000","last_fullsized":"2024-04-26T12:14:43.867097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.857845+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:14:42.857845+0000","last_peered":"2024-04-26T12:14:42.857845+0000","last_clean":"2024-04-26T12:14:42.857845+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:14:42.857845+0000","last_undegraded":"2024-04-26T12:14:42.857845+0000","last_fullsized":"2024-04-26T12:14:42.857845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859224+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:42.859224+0000","last_peered":"2024-04-26T12:14:42.859224+0000","last_clean":"2024-04-26T12:14:42.859224+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:42.859224+0000","last_undegraded":"2024-04-26T12:14:42.859224+0000","last_fullsized":"2024-04-26T12:14:42.859224+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867149+0000","last_change":"2024-04-26T12:14:42.868394+0000","last_active":"2024-04-26T12:14:43.867149+0000","last_peered":"2024-04-26T12:14:43.867149+0000","last_clean":"2024-04-26T12:14:43.867149+0000","last_became_active":"2024-04-26T12:14:42.867469+0000","last_became_peered":"2024-04-26T12:14:42.867469+0000","last_unstale":"2024-04-26T12:14:43.867149+0000","last_undegraded":"2024-04-26T12:14:43.867149+0000","last_fullsized":"2024-04-26T12:14:43.867149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.872596+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:14:42.872596+0000","last_peered":"2024-04-26T12:14:42.872596+0000","last_clean":"2024-04-26T12:14:42.872596+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:14:42.872596+0000","last_undegraded":"2024-04-26T12:14:42.872596+0000","last_fullsized":"2024-04-26T12:14:42.872596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.520232+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:42.520232+0000","last_peered":"2024-04-26T12:14:42.520232+0000","last_clean":"2024-04-26T12:14:42.520232+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:42.520232+0000","last_undegraded":"2024-04-26T12:14:42.520232+0000","last_fullsized":"2024-04-26T12:14:42.520232+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.873295+0000","last_change":"2024-04-26T12:14:42.872140+0000","last_active":"2024-04-26T12:14:42.873295+0000","last_peered":"2024-04-26T12:14:42.873295+0000","last_clean":"2024-04-26T12:14:42.873295+0000","last_became_active":"2024-04-26T12:14:42.871667+0000","last_became_peered":"2024-04-26T12:14:42.871667+0000","last_unstale":"2024-04-26T12:14:42.873295+0000","last_undegraded":"2024-04-26T12:14:42.873295+0000","last_fullsized":"2024-04-26T12:14:42.873295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859483+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:42.859483+0000","last_peered":"2024-04-26T12:14:42.859483+0000","last_clean":"2024-04-26T12:14:42.859483+0000","last_became_active":"2024-04-26T12:14:42.530054+0000","last_became_peered":"2024-04-26T12:14:42.530054+0000","last_unstale":"2024-04-26T12:14:42.859483+0000","last_undegraded":"2024-04-26T12:14:42.859483+0000","last_fullsized":"2024-04-26T12:14:42.859483+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.865382+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:42.865382+0000","last_peered":"2024-04-26T12:14:42.865382+0000","last_clean":"2024-04-26T12:14:42.865382+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:42.865382+0000","last_undegraded":"2024-04-26T12:14:42.865382+0000","last_fullsized":"2024-04-26T12:14:42.865382+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866908+0000","last_change":"2024-04-26T12:14:42.866932+0000","last_active":"2024-04-26T12:14:43.866908+0000","last_peered":"2024-04-26T12:14:43.866908+0000","last_clean":"2024-04-26T12:14:43.866908+0000","last_became_active":"2024-04-26T12:14:42.866555+0000","last_became_peered":"2024-04-26T12:14:42.866555+0000","last_unstale":"2024-04-26T12:14:43.866908+0000","last_undegraded":"2024-04-26T12:14:43.866908+0000","last_fullsized":"2024-04-26T12:14:43.866908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:35.495924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867685+0000","last_change":"2024-04-26T12:14:42.867426+0000","last_active":"2024-04-26T12:14:43.867685+0000","last_peered":"2024-04-26T12:14:43.867685+0000","last_clean":"2024-04-26T12:14:43.867685+0000","last_became_active":"2024-04-26T12:14:42.866597+0000","last_became_peered":"2024-04-26T12:14:42.866597+0000","last_unstale":"2024-04-26T12:14:43.867685+0000","last_undegraded":"2024-04-26T12:14:43.867685+0000","last_fullsized":"2024-04-26T12:14:43.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867778+0000","last_change":"2024-04-26T12:14:42.528956+0000","last_active":"2024-04-26T12:14:43.867778+0000","last_peered":"2024-04-26T12:14:43.867778+0000","last_clean":"2024-04-26T12:14:43.867778+0000","last_became_active":"2024-04-26T12:14:42.528543+0000","last_became_peered":"2024-04-26T12:14:42.528543+0000","last_unstale":"2024-04-26T12:14:43.867778+0000","last_undegraded":"2024-04-26T12:14:43.867778+0000","last_fullsized":"2024-04-26T12:14:43.867778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.867999+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:14:42.867999+0000","last_peered":"2024-04-26T12:14:42.867999+0000","last_clean":"2024-04-26T12:14:42.867999+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:14:42.867999+0000","last_undegraded":"2024-04-26T12:14:42.867999+0000","last_fullsized":"2024-04-26T12:14:42.867999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867876+0000","last_change":"2024-04-26T12:14:42.534326+0000","last_active":"2024-04-26T12:14:43.867876+0000","last_peered":"2024-04-26T12:14:43.867876+0000","last_clean":"2024-04-26T12:14:43.867876+0000","last_became_active":"2024-04-26T12:14:42.534008+0000","last_became_peered":"2024-04-26T12:14:42.534008+0000","last_unstale":"2024-04-26T12:14:43.867876+0000","last_undegraded":"2024-04-26T12:14:43.867876+0000","last_fullsized":"2024-04-26T12:14:43.867876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:34.796560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868039+0000","last_change":"2024-04-26T12:14:42.533769+0000","last_active":"2024-04-26T12:14:43.868039+0000","last_peered":"2024-04-26T12:14:43.868039+0000","last_clean":"2024-04-26T12:14:43.868039+0000","last_became_active":"2024-04-26T12:14:42.533439+0000","last_became_peered":"2024-04-26T12:14:42.533439+0000","last_unstale":"2024-04-26T12:14:43.868039+0000","last_undegraded":"2024-04-26T12:14:43.868039+0000","last_fullsized":"2024-04-26T12:14:43.868039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.872380+0000","last_change":"2024-04-26T12:14:42.870305+0000","last_active":"2024-04-26T12:14:42.872380+0000","last_peered":"2024-04-26T12:14:42.872380+0000","last_clean":"2024-04-26T12:14:42.872380+0000","last_became_active":"2024-04-26T12:14:42.869976+0000","last_became_peered":"2024-04-26T12:14:42.869976+0000","last_unstale":"2024-04-26T12:14:42.872380+0000","last_undegraded":"2024-04-26T12:14:42.872380+0000","last_fullsized":"2024-04-26T12:14:42.872380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.860487+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:42.860487+0000","last_peered":"2024-04-26T12:14:42.860487+0000","last_clean":"2024-04-26T12:14:42.860487+0000","last_became_active":"2024-04-26T12:14:42.529967+0000","last_became_peered":"2024-04-26T12:14:42.529967+0000","last_unstale":"2024-04-26T12:14:42.860487+0000","last_undegraded":"2024-04-26T12:14:42.860487+0000","last_fullsized":"2024-04-26T12:14:42.860487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.867545+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:14:42.867545+0000","last_peered":"2024-04-26T12:14:42.867545+0000","last_clean":"2024-04-26T12:14:42.867545+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:14:42.867545+0000","last_undegraded":"2024-04-26T12:14:42.867545+0000","last_fullsized":"2024-04-26T12:14:42.867545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867835+0000","last_change":"2024-04-26T12:14:42.874343+0000","last_active":"2024-04-26T12:14:43.867835+0000","last_peered":"2024-04-26T12:14:43.867835+0000","last_clean":"2024-04-26T12:14:43.867835+0000","last_became_active":"2024-04-26T12:14:42.874067+0000","last_became_peered":"2024-04-26T12:14:42.874067+0000","last_unstale":"2024-04-26T12:14:43.867835+0000","last_undegraded":"2024-04-26T12:14:43.867835+0000","last_fullsized":"2024-04-26T12:14:43.867835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.857619+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:14:42.857619+0000","last_peered":"2024-04-26T12:14:42.857619+0000","last_clean":"2024-04-26T12:14:42.857619+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:14:42.857619+0000","last_undegraded":"2024-04-26T12:14:42.857619+0000","last_fullsized":"2024-04-26T12:14:42.857619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.872365+0000","last_change":"2024-04-26T12:14:42.870189+0000","last_active":"2024-04-26T12:14:42.872365+0000","last_peered":"2024-04-26T12:14:42.872365+0000","last_clean":"2024-04-26T12:14:42.872365+0000","last_became_active":"2024-04-26T12:14:42.869808+0000","last_became_peered":"2024-04-26T12:14:42.869808+0000","last_unstale":"2024-04-26T12:14:42.872365+0000","last_undegraded":"2024-04-26T12:14:42.872365+0000","last_fullsized":"2024-04-26T12:14:42.872365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858228+0000","last_change":"2024-04-26T12:14:42.530759+0000","last_active":"2024-04-26T12:14:42.858228+0000","last_peered":"2024-04-26T12:14:42.858228+0000","last_clean":"2024-04-26T12:14:42.858228+0000","last_became_active":"2024-04-26T12:14:42.530393+0000","last_became_peered":"2024-04-26T12:14:42.530393+0000","last_unstale":"2024-04-26T12:14:42.858228+0000","last_undegraded":"2024-04-26T12:14:42.858228+0000","last_fullsized":"2024-04-26T12:14:42.858228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867656+0000","last_change":"2024-04-26T12:14:42.867217+0000","last_active":"2024-04-26T12:14:43.867656+0000","last_peered":"2024-04-26T12:14:43.867656+0000","last_clean":"2024-04-26T12:14:43.867656+0000","last_became_active":"2024-04-26T12:14:42.866778+0000","last_became_peered":"2024-04-26T12:14:42.866778+0000","last_unstale":"2024-04-26T12:14:43.867656+0000","last_undegraded":"2024-04-26T12:14:43.867656+0000","last_fullsized":"2024-04-26T12:14:43.867656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867244+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:14:43.867244+0000","last_peered":"2024-04-26T12:14:43.867244+0000","last_clean":"2024-04-26T12:14:43.867244+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:14:43.867244+0000","last_undegraded":"2024-04-26T12:14:43.867244+0000","last_fullsized":"2024-04-26T12:14:43.867244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867461+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:14:43.867461+0000","last_peered":"2024-04-26T12:14:43.867461+0000","last_clean":"2024-04-26T12:14:43.867461+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:14:43.867461+0000","last_undegraded":"2024-04-26T12:14:43.867461+0000","last_fullsized":"2024-04-26T12:14:43.867461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867373+0000","last_change":"2024-04-26T12:14:42.534341+0000","last_active":"2024-04-26T12:14:43.867373+0000","last_peered":"2024-04-26T12:14:43.867373+0000","last_clean":"2024-04-26T12:14:43.867373+0000","last_became_active":"2024-04-26T12:14:42.534034+0000","last_became_peered":"2024-04-26T12:14:42.534034+0000","last_unstale":"2024-04-26T12:14:43.867373+0000","last_undegraded":"2024-04-26T12:14:43.867373+0000","last_fullsized":"2024-04-26T12:14:43.867373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:49.137895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867226+0000","last_change":"2024-04-26T12:14:42.868865+0000","last_active":"2024-04-26T12:14:43.867226+0000","last_peered":"2024-04-26T12:14:43.867226+0000","last_clean":"2024-04-26T12:14:43.867226+0000","last_became_active":"2024-04-26T12:14:42.868331+0000","last_became_peered":"2024-04-26T12:14:42.868331+0000","last_unstale":"2024-04-26T12:14:43.867226+0000","last_undegraded":"2024-04-26T12:14:43.867226+0000","last_fullsized":"2024-04-26T12:14:43.867226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:48.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867662+0000","last_change":"2024-04-26T12:14:42.530621+0000","last_active":"2024-04-26T12:14:43.867662+0000","last_peered":"2024-04-26T12:14:43.867662+0000","last_clean":"2024-04-26T12:14:43.867662+0000","last_became_active":"2024-04-26T12:14:42.529635+0000","last_became_peered":"2024-04-26T12:14:42.529635+0000","last_unstale":"2024-04-26T12:14:43.867662+0000","last_undegraded":"2024-04-26T12:14:43.867662+0000","last_fullsized":"2024-04-26T12:14:43.867662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.073389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867450+0000","last_change":"2024-04-26T12:14:42.867354+0000","last_active":"2024-04-26T12:14:43.867450+0000","last_peered":"2024-04-26T12:14:43.867450+0000","last_clean":"2024-04-26T12:14:43.867450+0000","last_became_active":"2024-04-26T12:14:42.866550+0000","last_became_peered":"2024-04-26T12:14:42.866550+0000","last_unstale":"2024-04-26T12:14:43.867450+0000","last_undegraded":"2024-04-26T12:14:43.867450+0000","last_fullsized":"2024-04-26T12:14:43.867450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867761+0000","last_change":"2024-04-26T12:14:42.533661+0000","last_active":"2024-04-26T12:14:43.867761+0000","last_peered":"2024-04-26T12:14:43.867761+0000","last_clean":"2024-04-26T12:14:43.867761+0000","last_became_active":"2024-04-26T12:14:42.533454+0000","last_became_peered":"2024-04-26T12:14:42.533454+0000","last_unstale":"2024-04-26T12:14:43.867761+0000","last_undegraded":"2024-04-26T12:14:43.867761+0000","last_fullsized":"2024-04-26T12:14:43.867761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:06.330845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867306+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:14:43.867306+0000","last_peered":"2024-04-26T12:14:43.867306+0000","last_clean":"2024-04-26T12:14:43.867306+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:14:43.867306+0000","last_undegraded":"2024-04-26T12:14:43.867306+0000","last_fullsized":"2024-04-26T12:14:43.867306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.866852+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:14:42.866852+0000","last_peered":"2024-04-26T12:14:42.866852+0000","last_clean":"2024-04-26T12:14:42.866852+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:14:42.866852+0000","last_undegraded":"2024-04-26T12:14:42.866852+0000","last_fullsized":"2024-04-26T12:14:42.866852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867425+0000","last_change":"2024-04-26T12:14:42.869979+0000","last_active":"2024-04-26T12:14:43.867425+0000","last_peered":"2024-04-26T12:14:43.867425+0000","last_clean":"2024-04-26T12:14:43.867425+0000","last_became_active":"2024-04-26T12:14:42.868687+0000","last_became_peered":"2024-04-26T12:14:42.868687+0000","last_unstale":"2024-04-26T12:14:43.867425+0000","last_undegraded":"2024-04-26T12:14:43.867425+0000","last_fullsized":"2024-04-26T12:14:43.867425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.874042+0000","last_change":"2024-04-26T12:14:42.534167+0000","last_active":"2024-04-26T12:14:42.874042+0000","last_peered":"2024-04-26T12:14:42.874042+0000","last_clean":"2024-04-26T12:14:42.874042+0000","last_became_active":"2024-04-26T12:14:42.533826+0000","last_became_peered":"2024-04-26T12:14:42.533826+0000","last_unstale":"2024-04-26T12:14:42.874042+0000","last_undegraded":"2024-04-26T12:14:42.874042+0000","last_fullsized":"2024-04-26T12:14:42.874042+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35348,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336492,"statfs":{"total":96636764160,"available":96600567808,"internally_reserved":0,"allocated":131072,"data_stored":42060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:50.475 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T12:14:50.475 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:14:50.475 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:14:50.475 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:14:50.476 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:14:50.838 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:50.849 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":27895},{"type":"v1","addr":"172.21.15.69:6801","nonce":27895}]},"active_addr":"172.21.15.69:6801/27895","active_change":"2024-04-26T12:14:32.419207+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":940059827}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":1438581769}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2509863903}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3976097747}]}]} 2024-04-26T12:14:50.852 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:14:50.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:14:50.853 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:51.130 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:51.130 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:43.852134+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:51.143 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:14:51.143 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:51.420 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:51.420 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:43.852134+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:51.433 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:14:51.433 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:14:51.434 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:14:51.572 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2024-04-26T12:14:51.572 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:14:51.573 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2024-04-26T12:14:51.573 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:14:51.574 INFO:teuthology.orchestra.run.smithi069.stdout:34359738375 2024-04-26T12:14:51.574 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:14:51.905 INFO:teuthology.orchestra.run.smithi069.stdout:34359738372 2024-04-26T12:14:51.912 INFO:teuthology.orchestra.run.smithi069.stdout:34359738372 2024-04-26T12:14:51.913 INFO:teuthology.orchestra.run.smithi069.stdout:34359738373 2024-04-26T12:14:51.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.0 2024-04-26T12:14:51.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.1 2024-04-26T12:14:51.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.2 2024-04-26T12:14:52.921 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:14:52.929 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:14:52.929 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:14:53.230 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2024-04-26T12:14:53.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2024-04-26T12:14:53.244 DEBUG:teuthology.parallel:result is None 2024-04-26T12:14:53.261 INFO:teuthology.orchestra.run.smithi069.stdout:34359738374 2024-04-26T12:14:53.266 INFO:teuthology.orchestra.run.smithi069.stdout:34359738375 2024-04-26T12:14:53.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-04-26T12:14:53.275 DEBUG:teuthology.parallel:result is None 2024-04-26T12:14:53.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-04-26T12:14:53.280 DEBUG:teuthology.parallel:result is None 2024-04-26T12:14:53.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:14:53.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:53.606 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:53.608 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:14:53.617 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T12:14:52.425873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94972,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020548,"statfs":{"total":289910292480,"available":289813041152,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.571019"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867707+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:14:43.867707+0000","last_peered":"2024-04-26T12:14:43.867707+0000","last_clean":"2024-04-26T12:14:43.867707+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:14:43.867707+0000","last_undegraded":"2024-04-26T12:14:43.867707+0000","last_fullsized":"2024-04-26T12:14:43.867707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867546+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:14:43.867546+0000","last_peered":"2024-04-26T12:14:43.867546+0000","last_clean":"2024-04-26T12:14:43.867546+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:14:43.867546+0000","last_undegraded":"2024-04-26T12:14:43.867546+0000","last_fullsized":"2024-04-26T12:14:43.867546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867948+0000","last_change":"2024-04-26T12:14:42.872215+0000","last_active":"2024-04-26T12:14:43.867948+0000","last_peered":"2024-04-26T12:14:43.867948+0000","last_clean":"2024-04-26T12:14:43.867948+0000","last_became_active":"2024-04-26T12:14:42.871084+0000","last_became_peered":"2024-04-26T12:14:42.871084+0000","last_unstale":"2024-04-26T12:14:43.867948+0000","last_undegraded":"2024-04-26T12:14:43.867948+0000","last_fullsized":"2024-04-26T12:14:43.867948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:54.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867375+0000","last_change":"2024-04-26T12:14:42.869954+0000","last_active":"2024-04-26T12:14:43.867375+0000","last_peered":"2024-04-26T12:14:43.867375+0000","last_clean":"2024-04-26T12:14:43.867375+0000","last_became_active":"2024-04-26T12:14:42.869262+0000","last_became_peered":"2024-04-26T12:14:42.869262+0000","last_unstale":"2024-04-26T12:14:43.867375+0000","last_undegraded":"2024-04-26T12:14:43.867375+0000","last_fullsized":"2024-04-26T12:14:43.867375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:41.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867412+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:14:43.867412+0000","last_peered":"2024-04-26T12:14:43.867412+0000","last_clean":"2024-04-26T12:14:43.867412+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:14:43.867412+0000","last_undegraded":"2024-04-26T12:14:43.867412+0000","last_fullsized":"2024-04-26T12:14:43.867412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867032+0000","last_change":"2024-04-26T12:14:42.870198+0000","last_active":"2024-04-26T12:14:43.867032+0000","last_peered":"2024-04-26T12:14:43.867032+0000","last_clean":"2024-04-26T12:14:43.867032+0000","last_became_active":"2024-04-26T12:14:42.869783+0000","last_became_peered":"2024-04-26T12:14:42.869783+0000","last_unstale":"2024-04-26T12:14:43.867032+0000","last_undegraded":"2024-04-26T12:14:43.867032+0000","last_fullsized":"2024-04-26T12:14:43.867032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:03.272719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867135+0000","last_change":"2024-04-26T12:14:42.867620+0000","last_active":"2024-04-26T12:14:43.867135+0000","last_peered":"2024-04-26T12:14:43.867135+0000","last_clean":"2024-04-26T12:14:43.867135+0000","last_became_active":"2024-04-26T12:14:42.866727+0000","last_became_peered":"2024-04-26T12:14:42.866727+0000","last_unstale":"2024-04-26T12:14:43.867135+0000","last_undegraded":"2024-04-26T12:14:43.867135+0000","last_fullsized":"2024-04-26T12:14:43.867135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866936+0000","last_change":"2024-04-26T12:14:42.871957+0000","last_active":"2024-04-26T12:14:43.866936+0000","last_peered":"2024-04-26T12:14:43.866936+0000","last_clean":"2024-04-26T12:14:43.866936+0000","last_became_active":"2024-04-26T12:14:42.870987+0000","last_became_peered":"2024-04-26T12:14:42.870987+0000","last_unstale":"2024-04-26T12:14:43.866936+0000","last_undegraded":"2024-04-26T12:14:43.866936+0000","last_fullsized":"2024-04-26T12:14:43.866936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.657803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488830+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:14:46.488830+0000","last_peered":"2024-04-26T12:14:46.488830+0000","last_clean":"2024-04-26T12:14:46.488830+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:14:46.488830+0000","last_undegraded":"2024-04-26T12:14:46.488830+0000","last_fullsized":"2024-04-26T12:14:46.488830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867722+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:14:43.867722+0000","last_peered":"2024-04-26T12:14:43.867722+0000","last_clean":"2024-04-26T12:14:43.867722+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:14:43.867722+0000","last_undegraded":"2024-04-26T12:14:43.867722+0000","last_fullsized":"2024-04-26T12:14:43.867722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867635+0000","last_change":"2024-04-26T12:14:42.870737+0000","last_active":"2024-04-26T12:14:43.867635+0000","last_peered":"2024-04-26T12:14:43.867635+0000","last_clean":"2024-04-26T12:14:43.867635+0000","last_became_active":"2024-04-26T12:14:42.870218+0000","last_became_peered":"2024-04-26T12:14:42.870218+0000","last_unstale":"2024-04-26T12:14:43.867635+0000","last_undegraded":"2024-04-26T12:14:43.867635+0000","last_fullsized":"2024-04-26T12:14:43.867635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:47.108520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867459+0000","last_change":"2024-04-26T12:14:42.870694+0000","last_active":"2024-04-26T12:14:43.867459+0000","last_peered":"2024-04-26T12:14:43.867459+0000","last_clean":"2024-04-26T12:14:43.867459+0000","last_became_active":"2024-04-26T12:14:42.870325+0000","last_became_peered":"2024-04-26T12:14:42.870325+0000","last_unstale":"2024-04-26T12:14:43.867459+0000","last_undegraded":"2024-04-26T12:14:43.867459+0000","last_fullsized":"2024-04-26T12:14:43.867459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867047+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:14:43.867047+0000","last_peered":"2024-04-26T12:14:43.867047+0000","last_clean":"2024-04-26T12:14:43.867047+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:14:43.867047+0000","last_undegraded":"2024-04-26T12:14:43.867047+0000","last_fullsized":"2024-04-26T12:14:43.867047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867184+0000","last_change":"2024-04-26T12:14:42.868400+0000","last_active":"2024-04-26T12:14:43.867184+0000","last_peered":"2024-04-26T12:14:43.867184+0000","last_clean":"2024-04-26T12:14:43.867184+0000","last_became_active":"2024-04-26T12:14:42.867646+0000","last_became_peered":"2024-04-26T12:14:42.867646+0000","last_unstale":"2024-04-26T12:14:43.867184+0000","last_undegraded":"2024-04-26T12:14:43.867184+0000","last_fullsized":"2024-04-26T12:14:43.867184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867236+0000","last_change":"2024-04-26T12:14:42.867157+0000","last_active":"2024-04-26T12:14:43.867236+0000","last_peered":"2024-04-26T12:14:43.867236+0000","last_clean":"2024-04-26T12:14:43.867236+0000","last_became_active":"2024-04-26T12:14:42.865840+0000","last_became_peered":"2024-04-26T12:14:42.865840+0000","last_unstale":"2024-04-26T12:14:43.867236+0000","last_undegraded":"2024-04-26T12:14:43.867236+0000","last_fullsized":"2024-04-26T12:14:43.867236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866901+0000","last_change":"2024-04-26T12:14:42.871915+0000","last_active":"2024-04-26T12:14:43.866901+0000","last_peered":"2024-04-26T12:14:43.866901+0000","last_clean":"2024-04-26T12:14:43.866901+0000","last_became_active":"2024-04-26T12:14:42.870604+0000","last_became_peered":"2024-04-26T12:14:42.870604+0000","last_unstale":"2024-04-26T12:14:43.866901+0000","last_undegraded":"2024-04-26T12:14:43.866901+0000","last_fullsized":"2024-04-26T12:14:43.866901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488910+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:14:46.488910+0000","last_peered":"2024-04-26T12:14:46.488910+0000","last_clean":"2024-04-26T12:14:46.488910+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488910+0000","last_undegraded":"2024-04-26T12:14:46.488910+0000","last_fullsized":"2024-04-26T12:14:46.488910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867812+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:14:43.867812+0000","last_peered":"2024-04-26T12:14:43.867812+0000","last_clean":"2024-04-26T12:14:43.867812+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:14:43.867812+0000","last_undegraded":"2024-04-26T12:14:43.867812+0000","last_fullsized":"2024-04-26T12:14:43.867812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488755+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:14:46.488755+0000","last_peered":"2024-04-26T12:14:46.488755+0000","last_clean":"2024-04-26T12:14:46.488755+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:14:46.488755+0000","last_undegraded":"2024-04-26T12:14:46.488755+0000","last_fullsized":"2024-04-26T12:14:46.488755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867547+0000","last_change":"2024-04-26T12:14:42.869830+0000","last_active":"2024-04-26T12:14:43.867547+0000","last_peered":"2024-04-26T12:14:43.867547+0000","last_clean":"2024-04-26T12:14:43.867547+0000","last_became_active":"2024-04-26T12:14:42.869225+0000","last_became_peered":"2024-04-26T12:14:42.869225+0000","last_unstale":"2024-04-26T12:14:43.867547+0000","last_undegraded":"2024-04-26T12:14:43.867547+0000","last_fullsized":"2024-04-26T12:14:43.867547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:53.111870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867710+0000","last_change":"2024-04-26T12:14:42.868630+0000","last_active":"2024-04-26T12:14:43.867710+0000","last_peered":"2024-04-26T12:14:43.867710+0000","last_clean":"2024-04-26T12:14:43.867710+0000","last_became_active":"2024-04-26T12:14:42.867548+0000","last_became_peered":"2024-04-26T12:14:42.867548+0000","last_unstale":"2024-04-26T12:14:43.867710+0000","last_undegraded":"2024-04-26T12:14:43.867710+0000","last_fullsized":"2024-04-26T12:14:43.867710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866911+0000","last_change":"2024-04-26T12:14:42.870882+0000","last_active":"2024-04-26T12:14:43.866911+0000","last_peered":"2024-04-26T12:14:43.866911+0000","last_clean":"2024-04-26T12:14:43.866911+0000","last_became_active":"2024-04-26T12:14:42.870623+0000","last_became_peered":"2024-04-26T12:14:42.870623+0000","last_unstale":"2024-04-26T12:14:43.866911+0000","last_undegraded":"2024-04-26T12:14:43.866911+0000","last_fullsized":"2024-04-26T12:14:43.866911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488588+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488588+0000","last_peered":"2024-04-26T12:14:46.488588+0000","last_clean":"2024-04-26T12:14:46.488588+0000","last_became_active":"2024-04-26T12:14:42.867223+0000","last_became_peered":"2024-04-26T12:14:42.867223+0000","last_unstale":"2024-04-26T12:14:46.488588+0000","last_undegraded":"2024-04-26T12:14:46.488588+0000","last_fullsized":"2024-04-26T12:14:46.488588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866690+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:14:43.866690+0000","last_peered":"2024-04-26T12:14:43.866690+0000","last_clean":"2024-04-26T12:14:43.866690+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:14:43.866690+0000","last_undegraded":"2024-04-26T12:14:43.866690+0000","last_fullsized":"2024-04-26T12:14:43.866690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867693+0000","last_change":"2024-04-26T12:14:42.874005+0000","last_active":"2024-04-26T12:14:43.867693+0000","last_peered":"2024-04-26T12:14:43.867693+0000","last_clean":"2024-04-26T12:14:43.867693+0000","last_became_active":"2024-04-26T12:14:42.873631+0000","last_became_peered":"2024-04-26T12:14:42.873631+0000","last_unstale":"2024-04-26T12:14:43.867693+0000","last_undegraded":"2024-04-26T12:14:43.867693+0000","last_fullsized":"2024-04-26T12:14:43.867693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488765+0000","last_change":"2024-04-26T12:14:42.873571+0000","last_active":"2024-04-26T12:14:46.488765+0000","last_peered":"2024-04-26T12:14:46.488765+0000","last_clean":"2024-04-26T12:14:46.488765+0000","last_became_active":"2024-04-26T12:14:42.873286+0000","last_became_peered":"2024-04-26T12:14:42.873286+0000","last_unstale":"2024-04-26T12:14:46.488765+0000","last_undegraded":"2024-04-26T12:14:46.488765+0000","last_fullsized":"2024-04-26T12:14:46.488765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868004+0000","last_change":"2024-04-26T12:14:42.870555+0000","last_active":"2024-04-26T12:14:43.868004+0000","last_peered":"2024-04-26T12:14:43.868004+0000","last_clean":"2024-04-26T12:14:43.868004+0000","last_became_active":"2024-04-26T12:14:42.869400+0000","last_became_peered":"2024-04-26T12:14:42.869400+0000","last_unstale":"2024-04-26T12:14:43.868004+0000","last_undegraded":"2024-04-26T12:14:43.868004+0000","last_fullsized":"2024-04-26T12:14:43.868004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:23.492068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867621+0000","last_change":"2024-04-26T12:14:42.874272+0000","last_active":"2024-04-26T12:14:43.867621+0000","last_peered":"2024-04-26T12:14:43.867621+0000","last_clean":"2024-04-26T12:14:43.867621+0000","last_became_active":"2024-04-26T12:14:42.873934+0000","last_became_peered":"2024-04-26T12:14:42.873934+0000","last_unstale":"2024-04-26T12:14:43.867621+0000","last_undegraded":"2024-04-26T12:14:43.867621+0000","last_fullsized":"2024-04-26T12:14:43.867621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:05.149736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488690+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:14:46.488690+0000","last_peered":"2024-04-26T12:14:46.488690+0000","last_clean":"2024-04-26T12:14:46.488690+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:14:46.488690+0000","last_undegraded":"2024-04-26T12:14:46.488690+0000","last_fullsized":"2024-04-26T12:14:46.488690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867101+0000","last_change":"2024-04-26T12:14:42.867054+0000","last_active":"2024-04-26T12:14:43.867101+0000","last_peered":"2024-04-26T12:14:43.867101+0000","last_clean":"2024-04-26T12:14:43.867101+0000","last_became_active":"2024-04-26T12:14:42.866676+0000","last_became_peered":"2024-04-26T12:14:42.866676+0000","last_unstale":"2024-04-26T12:14:43.867101+0000","last_undegraded":"2024-04-26T12:14:43.867101+0000","last_fullsized":"2024-04-26T12:14:43.867101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488599+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:14:46.488599+0000","last_peered":"2024-04-26T12:14:46.488599+0000","last_clean":"2024-04-26T12:14:46.488599+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:14:46.488599+0000","last_undegraded":"2024-04-26T12:14:46.488599+0000","last_fullsized":"2024-04-26T12:14:46.488599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867023+0000","last_change":"2024-04-26T12:14:42.871222+0000","last_active":"2024-04-26T12:14:43.867023+0000","last_peered":"2024-04-26T12:14:43.867023+0000","last_clean":"2024-04-26T12:14:43.867023+0000","last_became_active":"2024-04-26T12:14:42.870454+0000","last_became_peered":"2024-04-26T12:14:42.870454+0000","last_unstale":"2024-04-26T12:14:43.867023+0000","last_undegraded":"2024-04-26T12:14:43.867023+0000","last_fullsized":"2024-04-26T12:14:43.867023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867584+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:14:43.867584+0000","last_peered":"2024-04-26T12:14:43.867584+0000","last_clean":"2024-04-26T12:14:43.867584+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:14:43.867584+0000","last_undegraded":"2024-04-26T12:14:43.867584+0000","last_fullsized":"2024-04-26T12:14:43.867584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867972+0000","last_change":"2024-04-26T12:14:42.527996+0000","last_active":"2024-04-26T12:14:43.867972+0000","last_peered":"2024-04-26T12:14:43.867972+0000","last_clean":"2024-04-26T12:14:43.867972+0000","last_became_active":"2024-04-26T12:14:42.527615+0000","last_became_peered":"2024-04-26T12:14:42.527615+0000","last_unstale":"2024-04-26T12:14:43.867972+0000","last_undegraded":"2024-04-26T12:14:43.867972+0000","last_fullsized":"2024-04-26T12:14:43.867972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867703+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:14:43.867703+0000","last_peered":"2024-04-26T12:14:43.867703+0000","last_clean":"2024-04-26T12:14:43.867703+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:14:43.867703+0000","last_undegraded":"2024-04-26T12:14:43.867703+0000","last_fullsized":"2024-04-26T12:14:43.867703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488669+0000","last_change":"2024-04-26T12:14:42.529666+0000","last_active":"2024-04-26T12:14:46.488669+0000","last_peered":"2024-04-26T12:14:46.488669+0000","last_clean":"2024-04-26T12:14:46.488669+0000","last_became_active":"2024-04-26T12:14:42.529366+0000","last_became_peered":"2024-04-26T12:14:42.529366+0000","last_unstale":"2024-04-26T12:14:46.488669+0000","last_undegraded":"2024-04-26T12:14:46.488669+0000","last_fullsized":"2024-04-26T12:14:46.488669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488798+0000","last_change":"2024-04-26T12:14:42.873577+0000","last_active":"2024-04-26T12:14:46.488798+0000","last_peered":"2024-04-26T12:14:46.488798+0000","last_clean":"2024-04-26T12:14:46.488798+0000","last_became_active":"2024-04-26T12:14:42.873183+0000","last_became_peered":"2024-04-26T12:14:42.873183+0000","last_unstale":"2024-04-26T12:14:46.488798+0000","last_undegraded":"2024-04-26T12:14:46.488798+0000","last_fullsized":"2024-04-26T12:14:46.488798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867161+0000","last_change":"2024-04-26T12:14:42.533710+0000","last_active":"2024-04-26T12:14:43.867161+0000","last_peered":"2024-04-26T12:14:43.867161+0000","last_clean":"2024-04-26T12:14:43.867161+0000","last_became_active":"2024-04-26T12:14:42.533436+0000","last_became_peered":"2024-04-26T12:14:42.533436+0000","last_unstale":"2024-04-26T12:14:43.867161+0000","last_undegraded":"2024-04-26T12:14:43.867161+0000","last_fullsized":"2024-04-26T12:14:43.867161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488840+0000","last_change":"2024-04-26T12:14:42.871019+0000","last_active":"2024-04-26T12:14:46.488840+0000","last_peered":"2024-04-26T12:14:46.488840+0000","last_clean":"2024-04-26T12:14:46.488840+0000","last_became_active":"2024-04-26T12:14:42.870630+0000","last_became_peered":"2024-04-26T12:14:42.870630+0000","last_unstale":"2024-04-26T12:14:46.488840+0000","last_undegraded":"2024-04-26T12:14:46.488840+0000","last_fullsized":"2024-04-26T12:14:46.488840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867164+0000","last_change":"2024-04-26T12:14:42.533517+0000","last_active":"2024-04-26T12:14:43.867164+0000","last_peered":"2024-04-26T12:14:43.867164+0000","last_clean":"2024-04-26T12:14:43.867164+0000","last_became_active":"2024-04-26T12:14:42.532693+0000","last_became_peered":"2024-04-26T12:14:42.532693+0000","last_unstale":"2024-04-26T12:14:43.867164+0000","last_undegraded":"2024-04-26T12:14:43.867164+0000","last_fullsized":"2024-04-26T12:14:43.867164+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868125+0000","last_change":"2024-04-26T12:14:42.532602+0000","last_active":"2024-04-26T12:14:43.868125+0000","last_peered":"2024-04-26T12:14:43.868125+0000","last_clean":"2024-04-26T12:14:43.868125+0000","last_became_active":"2024-04-26T12:14:42.531944+0000","last_became_peered":"2024-04-26T12:14:42.531944+0000","last_unstale":"2024-04-26T12:14:43.868125+0000","last_undegraded":"2024-04-26T12:14:43.868125+0000","last_fullsized":"2024-04-26T12:14:43.868125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866726+0000","last_change":"2024-04-26T12:14:42.871236+0000","last_active":"2024-04-26T12:14:43.866726+0000","last_peered":"2024-04-26T12:14:43.866726+0000","last_clean":"2024-04-26T12:14:43.866726+0000","last_became_active":"2024-04-26T12:14:42.871041+0000","last_became_peered":"2024-04-26T12:14:42.871041+0000","last_unstale":"2024-04-26T12:14:43.866726+0000","last_undegraded":"2024-04-26T12:14:43.866726+0000","last_fullsized":"2024-04-26T12:14:43.866726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:26.643464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867860+0000","last_change":"2024-04-26T12:14:42.534442+0000","last_active":"2024-04-26T12:14:43.867860+0000","last_peered":"2024-04-26T12:14:43.867860+0000","last_clean":"2024-04-26T12:14:43.867860+0000","last_became_active":"2024-04-26T12:14:42.534150+0000","last_became_peered":"2024-04-26T12:14:42.534150+0000","last_unstale":"2024-04-26T12:14:43.867860+0000","last_undegraded":"2024-04-26T12:14:43.867860+0000","last_fullsized":"2024-04-26T12:14:43.867860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:37.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868126+0000","last_change":"2024-04-26T12:14:42.530595+0000","last_active":"2024-04-26T12:14:43.868126+0000","last_peered":"2024-04-26T12:14:43.868126+0000","last_clean":"2024-04-26T12:14:43.868126+0000","last_became_active":"2024-04-26T12:14:42.529757+0000","last_became_peered":"2024-04-26T12:14:42.529757+0000","last_unstale":"2024-04-26T12:14:43.868126+0000","last_undegraded":"2024-04-26T12:14:43.868126+0000","last_fullsized":"2024-04-26T12:14:43.868126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867296+0000","last_change":"2024-04-26T12:14:42.869311+0000","last_active":"2024-04-26T12:14:43.867296+0000","last_peered":"2024-04-26T12:14:43.867296+0000","last_clean":"2024-04-26T12:14:43.867296+0000","last_became_active":"2024-04-26T12:14:42.868477+0000","last_became_peered":"2024-04-26T12:14:42.868477+0000","last_unstale":"2024-04-26T12:14:43.867296+0000","last_undegraded":"2024-04-26T12:14:43.867296+0000","last_fullsized":"2024-04-26T12:14:43.867296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867818+0000","last_change":"2024-04-26T12:14:42.528134+0000","last_active":"2024-04-26T12:14:43.867818+0000","last_peered":"2024-04-26T12:14:43.867818+0000","last_clean":"2024-04-26T12:14:43.867818+0000","last_became_active":"2024-04-26T12:14:42.527701+0000","last_became_peered":"2024-04-26T12:14:42.527701+0000","last_unstale":"2024-04-26T12:14:43.867818+0000","last_undegraded":"2024-04-26T12:14:43.867818+0000","last_fullsized":"2024-04-26T12:14:43.867818+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488699+0000","last_change":"2024-04-26T12:14:42.872162+0000","last_active":"2024-04-26T12:14:46.488699+0000","last_peered":"2024-04-26T12:14:46.488699+0000","last_clean":"2024-04-26T12:14:46.488699+0000","last_became_active":"2024-04-26T12:14:42.871777+0000","last_became_peered":"2024-04-26T12:14:42.871777+0000","last_unstale":"2024-04-26T12:14:46.488699+0000","last_undegraded":"2024-04-26T12:14:46.488699+0000","last_fullsized":"2024-04-26T12:14:46.488699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488710+0000","last_change":"2024-04-26T12:14:42.530739+0000","last_active":"2024-04-26T12:14:46.488710+0000","last_peered":"2024-04-26T12:14:46.488710+0000","last_clean":"2024-04-26T12:14:46.488710+0000","last_became_active":"2024-04-26T12:14:42.530380+0000","last_became_peered":"2024-04-26T12:14:42.530380+0000","last_unstale":"2024-04-26T12:14:46.488710+0000","last_undegraded":"2024-04-26T12:14:46.488710+0000","last_fullsized":"2024-04-26T12:14:46.488710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867734+0000","last_change":"2024-04-26T12:14:42.869606+0000","last_active":"2024-04-26T12:14:43.867734+0000","last_peered":"2024-04-26T12:14:43.867734+0000","last_clean":"2024-04-26T12:14:43.867734+0000","last_became_active":"2024-04-26T12:14:42.868445+0000","last_became_peered":"2024-04-26T12:14:42.868445+0000","last_unstale":"2024-04-26T12:14:43.867734+0000","last_undegraded":"2024-04-26T12:14:43.867734+0000","last_fullsized":"2024-04-26T12:14:43.867734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867653+0000","last_change":"2024-04-26T12:14:42.529285+0000","last_active":"2024-04-26T12:14:43.867653+0000","last_peered":"2024-04-26T12:14:43.867653+0000","last_clean":"2024-04-26T12:14:43.867653+0000","last_became_active":"2024-04-26T12:14:42.528618+0000","last_became_peered":"2024-04-26T12:14:42.528618+0000","last_unstale":"2024-04-26T12:14:43.867653+0000","last_undegraded":"2024-04-26T12:14:43.867653+0000","last_fullsized":"2024-04-26T12:14:43.867653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:10.595598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868242+0000","last_change":"2024-04-26T12:14:42.870080+0000","last_active":"2024-04-26T12:14:43.868242+0000","last_peered":"2024-04-26T12:14:43.868242+0000","last_clean":"2024-04-26T12:14:43.868242+0000","last_became_active":"2024-04-26T12:14:42.867542+0000","last_became_peered":"2024-04-26T12:14:42.867542+0000","last_unstale":"2024-04-26T12:14:43.868242+0000","last_undegraded":"2024-04-26T12:14:43.868242+0000","last_fullsized":"2024-04-26T12:14:43.868242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867192+0000","last_change":"2024-04-26T12:14:42.533248+0000","last_active":"2024-04-26T12:14:43.867192+0000","last_peered":"2024-04-26T12:14:43.867192+0000","last_clean":"2024-04-26T12:14:43.867192+0000","last_became_active":"2024-04-26T12:14:42.532987+0000","last_became_peered":"2024-04-26T12:14:42.532987+0000","last_unstale":"2024-04-26T12:14:43.867192+0000","last_undegraded":"2024-04-26T12:14:43.867192+0000","last_fullsized":"2024-04-26T12:14:43.867192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:03.860297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867786+0000","last_change":"2024-04-26T12:14:42.866349+0000","last_active":"2024-04-26T12:14:43.867786+0000","last_peered":"2024-04-26T12:14:43.867786+0000","last_clean":"2024-04-26T12:14:43.867786+0000","last_became_active":"2024-04-26T12:14:42.865989+0000","last_became_peered":"2024-04-26T12:14:42.865989+0000","last_unstale":"2024-04-26T12:14:43.867786+0000","last_undegraded":"2024-04-26T12:14:43.867786+0000","last_fullsized":"2024-04-26T12:14:43.867786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488849+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488849+0000","last_peered":"2024-04-26T12:14:46.488849+0000","last_clean":"2024-04-26T12:14:46.488849+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:14:46.488849+0000","last_undegraded":"2024-04-26T12:14:46.488849+0000","last_fullsized":"2024-04-26T12:14:46.488849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862558+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:42.862558+0000","last_peered":"2024-04-26T12:14:42.862558+0000","last_clean":"2024-04-26T12:14:42.862558+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:42.862558+0000","last_undegraded":"2024-04-26T12:14:42.862558+0000","last_fullsized":"2024-04-26T12:14:42.862558+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862638+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862638+0000","last_peered":"2024-04-26T12:14:42.862638+0000","last_clean":"2024-04-26T12:14:42.862638+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:42.862638+0000","last_undegraded":"2024-04-26T12:14:42.862638+0000","last_fullsized":"2024-04-26T12:14:42.862638+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488680+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:14:46.488680+0000","last_peered":"2024-04-26T12:14:46.488680+0000","last_clean":"2024-04-26T12:14:46.488680+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:14:46.488680+0000","last_undegraded":"2024-04-26T12:14:46.488680+0000","last_fullsized":"2024-04-26T12:14:46.488680+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868139+0000","last_change":"2024-04-26T12:14:42.869728+0000","last_active":"2024-04-26T12:14:43.868139+0000","last_peered":"2024-04-26T12:14:43.868139+0000","last_clean":"2024-04-26T12:14:43.868139+0000","last_became_active":"2024-04-26T12:14:42.867567+0000","last_became_peered":"2024-04-26T12:14:42.867567+0000","last_unstale":"2024-04-26T12:14:43.868139+0000","last_undegraded":"2024-04-26T12:14:43.868139+0000","last_fullsized":"2024-04-26T12:14:43.868139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862186+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:42.862186+0000","last_peered":"2024-04-26T12:14:42.862186+0000","last_clean":"2024-04-26T12:14:42.862186+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:42.862186+0000","last_undegraded":"2024-04-26T12:14:42.862186+0000","last_fullsized":"2024-04-26T12:14:42.862186+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488639+0000","last_change":"2024-04-26T12:14:42.529005+0000","last_active":"2024-04-26T12:14:46.488639+0000","last_peered":"2024-04-26T12:14:46.488639+0000","last_clean":"2024-04-26T12:14:46.488639+0000","last_became_active":"2024-04-26T12:14:42.528648+0000","last_became_peered":"2024-04-26T12:14:42.528648+0000","last_unstale":"2024-04-26T12:14:46.488639+0000","last_undegraded":"2024-04-26T12:14:46.488639+0000","last_fullsized":"2024-04-26T12:14:46.488639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867695+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:14:43.867695+0000","last_peered":"2024-04-26T12:14:43.867695+0000","last_clean":"2024-04-26T12:14:43.867695+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:14:43.867695+0000","last_undegraded":"2024-04-26T12:14:43.867695+0000","last_fullsized":"2024-04-26T12:14:43.867695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858931+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:42.858931+0000","last_peered":"2024-04-26T12:14:42.858931+0000","last_clean":"2024-04-26T12:14:42.858931+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:42.858931+0000","last_undegraded":"2024-04-26T12:14:42.858931+0000","last_fullsized":"2024-04-26T12:14:42.858931+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866866+0000","last_change":"2024-04-26T12:14:42.534422+0000","last_active":"2024-04-26T12:14:43.866866+0000","last_peered":"2024-04-26T12:14:43.866866+0000","last_clean":"2024-04-26T12:14:43.866866+0000","last_became_active":"2024-04-26T12:14:42.534055+0000","last_became_peered":"2024-04-26T12:14:42.534055+0000","last_unstale":"2024-04-26T12:14:43.866866+0000","last_undegraded":"2024-04-26T12:14:43.866866+0000","last_fullsized":"2024-04-26T12:14:43.866866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:07.197258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488858+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:14:46.488858+0000","last_peered":"2024-04-26T12:14:46.488858+0000","last_clean":"2024-04-26T12:14:46.488858+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488858+0000","last_undegraded":"2024-04-26T12:14:46.488858+0000","last_fullsized":"2024-04-26T12:14:46.488858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862986+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862986+0000","last_peered":"2024-04-26T12:14:42.862986+0000","last_clean":"2024-04-26T12:14:42.862986+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:42.862986+0000","last_undegraded":"2024-04-26T12:14:42.862986+0000","last_fullsized":"2024-04-26T12:14:42.862986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868018+0000","last_change":"2024-04-26T12:14:42.528091+0000","last_active":"2024-04-26T12:14:43.868018+0000","last_peered":"2024-04-26T12:14:43.868018+0000","last_clean":"2024-04-26T12:14:43.868018+0000","last_became_active":"2024-04-26T12:14:42.527707+0000","last_became_peered":"2024-04-26T12:14:42.527707+0000","last_unstale":"2024-04-26T12:14:43.868018+0000","last_undegraded":"2024-04-26T12:14:43.868018+0000","last_fullsized":"2024-04-26T12:14:43.868018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488728+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:14:46.488728+0000","last_peered":"2024-04-26T12:14:46.488728+0000","last_clean":"2024-04-26T12:14:46.488728+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:14:46.488728+0000","last_undegraded":"2024-04-26T12:14:46.488728+0000","last_fullsized":"2024-04-26T12:14:46.488728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868182+0000","last_change":"2024-04-26T12:14:42.530310+0000","last_active":"2024-04-26T12:14:43.868182+0000","last_peered":"2024-04-26T12:14:43.868182+0000","last_clean":"2024-04-26T12:14:43.868182+0000","last_became_active":"2024-04-26T12:14:42.529543+0000","last_became_peered":"2024-04-26T12:14:42.529543+0000","last_unstale":"2024-04-26T12:14:43.868182+0000","last_undegraded":"2024-04-26T12:14:43.868182+0000","last_fullsized":"2024-04-26T12:14:43.868182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858590+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:42.858590+0000","last_peered":"2024-04-26T12:14:42.858590+0000","last_clean":"2024-04-26T12:14:42.858590+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:42.858590+0000","last_undegraded":"2024-04-26T12:14:42.858590+0000","last_fullsized":"2024-04-26T12:14:42.858590+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867097+0000","last_change":"2024-04-26T12:14:42.870740+0000","last_active":"2024-04-26T12:14:43.867097+0000","last_peered":"2024-04-26T12:14:43.867097+0000","last_clean":"2024-04-26T12:14:43.867097+0000","last_became_active":"2024-04-26T12:14:42.870426+0000","last_became_peered":"2024-04-26T12:14:42.870426+0000","last_unstale":"2024-04-26T12:14:43.867097+0000","last_undegraded":"2024-04-26T12:14:43.867097+0000","last_fullsized":"2024-04-26T12:14:43.867097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488738+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:14:46.488738+0000","last_peered":"2024-04-26T12:14:46.488738+0000","last_clean":"2024-04-26T12:14:46.488738+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:14:46.488738+0000","last_undegraded":"2024-04-26T12:14:46.488738+0000","last_fullsized":"2024-04-26T12:14:46.488738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859224+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:42.859224+0000","last_peered":"2024-04-26T12:14:42.859224+0000","last_clean":"2024-04-26T12:14:42.859224+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:42.859224+0000","last_undegraded":"2024-04-26T12:14:42.859224+0000","last_fullsized":"2024-04-26T12:14:42.859224+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867149+0000","last_change":"2024-04-26T12:14:42.868394+0000","last_active":"2024-04-26T12:14:43.867149+0000","last_peered":"2024-04-26T12:14:43.867149+0000","last_clean":"2024-04-26T12:14:43.867149+0000","last_became_active":"2024-04-26T12:14:42.867469+0000","last_became_peered":"2024-04-26T12:14:42.867469+0000","last_unstale":"2024-04-26T12:14:43.867149+0000","last_undegraded":"2024-04-26T12:14:43.867149+0000","last_fullsized":"2024-04-26T12:14:43.867149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488919+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:14:46.488919+0000","last_peered":"2024-04-26T12:14:46.488919+0000","last_clean":"2024-04-26T12:14:46.488919+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:14:46.488919+0000","last_undegraded":"2024-04-26T12:14:46.488919+0000","last_fullsized":"2024-04-26T12:14:46.488919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859750+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:42.859750+0000","last_peered":"2024-04-26T12:14:42.859750+0000","last_clean":"2024-04-26T12:14:42.859750+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:42.859750+0000","last_undegraded":"2024-04-26T12:14:42.859750+0000","last_fullsized":"2024-04-26T12:14:42.859750+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488546+0000","last_change":"2024-04-26T12:14:42.872140+0000","last_active":"2024-04-26T12:14:46.488546+0000","last_peered":"2024-04-26T12:14:46.488546+0000","last_clean":"2024-04-26T12:14:46.488546+0000","last_became_active":"2024-04-26T12:14:42.871667+0000","last_became_peered":"2024-04-26T12:14:42.871667+0000","last_unstale":"2024-04-26T12:14:46.488546+0000","last_undegraded":"2024-04-26T12:14:46.488546+0000","last_fullsized":"2024-04-26T12:14:46.488546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.601045+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.601045+0000","last_peered":"2024-04-26T12:14:46.601045+0000","last_clean":"2024-04-26T12:14:46.601045+0000","last_became_active":"2024-04-26T12:14:42.530054+0000","last_became_peered":"2024-04-26T12:14:42.530054+0000","last_unstale":"2024-04-26T12:14:46.601045+0000","last_undegraded":"2024-04-26T12:14:46.601045+0000","last_fullsized":"2024-04-26T12:14:46.601045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.865382+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:42.865382+0000","last_peered":"2024-04-26T12:14:42.865382+0000","last_clean":"2024-04-26T12:14:42.865382+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:42.865382+0000","last_undegraded":"2024-04-26T12:14:42.865382+0000","last_fullsized":"2024-04-26T12:14:42.865382+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866908+0000","last_change":"2024-04-26T12:14:42.866932+0000","last_active":"2024-04-26T12:14:43.866908+0000","last_peered":"2024-04-26T12:14:43.866908+0000","last_clean":"2024-04-26T12:14:43.866908+0000","last_became_active":"2024-04-26T12:14:42.866555+0000","last_became_peered":"2024-04-26T12:14:42.866555+0000","last_unstale":"2024-04-26T12:14:43.866908+0000","last_undegraded":"2024-04-26T12:14:43.866908+0000","last_fullsized":"2024-04-26T12:14:43.866908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:35.495924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867685+0000","last_change":"2024-04-26T12:14:42.867426+0000","last_active":"2024-04-26T12:14:43.867685+0000","last_peered":"2024-04-26T12:14:43.867685+0000","last_clean":"2024-04-26T12:14:43.867685+0000","last_became_active":"2024-04-26T12:14:42.866597+0000","last_became_peered":"2024-04-26T12:14:42.866597+0000","last_unstale":"2024-04-26T12:14:43.867685+0000","last_undegraded":"2024-04-26T12:14:43.867685+0000","last_fullsized":"2024-04-26T12:14:43.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867778+0000","last_change":"2024-04-26T12:14:42.528956+0000","last_active":"2024-04-26T12:14:43.867778+0000","last_peered":"2024-04-26T12:14:43.867778+0000","last_clean":"2024-04-26T12:14:43.867778+0000","last_became_active":"2024-04-26T12:14:42.528543+0000","last_became_peered":"2024-04-26T12:14:42.528543+0000","last_unstale":"2024-04-26T12:14:43.867778+0000","last_undegraded":"2024-04-26T12:14:43.867778+0000","last_fullsized":"2024-04-26T12:14:43.867778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488657+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:14:46.488657+0000","last_peered":"2024-04-26T12:14:46.488657+0000","last_clean":"2024-04-26T12:14:46.488657+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:14:46.488657+0000","last_undegraded":"2024-04-26T12:14:46.488657+0000","last_fullsized":"2024-04-26T12:14:46.488657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867876+0000","last_change":"2024-04-26T12:14:42.534326+0000","last_active":"2024-04-26T12:14:43.867876+0000","last_peered":"2024-04-26T12:14:43.867876+0000","last_clean":"2024-04-26T12:14:43.867876+0000","last_became_active":"2024-04-26T12:14:42.534008+0000","last_became_peered":"2024-04-26T12:14:42.534008+0000","last_unstale":"2024-04-26T12:14:43.867876+0000","last_undegraded":"2024-04-26T12:14:43.867876+0000","last_fullsized":"2024-04-26T12:14:43.867876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:34.796560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868039+0000","last_change":"2024-04-26T12:14:42.533769+0000","last_active":"2024-04-26T12:14:43.868039+0000","last_peered":"2024-04-26T12:14:43.868039+0000","last_clean":"2024-04-26T12:14:43.868039+0000","last_became_active":"2024-04-26T12:14:42.533439+0000","last_became_peered":"2024-04-26T12:14:42.533439+0000","last_unstale":"2024-04-26T12:14:43.868039+0000","last_undegraded":"2024-04-26T12:14:43.868039+0000","last_fullsized":"2024-04-26T12:14:43.868039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488609+0000","last_change":"2024-04-26T12:14:42.870305+0000","last_active":"2024-04-26T12:14:46.488609+0000","last_peered":"2024-04-26T12:14:46.488609+0000","last_clean":"2024-04-26T12:14:46.488609+0000","last_became_active":"2024-04-26T12:14:42.869976+0000","last_became_peered":"2024-04-26T12:14:42.869976+0000","last_unstale":"2024-04-26T12:14:46.488609+0000","last_undegraded":"2024-04-26T12:14:46.488609+0000","last_fullsized":"2024-04-26T12:14:46.488609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488896+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.488896+0000","last_peered":"2024-04-26T12:14:46.488896+0000","last_clean":"2024-04-26T12:14:46.488896+0000","last_became_active":"2024-04-26T12:14:42.529967+0000","last_became_peered":"2024-04-26T12:14:42.529967+0000","last_unstale":"2024-04-26T12:14:46.488896+0000","last_undegraded":"2024-04-26T12:14:46.488896+0000","last_fullsized":"2024-04-26T12:14:46.488896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488516+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:14:46.488516+0000","last_peered":"2024-04-26T12:14:46.488516+0000","last_clean":"2024-04-26T12:14:46.488516+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:14:46.488516+0000","last_undegraded":"2024-04-26T12:14:46.488516+0000","last_fullsized":"2024-04-26T12:14:46.488516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867835+0000","last_change":"2024-04-26T12:14:42.874343+0000","last_active":"2024-04-26T12:14:43.867835+0000","last_peered":"2024-04-26T12:14:43.867835+0000","last_clean":"2024-04-26T12:14:43.867835+0000","last_became_active":"2024-04-26T12:14:42.874067+0000","last_became_peered":"2024-04-26T12:14:42.874067+0000","last_unstale":"2024-04-26T12:14:43.867835+0000","last_undegraded":"2024-04-26T12:14:43.867835+0000","last_fullsized":"2024-04-26T12:14:43.867835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488559+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:14:46.488559+0000","last_peered":"2024-04-26T12:14:46.488559+0000","last_clean":"2024-04-26T12:14:46.488559+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:14:46.488559+0000","last_undegraded":"2024-04-26T12:14:46.488559+0000","last_fullsized":"2024-04-26T12:14:46.488559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488775+0000","last_change":"2024-04-26T12:14:42.870189+0000","last_active":"2024-04-26T12:14:46.488775+0000","last_peered":"2024-04-26T12:14:46.488775+0000","last_clean":"2024-04-26T12:14:46.488775+0000","last_became_active":"2024-04-26T12:14:42.869808+0000","last_became_peered":"2024-04-26T12:14:42.869808+0000","last_unstale":"2024-04-26T12:14:46.488775+0000","last_undegraded":"2024-04-26T12:14:46.488775+0000","last_fullsized":"2024-04-26T12:14:46.488775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488619+0000","last_change":"2024-04-26T12:14:42.530759+0000","last_active":"2024-04-26T12:14:46.488619+0000","last_peered":"2024-04-26T12:14:46.488619+0000","last_clean":"2024-04-26T12:14:46.488619+0000","last_became_active":"2024-04-26T12:14:42.530393+0000","last_became_peered":"2024-04-26T12:14:42.530393+0000","last_unstale":"2024-04-26T12:14:46.488619+0000","last_undegraded":"2024-04-26T12:14:46.488619+0000","last_fullsized":"2024-04-26T12:14:46.488619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867656+0000","last_change":"2024-04-26T12:14:42.867217+0000","last_active":"2024-04-26T12:14:43.867656+0000","last_peered":"2024-04-26T12:14:43.867656+0000","last_clean":"2024-04-26T12:14:43.867656+0000","last_became_active":"2024-04-26T12:14:42.866778+0000","last_became_peered":"2024-04-26T12:14:42.866778+0000","last_unstale":"2024-04-26T12:14:43.867656+0000","last_undegraded":"2024-04-26T12:14:43.867656+0000","last_fullsized":"2024-04-26T12:14:43.867656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867244+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:14:43.867244+0000","last_peered":"2024-04-26T12:14:43.867244+0000","last_clean":"2024-04-26T12:14:43.867244+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:14:43.867244+0000","last_undegraded":"2024-04-26T12:14:43.867244+0000","last_fullsized":"2024-04-26T12:14:43.867244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867461+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:14:43.867461+0000","last_peered":"2024-04-26T12:14:43.867461+0000","last_clean":"2024-04-26T12:14:43.867461+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:14:43.867461+0000","last_undegraded":"2024-04-26T12:14:43.867461+0000","last_fullsized":"2024-04-26T12:14:43.867461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867373+0000","last_change":"2024-04-26T12:14:42.534341+0000","last_active":"2024-04-26T12:14:43.867373+0000","last_peered":"2024-04-26T12:14:43.867373+0000","last_clean":"2024-04-26T12:14:43.867373+0000","last_became_active":"2024-04-26T12:14:42.534034+0000","last_became_peered":"2024-04-26T12:14:42.534034+0000","last_unstale":"2024-04-26T12:14:43.867373+0000","last_undegraded":"2024-04-26T12:14:43.867373+0000","last_fullsized":"2024-04-26T12:14:43.867373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:49.137895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867226+0000","last_change":"2024-04-26T12:14:42.868865+0000","last_active":"2024-04-26T12:14:43.867226+0000","last_peered":"2024-04-26T12:14:43.867226+0000","last_clean":"2024-04-26T12:14:43.867226+0000","last_became_active":"2024-04-26T12:14:42.868331+0000","last_became_peered":"2024-04-26T12:14:42.868331+0000","last_unstale":"2024-04-26T12:14:43.867226+0000","last_undegraded":"2024-04-26T12:14:43.867226+0000","last_fullsized":"2024-04-26T12:14:43.867226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:48.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867662+0000","last_change":"2024-04-26T12:14:42.530621+0000","last_active":"2024-04-26T12:14:43.867662+0000","last_peered":"2024-04-26T12:14:43.867662+0000","last_clean":"2024-04-26T12:14:43.867662+0000","last_became_active":"2024-04-26T12:14:42.529635+0000","last_became_peered":"2024-04-26T12:14:42.529635+0000","last_unstale":"2024-04-26T12:14:43.867662+0000","last_undegraded":"2024-04-26T12:14:43.867662+0000","last_fullsized":"2024-04-26T12:14:43.867662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.073389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867450+0000","last_change":"2024-04-26T12:14:42.867354+0000","last_active":"2024-04-26T12:14:43.867450+0000","last_peered":"2024-04-26T12:14:43.867450+0000","last_clean":"2024-04-26T12:14:43.867450+0000","last_became_active":"2024-04-26T12:14:42.866550+0000","last_became_peered":"2024-04-26T12:14:42.866550+0000","last_unstale":"2024-04-26T12:14:43.867450+0000","last_undegraded":"2024-04-26T12:14:43.867450+0000","last_fullsized":"2024-04-26T12:14:43.867450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867761+0000","last_change":"2024-04-26T12:14:42.533661+0000","last_active":"2024-04-26T12:14:43.867761+0000","last_peered":"2024-04-26T12:14:43.867761+0000","last_clean":"2024-04-26T12:14:43.867761+0000","last_became_active":"2024-04-26T12:14:42.533454+0000","last_became_peered":"2024-04-26T12:14:42.533454+0000","last_unstale":"2024-04-26T12:14:43.867761+0000","last_undegraded":"2024-04-26T12:14:43.867761+0000","last_fullsized":"2024-04-26T12:14:43.867761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:06.330845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867306+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:14:43.867306+0000","last_peered":"2024-04-26T12:14:43.867306+0000","last_clean":"2024-04-26T12:14:43.867306+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:14:43.867306+0000","last_undegraded":"2024-04-26T12:14:43.867306+0000","last_fullsized":"2024-04-26T12:14:43.867306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488786+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:14:46.488786+0000","last_peered":"2024-04-26T12:14:46.488786+0000","last_clean":"2024-04-26T12:14:46.488786+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:14:46.488786+0000","last_undegraded":"2024-04-26T12:14:46.488786+0000","last_fullsized":"2024-04-26T12:14:46.488786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867425+0000","last_change":"2024-04-26T12:14:42.869979+0000","last_active":"2024-04-26T12:14:43.867425+0000","last_peered":"2024-04-26T12:14:43.867425+0000","last_clean":"2024-04-26T12:14:43.867425+0000","last_became_active":"2024-04-26T12:14:42.868687+0000","last_became_peered":"2024-04-26T12:14:42.868687+0000","last_unstale":"2024-04-26T12:14:43.867425+0000","last_undegraded":"2024-04-26T12:14:43.867425+0000","last_fullsized":"2024-04-26T12:14:43.867425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488886+0000","last_change":"2024-04-26T12:14:42.534167+0000","last_active":"2024-04-26T12:14:46.488886+0000","last_peered":"2024-04-26T12:14:46.488886+0000","last_clean":"2024-04-26T12:14:46.488886+0000","last_became_active":"2024-04-26T12:14:42.533826+0000","last_became_peered":"2024-04-26T12:14:42.533826+0000","last_unstale":"2024-04-26T12:14:46.488886+0000","last_undegraded":"2024-04-26T12:14:46.488886+0000","last_fullsized":"2024-04-26T12:14:46.488886+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35348,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336492,"statfs":{"total":96636764160,"available":96600567808,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:53.622 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:53.939 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:14:53.950 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T12:14:52.425873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94972,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020548,"statfs":{"total":289910292480,"available":289813041152,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.571019"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867707+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:14:43.867707+0000","last_peered":"2024-04-26T12:14:43.867707+0000","last_clean":"2024-04-26T12:14:43.867707+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:14:43.867707+0000","last_undegraded":"2024-04-26T12:14:43.867707+0000","last_fullsized":"2024-04-26T12:14:43.867707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867546+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:14:43.867546+0000","last_peered":"2024-04-26T12:14:43.867546+0000","last_clean":"2024-04-26T12:14:43.867546+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:14:43.867546+0000","last_undegraded":"2024-04-26T12:14:43.867546+0000","last_fullsized":"2024-04-26T12:14:43.867546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867948+0000","last_change":"2024-04-26T12:14:42.872215+0000","last_active":"2024-04-26T12:14:43.867948+0000","last_peered":"2024-04-26T12:14:43.867948+0000","last_clean":"2024-04-26T12:14:43.867948+0000","last_became_active":"2024-04-26T12:14:42.871084+0000","last_became_peered":"2024-04-26T12:14:42.871084+0000","last_unstale":"2024-04-26T12:14:43.867948+0000","last_undegraded":"2024-04-26T12:14:43.867948+0000","last_fullsized":"2024-04-26T12:14:43.867948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:54.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867375+0000","last_change":"2024-04-26T12:14:42.869954+0000","last_active":"2024-04-26T12:14:43.867375+0000","last_peered":"2024-04-26T12:14:43.867375+0000","last_clean":"2024-04-26T12:14:43.867375+0000","last_became_active":"2024-04-26T12:14:42.869262+0000","last_became_peered":"2024-04-26T12:14:42.869262+0000","last_unstale":"2024-04-26T12:14:43.867375+0000","last_undegraded":"2024-04-26T12:14:43.867375+0000","last_fullsized":"2024-04-26T12:14:43.867375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:41.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867412+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:14:43.867412+0000","last_peered":"2024-04-26T12:14:43.867412+0000","last_clean":"2024-04-26T12:14:43.867412+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:14:43.867412+0000","last_undegraded":"2024-04-26T12:14:43.867412+0000","last_fullsized":"2024-04-26T12:14:43.867412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867032+0000","last_change":"2024-04-26T12:14:42.870198+0000","last_active":"2024-04-26T12:14:43.867032+0000","last_peered":"2024-04-26T12:14:43.867032+0000","last_clean":"2024-04-26T12:14:43.867032+0000","last_became_active":"2024-04-26T12:14:42.869783+0000","last_became_peered":"2024-04-26T12:14:42.869783+0000","last_unstale":"2024-04-26T12:14:43.867032+0000","last_undegraded":"2024-04-26T12:14:43.867032+0000","last_fullsized":"2024-04-26T12:14:43.867032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:03.272719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867135+0000","last_change":"2024-04-26T12:14:42.867620+0000","last_active":"2024-04-26T12:14:43.867135+0000","last_peered":"2024-04-26T12:14:43.867135+0000","last_clean":"2024-04-26T12:14:43.867135+0000","last_became_active":"2024-04-26T12:14:42.866727+0000","last_became_peered":"2024-04-26T12:14:42.866727+0000","last_unstale":"2024-04-26T12:14:43.867135+0000","last_undegraded":"2024-04-26T12:14:43.867135+0000","last_fullsized":"2024-04-26T12:14:43.867135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866936+0000","last_change":"2024-04-26T12:14:42.871957+0000","last_active":"2024-04-26T12:14:43.866936+0000","last_peered":"2024-04-26T12:14:43.866936+0000","last_clean":"2024-04-26T12:14:43.866936+0000","last_became_active":"2024-04-26T12:14:42.870987+0000","last_became_peered":"2024-04-26T12:14:42.870987+0000","last_unstale":"2024-04-26T12:14:43.866936+0000","last_undegraded":"2024-04-26T12:14:43.866936+0000","last_fullsized":"2024-04-26T12:14:43.866936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.657803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488830+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:14:46.488830+0000","last_peered":"2024-04-26T12:14:46.488830+0000","last_clean":"2024-04-26T12:14:46.488830+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:14:46.488830+0000","last_undegraded":"2024-04-26T12:14:46.488830+0000","last_fullsized":"2024-04-26T12:14:46.488830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867722+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:14:43.867722+0000","last_peered":"2024-04-26T12:14:43.867722+0000","last_clean":"2024-04-26T12:14:43.867722+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:14:43.867722+0000","last_undegraded":"2024-04-26T12:14:43.867722+0000","last_fullsized":"2024-04-26T12:14:43.867722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867635+0000","last_change":"2024-04-26T12:14:42.870737+0000","last_active":"2024-04-26T12:14:43.867635+0000","last_peered":"2024-04-26T12:14:43.867635+0000","last_clean":"2024-04-26T12:14:43.867635+0000","last_became_active":"2024-04-26T12:14:42.870218+0000","last_became_peered":"2024-04-26T12:14:42.870218+0000","last_unstale":"2024-04-26T12:14:43.867635+0000","last_undegraded":"2024-04-26T12:14:43.867635+0000","last_fullsized":"2024-04-26T12:14:43.867635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:47.108520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867459+0000","last_change":"2024-04-26T12:14:42.870694+0000","last_active":"2024-04-26T12:14:43.867459+0000","last_peered":"2024-04-26T12:14:43.867459+0000","last_clean":"2024-04-26T12:14:43.867459+0000","last_became_active":"2024-04-26T12:14:42.870325+0000","last_became_peered":"2024-04-26T12:14:42.870325+0000","last_unstale":"2024-04-26T12:14:43.867459+0000","last_undegraded":"2024-04-26T12:14:43.867459+0000","last_fullsized":"2024-04-26T12:14:43.867459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867047+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:14:43.867047+0000","last_peered":"2024-04-26T12:14:43.867047+0000","last_clean":"2024-04-26T12:14:43.867047+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:14:43.867047+0000","last_undegraded":"2024-04-26T12:14:43.867047+0000","last_fullsized":"2024-04-26T12:14:43.867047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867184+0000","last_change":"2024-04-26T12:14:42.868400+0000","last_active":"2024-04-26T12:14:43.867184+0000","last_peered":"2024-04-26T12:14:43.867184+0000","last_clean":"2024-04-26T12:14:43.867184+0000","last_became_active":"2024-04-26T12:14:42.867646+0000","last_became_peered":"2024-04-26T12:14:42.867646+0000","last_unstale":"2024-04-26T12:14:43.867184+0000","last_undegraded":"2024-04-26T12:14:43.867184+0000","last_fullsized":"2024-04-26T12:14:43.867184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867236+0000","last_change":"2024-04-26T12:14:42.867157+0000","last_active":"2024-04-26T12:14:43.867236+0000","last_peered":"2024-04-26T12:14:43.867236+0000","last_clean":"2024-04-26T12:14:43.867236+0000","last_became_active":"2024-04-26T12:14:42.865840+0000","last_became_peered":"2024-04-26T12:14:42.865840+0000","last_unstale":"2024-04-26T12:14:43.867236+0000","last_undegraded":"2024-04-26T12:14:43.867236+0000","last_fullsized":"2024-04-26T12:14:43.867236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866901+0000","last_change":"2024-04-26T12:14:42.871915+0000","last_active":"2024-04-26T12:14:43.866901+0000","last_peered":"2024-04-26T12:14:43.866901+0000","last_clean":"2024-04-26T12:14:43.866901+0000","last_became_active":"2024-04-26T12:14:42.870604+0000","last_became_peered":"2024-04-26T12:14:42.870604+0000","last_unstale":"2024-04-26T12:14:43.866901+0000","last_undegraded":"2024-04-26T12:14:43.866901+0000","last_fullsized":"2024-04-26T12:14:43.866901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488910+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:14:46.488910+0000","last_peered":"2024-04-26T12:14:46.488910+0000","last_clean":"2024-04-26T12:14:46.488910+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488910+0000","last_undegraded":"2024-04-26T12:14:46.488910+0000","last_fullsized":"2024-04-26T12:14:46.488910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867812+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:14:43.867812+0000","last_peered":"2024-04-26T12:14:43.867812+0000","last_clean":"2024-04-26T12:14:43.867812+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:14:43.867812+0000","last_undegraded":"2024-04-26T12:14:43.867812+0000","last_fullsized":"2024-04-26T12:14:43.867812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488755+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:14:46.488755+0000","last_peered":"2024-04-26T12:14:46.488755+0000","last_clean":"2024-04-26T12:14:46.488755+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:14:46.488755+0000","last_undegraded":"2024-04-26T12:14:46.488755+0000","last_fullsized":"2024-04-26T12:14:46.488755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867547+0000","last_change":"2024-04-26T12:14:42.869830+0000","last_active":"2024-04-26T12:14:43.867547+0000","last_peered":"2024-04-26T12:14:43.867547+0000","last_clean":"2024-04-26T12:14:43.867547+0000","last_became_active":"2024-04-26T12:14:42.869225+0000","last_became_peered":"2024-04-26T12:14:42.869225+0000","last_unstale":"2024-04-26T12:14:43.867547+0000","last_undegraded":"2024-04-26T12:14:43.867547+0000","last_fullsized":"2024-04-26T12:14:43.867547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:53.111870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867710+0000","last_change":"2024-04-26T12:14:42.868630+0000","last_active":"2024-04-26T12:14:43.867710+0000","last_peered":"2024-04-26T12:14:43.867710+0000","last_clean":"2024-04-26T12:14:43.867710+0000","last_became_active":"2024-04-26T12:14:42.867548+0000","last_became_peered":"2024-04-26T12:14:42.867548+0000","last_unstale":"2024-04-26T12:14:43.867710+0000","last_undegraded":"2024-04-26T12:14:43.867710+0000","last_fullsized":"2024-04-26T12:14:43.867710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866911+0000","last_change":"2024-04-26T12:14:42.870882+0000","last_active":"2024-04-26T12:14:43.866911+0000","last_peered":"2024-04-26T12:14:43.866911+0000","last_clean":"2024-04-26T12:14:43.866911+0000","last_became_active":"2024-04-26T12:14:42.870623+0000","last_became_peered":"2024-04-26T12:14:42.870623+0000","last_unstale":"2024-04-26T12:14:43.866911+0000","last_undegraded":"2024-04-26T12:14:43.866911+0000","last_fullsized":"2024-04-26T12:14:43.866911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488588+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488588+0000","last_peered":"2024-04-26T12:14:46.488588+0000","last_clean":"2024-04-26T12:14:46.488588+0000","last_became_active":"2024-04-26T12:14:42.867223+0000","last_became_peered":"2024-04-26T12:14:42.867223+0000","last_unstale":"2024-04-26T12:14:46.488588+0000","last_undegraded":"2024-04-26T12:14:46.488588+0000","last_fullsized":"2024-04-26T12:14:46.488588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866690+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:14:43.866690+0000","last_peered":"2024-04-26T12:14:43.866690+0000","last_clean":"2024-04-26T12:14:43.866690+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:14:43.866690+0000","last_undegraded":"2024-04-26T12:14:43.866690+0000","last_fullsized":"2024-04-26T12:14:43.866690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867693+0000","last_change":"2024-04-26T12:14:42.874005+0000","last_active":"2024-04-26T12:14:43.867693+0000","last_peered":"2024-04-26T12:14:43.867693+0000","last_clean":"2024-04-26T12:14:43.867693+0000","last_became_active":"2024-04-26T12:14:42.873631+0000","last_became_peered":"2024-04-26T12:14:42.873631+0000","last_unstale":"2024-04-26T12:14:43.867693+0000","last_undegraded":"2024-04-26T12:14:43.867693+0000","last_fullsized":"2024-04-26T12:14:43.867693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488765+0000","last_change":"2024-04-26T12:14:42.873571+0000","last_active":"2024-04-26T12:14:46.488765+0000","last_peered":"2024-04-26T12:14:46.488765+0000","last_clean":"2024-04-26T12:14:46.488765+0000","last_became_active":"2024-04-26T12:14:42.873286+0000","last_became_peered":"2024-04-26T12:14:42.873286+0000","last_unstale":"2024-04-26T12:14:46.488765+0000","last_undegraded":"2024-04-26T12:14:46.488765+0000","last_fullsized":"2024-04-26T12:14:46.488765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868004+0000","last_change":"2024-04-26T12:14:42.870555+0000","last_active":"2024-04-26T12:14:43.868004+0000","last_peered":"2024-04-26T12:14:43.868004+0000","last_clean":"2024-04-26T12:14:43.868004+0000","last_became_active":"2024-04-26T12:14:42.869400+0000","last_became_peered":"2024-04-26T12:14:42.869400+0000","last_unstale":"2024-04-26T12:14:43.868004+0000","last_undegraded":"2024-04-26T12:14:43.868004+0000","last_fullsized":"2024-04-26T12:14:43.868004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:23.492068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867621+0000","last_change":"2024-04-26T12:14:42.874272+0000","last_active":"2024-04-26T12:14:43.867621+0000","last_peered":"2024-04-26T12:14:43.867621+0000","last_clean":"2024-04-26T12:14:43.867621+0000","last_became_active":"2024-04-26T12:14:42.873934+0000","last_became_peered":"2024-04-26T12:14:42.873934+0000","last_unstale":"2024-04-26T12:14:43.867621+0000","last_undegraded":"2024-04-26T12:14:43.867621+0000","last_fullsized":"2024-04-26T12:14:43.867621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:05.149736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488690+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:14:46.488690+0000","last_peered":"2024-04-26T12:14:46.488690+0000","last_clean":"2024-04-26T12:14:46.488690+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:14:46.488690+0000","last_undegraded":"2024-04-26T12:14:46.488690+0000","last_fullsized":"2024-04-26T12:14:46.488690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867101+0000","last_change":"2024-04-26T12:14:42.867054+0000","last_active":"2024-04-26T12:14:43.867101+0000","last_peered":"2024-04-26T12:14:43.867101+0000","last_clean":"2024-04-26T12:14:43.867101+0000","last_became_active":"2024-04-26T12:14:42.866676+0000","last_became_peered":"2024-04-26T12:14:42.866676+0000","last_unstale":"2024-04-26T12:14:43.867101+0000","last_undegraded":"2024-04-26T12:14:43.867101+0000","last_fullsized":"2024-04-26T12:14:43.867101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488599+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:14:46.488599+0000","last_peered":"2024-04-26T12:14:46.488599+0000","last_clean":"2024-04-26T12:14:46.488599+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:14:46.488599+0000","last_undegraded":"2024-04-26T12:14:46.488599+0000","last_fullsized":"2024-04-26T12:14:46.488599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867023+0000","last_change":"2024-04-26T12:14:42.871222+0000","last_active":"2024-04-26T12:14:43.867023+0000","last_peered":"2024-04-26T12:14:43.867023+0000","last_clean":"2024-04-26T12:14:43.867023+0000","last_became_active":"2024-04-26T12:14:42.870454+0000","last_became_peered":"2024-04-26T12:14:42.870454+0000","last_unstale":"2024-04-26T12:14:43.867023+0000","last_undegraded":"2024-04-26T12:14:43.867023+0000","last_fullsized":"2024-04-26T12:14:43.867023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867584+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:14:43.867584+0000","last_peered":"2024-04-26T12:14:43.867584+0000","last_clean":"2024-04-26T12:14:43.867584+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:14:43.867584+0000","last_undegraded":"2024-04-26T12:14:43.867584+0000","last_fullsized":"2024-04-26T12:14:43.867584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867972+0000","last_change":"2024-04-26T12:14:42.527996+0000","last_active":"2024-04-26T12:14:43.867972+0000","last_peered":"2024-04-26T12:14:43.867972+0000","last_clean":"2024-04-26T12:14:43.867972+0000","last_became_active":"2024-04-26T12:14:42.527615+0000","last_became_peered":"2024-04-26T12:14:42.527615+0000","last_unstale":"2024-04-26T12:14:43.867972+0000","last_undegraded":"2024-04-26T12:14:43.867972+0000","last_fullsized":"2024-04-26T12:14:43.867972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867703+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:14:43.867703+0000","last_peered":"2024-04-26T12:14:43.867703+0000","last_clean":"2024-04-26T12:14:43.867703+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:14:43.867703+0000","last_undegraded":"2024-04-26T12:14:43.867703+0000","last_fullsized":"2024-04-26T12:14:43.867703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488669+0000","last_change":"2024-04-26T12:14:42.529666+0000","last_active":"2024-04-26T12:14:46.488669+0000","last_peered":"2024-04-26T12:14:46.488669+0000","last_clean":"2024-04-26T12:14:46.488669+0000","last_became_active":"2024-04-26T12:14:42.529366+0000","last_became_peered":"2024-04-26T12:14:42.529366+0000","last_unstale":"2024-04-26T12:14:46.488669+0000","last_undegraded":"2024-04-26T12:14:46.488669+0000","last_fullsized":"2024-04-26T12:14:46.488669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488798+0000","last_change":"2024-04-26T12:14:42.873577+0000","last_active":"2024-04-26T12:14:46.488798+0000","last_peered":"2024-04-26T12:14:46.488798+0000","last_clean":"2024-04-26T12:14:46.488798+0000","last_became_active":"2024-04-26T12:14:42.873183+0000","last_became_peered":"2024-04-26T12:14:42.873183+0000","last_unstale":"2024-04-26T12:14:46.488798+0000","last_undegraded":"2024-04-26T12:14:46.488798+0000","last_fullsized":"2024-04-26T12:14:46.488798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867161+0000","last_change":"2024-04-26T12:14:42.533710+0000","last_active":"2024-04-26T12:14:43.867161+0000","last_peered":"2024-04-26T12:14:43.867161+0000","last_clean":"2024-04-26T12:14:43.867161+0000","last_became_active":"2024-04-26T12:14:42.533436+0000","last_became_peered":"2024-04-26T12:14:42.533436+0000","last_unstale":"2024-04-26T12:14:43.867161+0000","last_undegraded":"2024-04-26T12:14:43.867161+0000","last_fullsized":"2024-04-26T12:14:43.867161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488840+0000","last_change":"2024-04-26T12:14:42.871019+0000","last_active":"2024-04-26T12:14:46.488840+0000","last_peered":"2024-04-26T12:14:46.488840+0000","last_clean":"2024-04-26T12:14:46.488840+0000","last_became_active":"2024-04-26T12:14:42.870630+0000","last_became_peered":"2024-04-26T12:14:42.870630+0000","last_unstale":"2024-04-26T12:14:46.488840+0000","last_undegraded":"2024-04-26T12:14:46.488840+0000","last_fullsized":"2024-04-26T12:14:46.488840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867164+0000","last_change":"2024-04-26T12:14:42.533517+0000","last_active":"2024-04-26T12:14:43.867164+0000","last_peered":"2024-04-26T12:14:43.867164+0000","last_clean":"2024-04-26T12:14:43.867164+0000","last_became_active":"2024-04-26T12:14:42.532693+0000","last_became_peered":"2024-04-26T12:14:42.532693+0000","last_unstale":"2024-04-26T12:14:43.867164+0000","last_undegraded":"2024-04-26T12:14:43.867164+0000","last_fullsized":"2024-04-26T12:14:43.867164+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868125+0000","last_change":"2024-04-26T12:14:42.532602+0000","last_active":"2024-04-26T12:14:43.868125+0000","last_peered":"2024-04-26T12:14:43.868125+0000","last_clean":"2024-04-26T12:14:43.868125+0000","last_became_active":"2024-04-26T12:14:42.531944+0000","last_became_peered":"2024-04-26T12:14:42.531944+0000","last_unstale":"2024-04-26T12:14:43.868125+0000","last_undegraded":"2024-04-26T12:14:43.868125+0000","last_fullsized":"2024-04-26T12:14:43.868125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866726+0000","last_change":"2024-04-26T12:14:42.871236+0000","last_active":"2024-04-26T12:14:43.866726+0000","last_peered":"2024-04-26T12:14:43.866726+0000","last_clean":"2024-04-26T12:14:43.866726+0000","last_became_active":"2024-04-26T12:14:42.871041+0000","last_became_peered":"2024-04-26T12:14:42.871041+0000","last_unstale":"2024-04-26T12:14:43.866726+0000","last_undegraded":"2024-04-26T12:14:43.866726+0000","last_fullsized":"2024-04-26T12:14:43.866726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:26.643464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867860+0000","last_change":"2024-04-26T12:14:42.534442+0000","last_active":"2024-04-26T12:14:43.867860+0000","last_peered":"2024-04-26T12:14:43.867860+0000","last_clean":"2024-04-26T12:14:43.867860+0000","last_became_active":"2024-04-26T12:14:42.534150+0000","last_became_peered":"2024-04-26T12:14:42.534150+0000","last_unstale":"2024-04-26T12:14:43.867860+0000","last_undegraded":"2024-04-26T12:14:43.867860+0000","last_fullsized":"2024-04-26T12:14:43.867860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:37.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868126+0000","last_change":"2024-04-26T12:14:42.530595+0000","last_active":"2024-04-26T12:14:43.868126+0000","last_peered":"2024-04-26T12:14:43.868126+0000","last_clean":"2024-04-26T12:14:43.868126+0000","last_became_active":"2024-04-26T12:14:42.529757+0000","last_became_peered":"2024-04-26T12:14:42.529757+0000","last_unstale":"2024-04-26T12:14:43.868126+0000","last_undegraded":"2024-04-26T12:14:43.868126+0000","last_fullsized":"2024-04-26T12:14:43.868126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867296+0000","last_change":"2024-04-26T12:14:42.869311+0000","last_active":"2024-04-26T12:14:43.867296+0000","last_peered":"2024-04-26T12:14:43.867296+0000","last_clean":"2024-04-26T12:14:43.867296+0000","last_became_active":"2024-04-26T12:14:42.868477+0000","last_became_peered":"2024-04-26T12:14:42.868477+0000","last_unstale":"2024-04-26T12:14:43.867296+0000","last_undegraded":"2024-04-26T12:14:43.867296+0000","last_fullsized":"2024-04-26T12:14:43.867296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867818+0000","last_change":"2024-04-26T12:14:42.528134+0000","last_active":"2024-04-26T12:14:43.867818+0000","last_peered":"2024-04-26T12:14:43.867818+0000","last_clean":"2024-04-26T12:14:43.867818+0000","last_became_active":"2024-04-26T12:14:42.527701+0000","last_became_peered":"2024-04-26T12:14:42.527701+0000","last_unstale":"2024-04-26T12:14:43.867818+0000","last_undegraded":"2024-04-26T12:14:43.867818+0000","last_fullsized":"2024-04-26T12:14:43.867818+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488699+0000","last_change":"2024-04-26T12:14:42.872162+0000","last_active":"2024-04-26T12:14:46.488699+0000","last_peered":"2024-04-26T12:14:46.488699+0000","last_clean":"2024-04-26T12:14:46.488699+0000","last_became_active":"2024-04-26T12:14:42.871777+0000","last_became_peered":"2024-04-26T12:14:42.871777+0000","last_unstale":"2024-04-26T12:14:46.488699+0000","last_undegraded":"2024-04-26T12:14:46.488699+0000","last_fullsized":"2024-04-26T12:14:46.488699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488710+0000","last_change":"2024-04-26T12:14:42.530739+0000","last_active":"2024-04-26T12:14:46.488710+0000","last_peered":"2024-04-26T12:14:46.488710+0000","last_clean":"2024-04-26T12:14:46.488710+0000","last_became_active":"2024-04-26T12:14:42.530380+0000","last_became_peered":"2024-04-26T12:14:42.530380+0000","last_unstale":"2024-04-26T12:14:46.488710+0000","last_undegraded":"2024-04-26T12:14:46.488710+0000","last_fullsized":"2024-04-26T12:14:46.488710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867734+0000","last_change":"2024-04-26T12:14:42.869606+0000","last_active":"2024-04-26T12:14:43.867734+0000","last_peered":"2024-04-26T12:14:43.867734+0000","last_clean":"2024-04-26T12:14:43.867734+0000","last_became_active":"2024-04-26T12:14:42.868445+0000","last_became_peered":"2024-04-26T12:14:42.868445+0000","last_unstale":"2024-04-26T12:14:43.867734+0000","last_undegraded":"2024-04-26T12:14:43.867734+0000","last_fullsized":"2024-04-26T12:14:43.867734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867653+0000","last_change":"2024-04-26T12:14:42.529285+0000","last_active":"2024-04-26T12:14:43.867653+0000","last_peered":"2024-04-26T12:14:43.867653+0000","last_clean":"2024-04-26T12:14:43.867653+0000","last_became_active":"2024-04-26T12:14:42.528618+0000","last_became_peered":"2024-04-26T12:14:42.528618+0000","last_unstale":"2024-04-26T12:14:43.867653+0000","last_undegraded":"2024-04-26T12:14:43.867653+0000","last_fullsized":"2024-04-26T12:14:43.867653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:10.595598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868242+0000","last_change":"2024-04-26T12:14:42.870080+0000","last_active":"2024-04-26T12:14:43.868242+0000","last_peered":"2024-04-26T12:14:43.868242+0000","last_clean":"2024-04-26T12:14:43.868242+0000","last_became_active":"2024-04-26T12:14:42.867542+0000","last_became_peered":"2024-04-26T12:14:42.867542+0000","last_unstale":"2024-04-26T12:14:43.868242+0000","last_undegraded":"2024-04-26T12:14:43.868242+0000","last_fullsized":"2024-04-26T12:14:43.868242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867192+0000","last_change":"2024-04-26T12:14:42.533248+0000","last_active":"2024-04-26T12:14:43.867192+0000","last_peered":"2024-04-26T12:14:43.867192+0000","last_clean":"2024-04-26T12:14:43.867192+0000","last_became_active":"2024-04-26T12:14:42.532987+0000","last_became_peered":"2024-04-26T12:14:42.532987+0000","last_unstale":"2024-04-26T12:14:43.867192+0000","last_undegraded":"2024-04-26T12:14:43.867192+0000","last_fullsized":"2024-04-26T12:14:43.867192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:03.860297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867786+0000","last_change":"2024-04-26T12:14:42.866349+0000","last_active":"2024-04-26T12:14:43.867786+0000","last_peered":"2024-04-26T12:14:43.867786+0000","last_clean":"2024-04-26T12:14:43.867786+0000","last_became_active":"2024-04-26T12:14:42.865989+0000","last_became_peered":"2024-04-26T12:14:42.865989+0000","last_unstale":"2024-04-26T12:14:43.867786+0000","last_undegraded":"2024-04-26T12:14:43.867786+0000","last_fullsized":"2024-04-26T12:14:43.867786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488849+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488849+0000","last_peered":"2024-04-26T12:14:46.488849+0000","last_clean":"2024-04-26T12:14:46.488849+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:14:46.488849+0000","last_undegraded":"2024-04-26T12:14:46.488849+0000","last_fullsized":"2024-04-26T12:14:46.488849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862558+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:42.862558+0000","last_peered":"2024-04-26T12:14:42.862558+0000","last_clean":"2024-04-26T12:14:42.862558+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:42.862558+0000","last_undegraded":"2024-04-26T12:14:42.862558+0000","last_fullsized":"2024-04-26T12:14:42.862558+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862638+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862638+0000","last_peered":"2024-04-26T12:14:42.862638+0000","last_clean":"2024-04-26T12:14:42.862638+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:42.862638+0000","last_undegraded":"2024-04-26T12:14:42.862638+0000","last_fullsized":"2024-04-26T12:14:42.862638+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488680+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:14:46.488680+0000","last_peered":"2024-04-26T12:14:46.488680+0000","last_clean":"2024-04-26T12:14:46.488680+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:14:46.488680+0000","last_undegraded":"2024-04-26T12:14:46.488680+0000","last_fullsized":"2024-04-26T12:14:46.488680+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868139+0000","last_change":"2024-04-26T12:14:42.869728+0000","last_active":"2024-04-26T12:14:43.868139+0000","last_peered":"2024-04-26T12:14:43.868139+0000","last_clean":"2024-04-26T12:14:43.868139+0000","last_became_active":"2024-04-26T12:14:42.867567+0000","last_became_peered":"2024-04-26T12:14:42.867567+0000","last_unstale":"2024-04-26T12:14:43.868139+0000","last_undegraded":"2024-04-26T12:14:43.868139+0000","last_fullsized":"2024-04-26T12:14:43.868139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862186+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:42.862186+0000","last_peered":"2024-04-26T12:14:42.862186+0000","last_clean":"2024-04-26T12:14:42.862186+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:42.862186+0000","last_undegraded":"2024-04-26T12:14:42.862186+0000","last_fullsized":"2024-04-26T12:14:42.862186+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488639+0000","last_change":"2024-04-26T12:14:42.529005+0000","last_active":"2024-04-26T12:14:46.488639+0000","last_peered":"2024-04-26T12:14:46.488639+0000","last_clean":"2024-04-26T12:14:46.488639+0000","last_became_active":"2024-04-26T12:14:42.528648+0000","last_became_peered":"2024-04-26T12:14:42.528648+0000","last_unstale":"2024-04-26T12:14:46.488639+0000","last_undegraded":"2024-04-26T12:14:46.488639+0000","last_fullsized":"2024-04-26T12:14:46.488639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867695+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:14:43.867695+0000","last_peered":"2024-04-26T12:14:43.867695+0000","last_clean":"2024-04-26T12:14:43.867695+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:14:43.867695+0000","last_undegraded":"2024-04-26T12:14:43.867695+0000","last_fullsized":"2024-04-26T12:14:43.867695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858931+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:42.858931+0000","last_peered":"2024-04-26T12:14:42.858931+0000","last_clean":"2024-04-26T12:14:42.858931+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:42.858931+0000","last_undegraded":"2024-04-26T12:14:42.858931+0000","last_fullsized":"2024-04-26T12:14:42.858931+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866866+0000","last_change":"2024-04-26T12:14:42.534422+0000","last_active":"2024-04-26T12:14:43.866866+0000","last_peered":"2024-04-26T12:14:43.866866+0000","last_clean":"2024-04-26T12:14:43.866866+0000","last_became_active":"2024-04-26T12:14:42.534055+0000","last_became_peered":"2024-04-26T12:14:42.534055+0000","last_unstale":"2024-04-26T12:14:43.866866+0000","last_undegraded":"2024-04-26T12:14:43.866866+0000","last_fullsized":"2024-04-26T12:14:43.866866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:07.197258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488858+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:14:46.488858+0000","last_peered":"2024-04-26T12:14:46.488858+0000","last_clean":"2024-04-26T12:14:46.488858+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488858+0000","last_undegraded":"2024-04-26T12:14:46.488858+0000","last_fullsized":"2024-04-26T12:14:46.488858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862986+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862986+0000","last_peered":"2024-04-26T12:14:42.862986+0000","last_clean":"2024-04-26T12:14:42.862986+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:42.862986+0000","last_undegraded":"2024-04-26T12:14:42.862986+0000","last_fullsized":"2024-04-26T12:14:42.862986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868018+0000","last_change":"2024-04-26T12:14:42.528091+0000","last_active":"2024-04-26T12:14:43.868018+0000","last_peered":"2024-04-26T12:14:43.868018+0000","last_clean":"2024-04-26T12:14:43.868018+0000","last_became_active":"2024-04-26T12:14:42.527707+0000","last_became_peered":"2024-04-26T12:14:42.527707+0000","last_unstale":"2024-04-26T12:14:43.868018+0000","last_undegraded":"2024-04-26T12:14:43.868018+0000","last_fullsized":"2024-04-26T12:14:43.868018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488728+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:14:46.488728+0000","last_peered":"2024-04-26T12:14:46.488728+0000","last_clean":"2024-04-26T12:14:46.488728+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:14:46.488728+0000","last_undegraded":"2024-04-26T12:14:46.488728+0000","last_fullsized":"2024-04-26T12:14:46.488728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868182+0000","last_change":"2024-04-26T12:14:42.530310+0000","last_active":"2024-04-26T12:14:43.868182+0000","last_peered":"2024-04-26T12:14:43.868182+0000","last_clean":"2024-04-26T12:14:43.868182+0000","last_became_active":"2024-04-26T12:14:42.529543+0000","last_became_peered":"2024-04-26T12:14:42.529543+0000","last_unstale":"2024-04-26T12:14:43.868182+0000","last_undegraded":"2024-04-26T12:14:43.868182+0000","last_fullsized":"2024-04-26T12:14:43.868182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858590+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:42.858590+0000","last_peered":"2024-04-26T12:14:42.858590+0000","last_clean":"2024-04-26T12:14:42.858590+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:42.858590+0000","last_undegraded":"2024-04-26T12:14:42.858590+0000","last_fullsized":"2024-04-26T12:14:42.858590+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867097+0000","last_change":"2024-04-26T12:14:42.870740+0000","last_active":"2024-04-26T12:14:43.867097+0000","last_peered":"2024-04-26T12:14:43.867097+0000","last_clean":"2024-04-26T12:14:43.867097+0000","last_became_active":"2024-04-26T12:14:42.870426+0000","last_became_peered":"2024-04-26T12:14:42.870426+0000","last_unstale":"2024-04-26T12:14:43.867097+0000","last_undegraded":"2024-04-26T12:14:43.867097+0000","last_fullsized":"2024-04-26T12:14:43.867097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488738+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:14:46.488738+0000","last_peered":"2024-04-26T12:14:46.488738+0000","last_clean":"2024-04-26T12:14:46.488738+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:14:46.488738+0000","last_undegraded":"2024-04-26T12:14:46.488738+0000","last_fullsized":"2024-04-26T12:14:46.488738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859224+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:42.859224+0000","last_peered":"2024-04-26T12:14:42.859224+0000","last_clean":"2024-04-26T12:14:42.859224+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:42.859224+0000","last_undegraded":"2024-04-26T12:14:42.859224+0000","last_fullsized":"2024-04-26T12:14:42.859224+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867149+0000","last_change":"2024-04-26T12:14:42.868394+0000","last_active":"2024-04-26T12:14:43.867149+0000","last_peered":"2024-04-26T12:14:43.867149+0000","last_clean":"2024-04-26T12:14:43.867149+0000","last_became_active":"2024-04-26T12:14:42.867469+0000","last_became_peered":"2024-04-26T12:14:42.867469+0000","last_unstale":"2024-04-26T12:14:43.867149+0000","last_undegraded":"2024-04-26T12:14:43.867149+0000","last_fullsized":"2024-04-26T12:14:43.867149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488919+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:14:46.488919+0000","last_peered":"2024-04-26T12:14:46.488919+0000","last_clean":"2024-04-26T12:14:46.488919+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:14:46.488919+0000","last_undegraded":"2024-04-26T12:14:46.488919+0000","last_fullsized":"2024-04-26T12:14:46.488919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859750+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:42.859750+0000","last_peered":"2024-04-26T12:14:42.859750+0000","last_clean":"2024-04-26T12:14:42.859750+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:42.859750+0000","last_undegraded":"2024-04-26T12:14:42.859750+0000","last_fullsized":"2024-04-26T12:14:42.859750+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488546+0000","last_change":"2024-04-26T12:14:42.872140+0000","last_active":"2024-04-26T12:14:46.488546+0000","last_peered":"2024-04-26T12:14:46.488546+0000","last_clean":"2024-04-26T12:14:46.488546+0000","last_became_active":"2024-04-26T12:14:42.871667+0000","last_became_peered":"2024-04-26T12:14:42.871667+0000","last_unstale":"2024-04-26T12:14:46.488546+0000","last_undegraded":"2024-04-26T12:14:46.488546+0000","last_fullsized":"2024-04-26T12:14:46.488546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.601045+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.601045+0000","last_peered":"2024-04-26T12:14:46.601045+0000","last_clean":"2024-04-26T12:14:46.601045+0000","last_became_active":"2024-04-26T12:14:42.530054+0000","last_became_peered":"2024-04-26T12:14:42.530054+0000","last_unstale":"2024-04-26T12:14:46.601045+0000","last_undegraded":"2024-04-26T12:14:46.601045+0000","last_fullsized":"2024-04-26T12:14:46.601045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.865382+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:42.865382+0000","last_peered":"2024-04-26T12:14:42.865382+0000","last_clean":"2024-04-26T12:14:42.865382+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:42.865382+0000","last_undegraded":"2024-04-26T12:14:42.865382+0000","last_fullsized":"2024-04-26T12:14:42.865382+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866908+0000","last_change":"2024-04-26T12:14:42.866932+0000","last_active":"2024-04-26T12:14:43.866908+0000","last_peered":"2024-04-26T12:14:43.866908+0000","last_clean":"2024-04-26T12:14:43.866908+0000","last_became_active":"2024-04-26T12:14:42.866555+0000","last_became_peered":"2024-04-26T12:14:42.866555+0000","last_unstale":"2024-04-26T12:14:43.866908+0000","last_undegraded":"2024-04-26T12:14:43.866908+0000","last_fullsized":"2024-04-26T12:14:43.866908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:35.495924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867685+0000","last_change":"2024-04-26T12:14:42.867426+0000","last_active":"2024-04-26T12:14:43.867685+0000","last_peered":"2024-04-26T12:14:43.867685+0000","last_clean":"2024-04-26T12:14:43.867685+0000","last_became_active":"2024-04-26T12:14:42.866597+0000","last_became_peered":"2024-04-26T12:14:42.866597+0000","last_unstale":"2024-04-26T12:14:43.867685+0000","last_undegraded":"2024-04-26T12:14:43.867685+0000","last_fullsized":"2024-04-26T12:14:43.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867778+0000","last_change":"2024-04-26T12:14:42.528956+0000","last_active":"2024-04-26T12:14:43.867778+0000","last_peered":"2024-04-26T12:14:43.867778+0000","last_clean":"2024-04-26T12:14:43.867778+0000","last_became_active":"2024-04-26T12:14:42.528543+0000","last_became_peered":"2024-04-26T12:14:42.528543+0000","last_unstale":"2024-04-26T12:14:43.867778+0000","last_undegraded":"2024-04-26T12:14:43.867778+0000","last_fullsized":"2024-04-26T12:14:43.867778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488657+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:14:46.488657+0000","last_peered":"2024-04-26T12:14:46.488657+0000","last_clean":"2024-04-26T12:14:46.488657+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:14:46.488657+0000","last_undegraded":"2024-04-26T12:14:46.488657+0000","last_fullsized":"2024-04-26T12:14:46.488657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867876+0000","last_change":"2024-04-26T12:14:42.534326+0000","last_active":"2024-04-26T12:14:43.867876+0000","last_peered":"2024-04-26T12:14:43.867876+0000","last_clean":"2024-04-26T12:14:43.867876+0000","last_became_active":"2024-04-26T12:14:42.534008+0000","last_became_peered":"2024-04-26T12:14:42.534008+0000","last_unstale":"2024-04-26T12:14:43.867876+0000","last_undegraded":"2024-04-26T12:14:43.867876+0000","last_fullsized":"2024-04-26T12:14:43.867876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:34.796560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868039+0000","last_change":"2024-04-26T12:14:42.533769+0000","last_active":"2024-04-26T12:14:43.868039+0000","last_peered":"2024-04-26T12:14:43.868039+0000","last_clean":"2024-04-26T12:14:43.868039+0000","last_became_active":"2024-04-26T12:14:42.533439+0000","last_became_peered":"2024-04-26T12:14:42.533439+0000","last_unstale":"2024-04-26T12:14:43.868039+0000","last_undegraded":"2024-04-26T12:14:43.868039+0000","last_fullsized":"2024-04-26T12:14:43.868039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488609+0000","last_change":"2024-04-26T12:14:42.870305+0000","last_active":"2024-04-26T12:14:46.488609+0000","last_peered":"2024-04-26T12:14:46.488609+0000","last_clean":"2024-04-26T12:14:46.488609+0000","last_became_active":"2024-04-26T12:14:42.869976+0000","last_became_peered":"2024-04-26T12:14:42.869976+0000","last_unstale":"2024-04-26T12:14:46.488609+0000","last_undegraded":"2024-04-26T12:14:46.488609+0000","last_fullsized":"2024-04-26T12:14:46.488609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488896+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.488896+0000","last_peered":"2024-04-26T12:14:46.488896+0000","last_clean":"2024-04-26T12:14:46.488896+0000","last_became_active":"2024-04-26T12:14:42.529967+0000","last_became_peered":"2024-04-26T12:14:42.529967+0000","last_unstale":"2024-04-26T12:14:46.488896+0000","last_undegraded":"2024-04-26T12:14:46.488896+0000","last_fullsized":"2024-04-26T12:14:46.488896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488516+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:14:46.488516+0000","last_peered":"2024-04-26T12:14:46.488516+0000","last_clean":"2024-04-26T12:14:46.488516+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:14:46.488516+0000","last_undegraded":"2024-04-26T12:14:46.488516+0000","last_fullsized":"2024-04-26T12:14:46.488516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867835+0000","last_change":"2024-04-26T12:14:42.874343+0000","last_active":"2024-04-26T12:14:43.867835+0000","last_peered":"2024-04-26T12:14:43.867835+0000","last_clean":"2024-04-26T12:14:43.867835+0000","last_became_active":"2024-04-26T12:14:42.874067+0000","last_became_peered":"2024-04-26T12:14:42.874067+0000","last_unstale":"2024-04-26T12:14:43.867835+0000","last_undegraded":"2024-04-26T12:14:43.867835+0000","last_fullsized":"2024-04-26T12:14:43.867835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488559+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:14:46.488559+0000","last_peered":"2024-04-26T12:14:46.488559+0000","last_clean":"2024-04-26T12:14:46.488559+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:14:46.488559+0000","last_undegraded":"2024-04-26T12:14:46.488559+0000","last_fullsized":"2024-04-26T12:14:46.488559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488775+0000","last_change":"2024-04-26T12:14:42.870189+0000","last_active":"2024-04-26T12:14:46.488775+0000","last_peered":"2024-04-26T12:14:46.488775+0000","last_clean":"2024-04-26T12:14:46.488775+0000","last_became_active":"2024-04-26T12:14:42.869808+0000","last_became_peered":"2024-04-26T12:14:42.869808+0000","last_unstale":"2024-04-26T12:14:46.488775+0000","last_undegraded":"2024-04-26T12:14:46.488775+0000","last_fullsized":"2024-04-26T12:14:46.488775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488619+0000","last_change":"2024-04-26T12:14:42.530759+0000","last_active":"2024-04-26T12:14:46.488619+0000","last_peered":"2024-04-26T12:14:46.488619+0000","last_clean":"2024-04-26T12:14:46.488619+0000","last_became_active":"2024-04-26T12:14:42.530393+0000","last_became_peered":"2024-04-26T12:14:42.530393+0000","last_unstale":"2024-04-26T12:14:46.488619+0000","last_undegraded":"2024-04-26T12:14:46.488619+0000","last_fullsized":"2024-04-26T12:14:46.488619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867656+0000","last_change":"2024-04-26T12:14:42.867217+0000","last_active":"2024-04-26T12:14:43.867656+0000","last_peered":"2024-04-26T12:14:43.867656+0000","last_clean":"2024-04-26T12:14:43.867656+0000","last_became_active":"2024-04-26T12:14:42.866778+0000","last_became_peered":"2024-04-26T12:14:42.866778+0000","last_unstale":"2024-04-26T12:14:43.867656+0000","last_undegraded":"2024-04-26T12:14:43.867656+0000","last_fullsized":"2024-04-26T12:14:43.867656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867244+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:14:43.867244+0000","last_peered":"2024-04-26T12:14:43.867244+0000","last_clean":"2024-04-26T12:14:43.867244+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:14:43.867244+0000","last_undegraded":"2024-04-26T12:14:43.867244+0000","last_fullsized":"2024-04-26T12:14:43.867244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867461+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:14:43.867461+0000","last_peered":"2024-04-26T12:14:43.867461+0000","last_clean":"2024-04-26T12:14:43.867461+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:14:43.867461+0000","last_undegraded":"2024-04-26T12:14:43.867461+0000","last_fullsized":"2024-04-26T12:14:43.867461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867373+0000","last_change":"2024-04-26T12:14:42.534341+0000","last_active":"2024-04-26T12:14:43.867373+0000","last_peered":"2024-04-26T12:14:43.867373+0000","last_clean":"2024-04-26T12:14:43.867373+0000","last_became_active":"2024-04-26T12:14:42.534034+0000","last_became_peered":"2024-04-26T12:14:42.534034+0000","last_unstale":"2024-04-26T12:14:43.867373+0000","last_undegraded":"2024-04-26T12:14:43.867373+0000","last_fullsized":"2024-04-26T12:14:43.867373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:49.137895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867226+0000","last_change":"2024-04-26T12:14:42.868865+0000","last_active":"2024-04-26T12:14:43.867226+0000","last_peered":"2024-04-26T12:14:43.867226+0000","last_clean":"2024-04-26T12:14:43.867226+0000","last_became_active":"2024-04-26T12:14:42.868331+0000","last_became_peered":"2024-04-26T12:14:42.868331+0000","last_unstale":"2024-04-26T12:14:43.867226+0000","last_undegraded":"2024-04-26T12:14:43.867226+0000","last_fullsized":"2024-04-26T12:14:43.867226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:48.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867662+0000","last_change":"2024-04-26T12:14:42.530621+0000","last_active":"2024-04-26T12:14:43.867662+0000","last_peered":"2024-04-26T12:14:43.867662+0000","last_clean":"2024-04-26T12:14:43.867662+0000","last_became_active":"2024-04-26T12:14:42.529635+0000","last_became_peered":"2024-04-26T12:14:42.529635+0000","last_unstale":"2024-04-26T12:14:43.867662+0000","last_undegraded":"2024-04-26T12:14:43.867662+0000","last_fullsized":"2024-04-26T12:14:43.867662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.073389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867450+0000","last_change":"2024-04-26T12:14:42.867354+0000","last_active":"2024-04-26T12:14:43.867450+0000","last_peered":"2024-04-26T12:14:43.867450+0000","last_clean":"2024-04-26T12:14:43.867450+0000","last_became_active":"2024-04-26T12:14:42.866550+0000","last_became_peered":"2024-04-26T12:14:42.866550+0000","last_unstale":"2024-04-26T12:14:43.867450+0000","last_undegraded":"2024-04-26T12:14:43.867450+0000","last_fullsized":"2024-04-26T12:14:43.867450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867761+0000","last_change":"2024-04-26T12:14:42.533661+0000","last_active":"2024-04-26T12:14:43.867761+0000","last_peered":"2024-04-26T12:14:43.867761+0000","last_clean":"2024-04-26T12:14:43.867761+0000","last_became_active":"2024-04-26T12:14:42.533454+0000","last_became_peered":"2024-04-26T12:14:42.533454+0000","last_unstale":"2024-04-26T12:14:43.867761+0000","last_undegraded":"2024-04-26T12:14:43.867761+0000","last_fullsized":"2024-04-26T12:14:43.867761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:06.330845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867306+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:14:43.867306+0000","last_peered":"2024-04-26T12:14:43.867306+0000","last_clean":"2024-04-26T12:14:43.867306+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:14:43.867306+0000","last_undegraded":"2024-04-26T12:14:43.867306+0000","last_fullsized":"2024-04-26T12:14:43.867306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488786+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:14:46.488786+0000","last_peered":"2024-04-26T12:14:46.488786+0000","last_clean":"2024-04-26T12:14:46.488786+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:14:46.488786+0000","last_undegraded":"2024-04-26T12:14:46.488786+0000","last_fullsized":"2024-04-26T12:14:46.488786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867425+0000","last_change":"2024-04-26T12:14:42.869979+0000","last_active":"2024-04-26T12:14:43.867425+0000","last_peered":"2024-04-26T12:14:43.867425+0000","last_clean":"2024-04-26T12:14:43.867425+0000","last_became_active":"2024-04-26T12:14:42.868687+0000","last_became_peered":"2024-04-26T12:14:42.868687+0000","last_unstale":"2024-04-26T12:14:43.867425+0000","last_undegraded":"2024-04-26T12:14:43.867425+0000","last_fullsized":"2024-04-26T12:14:43.867425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488886+0000","last_change":"2024-04-26T12:14:42.534167+0000","last_active":"2024-04-26T12:14:46.488886+0000","last_peered":"2024-04-26T12:14:46.488886+0000","last_clean":"2024-04-26T12:14:46.488886+0000","last_became_active":"2024-04-26T12:14:42.533826+0000","last_became_peered":"2024-04-26T12:14:42.533826+0000","last_unstale":"2024-04-26T12:14:46.488886+0000","last_undegraded":"2024-04-26T12:14:46.488886+0000","last_fullsized":"2024-04-26T12:14:46.488886+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35348,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336492,"statfs":{"total":96636764160,"available":96600567808,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:53.954 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:14:53.954 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:14:53.955 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:14:53.955 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:14:54.299 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:54.299 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:14:54.312 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:14:54.312 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:54.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:54.592 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:43.852134+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:54.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:14:36.451914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:14:36.730304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:14:41.002412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:14:41.827946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:14:54.606 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:14:54.889 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-26T12:14:54.901 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:14:55.178 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2024-04-26T12:14:55.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:14:55.466 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-26T12:14:55.479 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:14:55.762 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-26T12:14:55.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:14:56.083 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:56.084 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:14:42.847976+0000","modified":"2024-04-26T12:14:44.858997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6803/2901824101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":2901824101},{"type":"v1","addr":"172.21.15.69:6803","nonce":2901824101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:14:56.084 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-04-26T12:14:56.097 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:56.373 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:43.852134+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:56.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:14:36.451914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:14:36.730304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:14:41.002412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:14:41.827946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:14:56.386 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:14:56.667 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-26T12:14:56.679 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:14:56.960 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2024-04-26T12:14:56.973 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:14:57.250 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-26T12:14:57.263 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:14:57.542 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-26T12:14:57.556 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:14:57.870 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:57.870 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:14:42.847976+0000","modified":"2024-04-26T12:14:44.858997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6803/2901824101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":2901824101},{"type":"v1","addr":"172.21.15.69:6803","nonce":2901824101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:14:57.870 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-04-26T12:14:57.883 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:14:58.161 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:58.161 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:14:43.852134+0000","last_up_change":"2024-04-26T12:14:36.211532+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":28559},{"type":"v1","addr":"172.21.15.113:6801","nonce":28559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":28559},{"type":"v1","addr":"172.21.15.113:6803","nonce":28559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":28559},{"type":"v1","addr":"172.21.15.113:6807","nonce":28559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":28559},{"type":"v1","addr":"172.21.15.113:6805","nonce":28559}]},"public_addr":"172.21.15.113:6801/28559","cluster_addr":"172.21.15.113:6803/28559","heartbeat_back_addr":"172.21.15.113:6807/28559","heartbeat_front_addr":"172.21.15.113:6805/28559","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:14:58.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:14:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:14:58.486 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:14:42.847976+0000","modified":"2024-04-26T12:14:44.858997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6803/2901824101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":2901824101},{"type":"v1","addr":"172.21.15.69:6803","nonce":2901824101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:14:58.486 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-04-26T12:14:58.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T12:14:42.847976+0000', 'modified': '2024-04-26T12:14:44.858997+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4186': {'gid': 4186, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.69:6803/2901824101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6802', 'nonce': 2901824101}, {'type': 'v1', 'addr': '172.21.15.69:6803', 'nonce': 2901824101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T12:14:58.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T12:14:58.600 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T12:14:58.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-26T12:14:58.708+0000 7fb8ad7fa640 0 client.4620 ms_handle_reset on v2:172.21.15.69:6802/2901824101 2024-04-26T12:14:58.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-26T12:14:58.727+0000 7fb8ad7fa640 0 client.4499 ms_handle_reset on v2:172.21.15.69:6802/2901824101 2024-04-26T12:14:58.727 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-26T12:14:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "38aaef92-b73b-4053-b2f0-6b2ea75fb544", 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4186, 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 15.874645481, 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 5, 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 15, 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 15, 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 20.412613465 2024-04-26T12:14:58.728 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-26T12:14:58.739 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T12:14:58.750 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T12:14:58.750 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T12:14:58.750 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T12:14:58.750 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T12:14:58.751 DEBUG:teuthology.orchestra.run.smithi069:> sync 2024-04-26T12:14:58.875 DEBUG:teuthology.orchestra.run.smithi070:> sync 2024-04-26T12:14:59.039 DEBUG:teuthology.orchestra.run.smithi113:> sync 2024-04-26T12:14:59.184 DEBUG:teuthology.orchestra.run.smithi172:> sync 2024-04-26T12:14:59.334 DEBUG:tasks.thrashosds:checking console status of smithi069 2024-04-26T12:14:59.334 DEBUG:teuthology.orchestra.console.smithi069:Waiting for login prompt 2024-04-26T12:14:59.334 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi069 2024-04-26T12:14:59.437 DEBUG:teuthology.orchestra.console.smithi069:expect before: [Enter `^Ec?' for help] 2024-04-26T12:14:59.437 DEBUG:teuthology.orchestra.console.smithi069:expect after: smithi069 login: 2024-04-26T12:14:59.489 DEBUG:teuthology.orchestra.console.smithi069:console disconnect output: [Enter `^Ec?' for help] smithi069 login: [disconnect] 2024-04-26T12:14:59.591 DEBUG:tasks.thrashosds:checking console status of smithi070 2024-04-26T12:14:59.591 DEBUG:teuthology.orchestra.console.smithi070:Waiting for login prompt 2024-04-26T12:14:59.591 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi070 2024-04-26T12:14:59.667 DEBUG:teuthology.orchestra.console.smithi070:expect before: [Enter `^Ec?' for help] 2024-04-26T12:14:59.668 DEBUG:teuthology.orchestra.console.smithi070:expect after: smithi070 login: 2024-04-26T12:14:59.720 DEBUG:teuthology.orchestra.console.smithi070:console disconnect output: [Enter `^Ec?' for help] smithi070 login: [disconnect] 2024-04-26T12:14:59.821 DEBUG:tasks.thrashosds:checking console status of smithi113 2024-04-26T12:14:59.821 DEBUG:teuthology.orchestra.console.smithi113:Waiting for login prompt 2024-04-26T12:14:59.821 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi113 2024-04-26T12:14:59.905 DEBUG:teuthology.orchestra.console.smithi113:expect before: [Enter `^Ec?' for help] 2024-04-26T12:14:59.905 DEBUG:teuthology.orchestra.console.smithi113:expect after: smithi113 login: 2024-04-26T12:14:59.957 DEBUG:teuthology.orchestra.console.smithi113:console disconnect output: [Enter `^Ec?' for help] smithi113 login: [disconnect] 2024-04-26T12:15:00.058 DEBUG:tasks.thrashosds:checking console status of smithi172 2024-04-26T12:15:00.058 DEBUG:teuthology.orchestra.console.smithi172:Waiting for login prompt 2024-04-26T12:15:00.058 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi172 2024-04-26T12:15:00.182 DEBUG:teuthology.orchestra.console.smithi172:expect before: [Enter `^Ec?' for help] 2024-04-26T12:15:00.182 DEBUG:teuthology.orchestra.console.smithi172:expect after: smithi172 login: 2024-04-26T12:15:00.234 DEBUG:teuthology.orchestra.console.smithi172:console disconnect output: [Enter `^Ec?' for help] smithi172 login: [disconnect] 2024-04-26T12:15:00.335 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T12:15:00.649 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T12:15:00.649 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:15:00.650 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:15:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:15:00.934 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:15:00.942 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T12:15:00.427524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94972,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020548,"statfs":{"total":289910292480,"available":289813041152,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002435"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867707+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:14:43.867707+0000","last_peered":"2024-04-26T12:14:43.867707+0000","last_clean":"2024-04-26T12:14:43.867707+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:14:43.867707+0000","last_undegraded":"2024-04-26T12:14:43.867707+0000","last_fullsized":"2024-04-26T12:14:43.867707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867546+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:14:43.867546+0000","last_peered":"2024-04-26T12:14:43.867546+0000","last_clean":"2024-04-26T12:14:43.867546+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:14:43.867546+0000","last_undegraded":"2024-04-26T12:14:43.867546+0000","last_fullsized":"2024-04-26T12:14:43.867546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867948+0000","last_change":"2024-04-26T12:14:42.872215+0000","last_active":"2024-04-26T12:14:43.867948+0000","last_peered":"2024-04-26T12:14:43.867948+0000","last_clean":"2024-04-26T12:14:43.867948+0000","last_became_active":"2024-04-26T12:14:42.871084+0000","last_became_peered":"2024-04-26T12:14:42.871084+0000","last_unstale":"2024-04-26T12:14:43.867948+0000","last_undegraded":"2024-04-26T12:14:43.867948+0000","last_fullsized":"2024-04-26T12:14:43.867948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:54.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867375+0000","last_change":"2024-04-26T12:14:42.869954+0000","last_active":"2024-04-26T12:14:43.867375+0000","last_peered":"2024-04-26T12:14:43.867375+0000","last_clean":"2024-04-26T12:14:43.867375+0000","last_became_active":"2024-04-26T12:14:42.869262+0000","last_became_peered":"2024-04-26T12:14:42.869262+0000","last_unstale":"2024-04-26T12:14:43.867375+0000","last_undegraded":"2024-04-26T12:14:43.867375+0000","last_fullsized":"2024-04-26T12:14:43.867375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:41.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867412+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:14:43.867412+0000","last_peered":"2024-04-26T12:14:43.867412+0000","last_clean":"2024-04-26T12:14:43.867412+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:14:43.867412+0000","last_undegraded":"2024-04-26T12:14:43.867412+0000","last_fullsized":"2024-04-26T12:14:43.867412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867032+0000","last_change":"2024-04-26T12:14:42.870198+0000","last_active":"2024-04-26T12:14:43.867032+0000","last_peered":"2024-04-26T12:14:43.867032+0000","last_clean":"2024-04-26T12:14:43.867032+0000","last_became_active":"2024-04-26T12:14:42.869783+0000","last_became_peered":"2024-04-26T12:14:42.869783+0000","last_unstale":"2024-04-26T12:14:43.867032+0000","last_undegraded":"2024-04-26T12:14:43.867032+0000","last_fullsized":"2024-04-26T12:14:43.867032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:03.272719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867135+0000","last_change":"2024-04-26T12:14:42.867620+0000","last_active":"2024-04-26T12:14:43.867135+0000","last_peered":"2024-04-26T12:14:43.867135+0000","last_clean":"2024-04-26T12:14:43.867135+0000","last_became_active":"2024-04-26T12:14:42.866727+0000","last_became_peered":"2024-04-26T12:14:42.866727+0000","last_unstale":"2024-04-26T12:14:43.867135+0000","last_undegraded":"2024-04-26T12:14:43.867135+0000","last_fullsized":"2024-04-26T12:14:43.867135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866936+0000","last_change":"2024-04-26T12:14:42.871957+0000","last_active":"2024-04-26T12:14:43.866936+0000","last_peered":"2024-04-26T12:14:43.866936+0000","last_clean":"2024-04-26T12:14:43.866936+0000","last_became_active":"2024-04-26T12:14:42.870987+0000","last_became_peered":"2024-04-26T12:14:42.870987+0000","last_unstale":"2024-04-26T12:14:43.866936+0000","last_undegraded":"2024-04-26T12:14:43.866936+0000","last_fullsized":"2024-04-26T12:14:43.866936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.657803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488830+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:14:46.488830+0000","last_peered":"2024-04-26T12:14:46.488830+0000","last_clean":"2024-04-26T12:14:46.488830+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:14:46.488830+0000","last_undegraded":"2024-04-26T12:14:46.488830+0000","last_fullsized":"2024-04-26T12:14:46.488830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867722+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:14:43.867722+0000","last_peered":"2024-04-26T12:14:43.867722+0000","last_clean":"2024-04-26T12:14:43.867722+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:14:43.867722+0000","last_undegraded":"2024-04-26T12:14:43.867722+0000","last_fullsized":"2024-04-26T12:14:43.867722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867635+0000","last_change":"2024-04-26T12:14:42.870737+0000","last_active":"2024-04-26T12:14:43.867635+0000","last_peered":"2024-04-26T12:14:43.867635+0000","last_clean":"2024-04-26T12:14:43.867635+0000","last_became_active":"2024-04-26T12:14:42.870218+0000","last_became_peered":"2024-04-26T12:14:42.870218+0000","last_unstale":"2024-04-26T12:14:43.867635+0000","last_undegraded":"2024-04-26T12:14:43.867635+0000","last_fullsized":"2024-04-26T12:14:43.867635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:47.108520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867459+0000","last_change":"2024-04-26T12:14:42.870694+0000","last_active":"2024-04-26T12:14:43.867459+0000","last_peered":"2024-04-26T12:14:43.867459+0000","last_clean":"2024-04-26T12:14:43.867459+0000","last_became_active":"2024-04-26T12:14:42.870325+0000","last_became_peered":"2024-04-26T12:14:42.870325+0000","last_unstale":"2024-04-26T12:14:43.867459+0000","last_undegraded":"2024-04-26T12:14:43.867459+0000","last_fullsized":"2024-04-26T12:14:43.867459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867047+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:14:43.867047+0000","last_peered":"2024-04-26T12:14:43.867047+0000","last_clean":"2024-04-26T12:14:43.867047+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:14:43.867047+0000","last_undegraded":"2024-04-26T12:14:43.867047+0000","last_fullsized":"2024-04-26T12:14:43.867047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867184+0000","last_change":"2024-04-26T12:14:42.868400+0000","last_active":"2024-04-26T12:14:43.867184+0000","last_peered":"2024-04-26T12:14:43.867184+0000","last_clean":"2024-04-26T12:14:43.867184+0000","last_became_active":"2024-04-26T12:14:42.867646+0000","last_became_peered":"2024-04-26T12:14:42.867646+0000","last_unstale":"2024-04-26T12:14:43.867184+0000","last_undegraded":"2024-04-26T12:14:43.867184+0000","last_fullsized":"2024-04-26T12:14:43.867184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867236+0000","last_change":"2024-04-26T12:14:42.867157+0000","last_active":"2024-04-26T12:14:43.867236+0000","last_peered":"2024-04-26T12:14:43.867236+0000","last_clean":"2024-04-26T12:14:43.867236+0000","last_became_active":"2024-04-26T12:14:42.865840+0000","last_became_peered":"2024-04-26T12:14:42.865840+0000","last_unstale":"2024-04-26T12:14:43.867236+0000","last_undegraded":"2024-04-26T12:14:43.867236+0000","last_fullsized":"2024-04-26T12:14:43.867236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866901+0000","last_change":"2024-04-26T12:14:42.871915+0000","last_active":"2024-04-26T12:14:43.866901+0000","last_peered":"2024-04-26T12:14:43.866901+0000","last_clean":"2024-04-26T12:14:43.866901+0000","last_became_active":"2024-04-26T12:14:42.870604+0000","last_became_peered":"2024-04-26T12:14:42.870604+0000","last_unstale":"2024-04-26T12:14:43.866901+0000","last_undegraded":"2024-04-26T12:14:43.866901+0000","last_fullsized":"2024-04-26T12:14:43.866901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488910+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:14:46.488910+0000","last_peered":"2024-04-26T12:14:46.488910+0000","last_clean":"2024-04-26T12:14:46.488910+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488910+0000","last_undegraded":"2024-04-26T12:14:46.488910+0000","last_fullsized":"2024-04-26T12:14:46.488910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867812+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:14:43.867812+0000","last_peered":"2024-04-26T12:14:43.867812+0000","last_clean":"2024-04-26T12:14:43.867812+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:14:43.867812+0000","last_undegraded":"2024-04-26T12:14:43.867812+0000","last_fullsized":"2024-04-26T12:14:43.867812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488755+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:14:46.488755+0000","last_peered":"2024-04-26T12:14:46.488755+0000","last_clean":"2024-04-26T12:14:46.488755+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:14:46.488755+0000","last_undegraded":"2024-04-26T12:14:46.488755+0000","last_fullsized":"2024-04-26T12:14:46.488755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867547+0000","last_change":"2024-04-26T12:14:42.869830+0000","last_active":"2024-04-26T12:14:43.867547+0000","last_peered":"2024-04-26T12:14:43.867547+0000","last_clean":"2024-04-26T12:14:43.867547+0000","last_became_active":"2024-04-26T12:14:42.869225+0000","last_became_peered":"2024-04-26T12:14:42.869225+0000","last_unstale":"2024-04-26T12:14:43.867547+0000","last_undegraded":"2024-04-26T12:14:43.867547+0000","last_fullsized":"2024-04-26T12:14:43.867547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:53.111870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867710+0000","last_change":"2024-04-26T12:14:42.868630+0000","last_active":"2024-04-26T12:14:43.867710+0000","last_peered":"2024-04-26T12:14:43.867710+0000","last_clean":"2024-04-26T12:14:43.867710+0000","last_became_active":"2024-04-26T12:14:42.867548+0000","last_became_peered":"2024-04-26T12:14:42.867548+0000","last_unstale":"2024-04-26T12:14:43.867710+0000","last_undegraded":"2024-04-26T12:14:43.867710+0000","last_fullsized":"2024-04-26T12:14:43.867710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866911+0000","last_change":"2024-04-26T12:14:42.870882+0000","last_active":"2024-04-26T12:14:43.866911+0000","last_peered":"2024-04-26T12:14:43.866911+0000","last_clean":"2024-04-26T12:14:43.866911+0000","last_became_active":"2024-04-26T12:14:42.870623+0000","last_became_peered":"2024-04-26T12:14:42.870623+0000","last_unstale":"2024-04-26T12:14:43.866911+0000","last_undegraded":"2024-04-26T12:14:43.866911+0000","last_fullsized":"2024-04-26T12:14:43.866911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488588+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488588+0000","last_peered":"2024-04-26T12:14:46.488588+0000","last_clean":"2024-04-26T12:14:46.488588+0000","last_became_active":"2024-04-26T12:14:42.867223+0000","last_became_peered":"2024-04-26T12:14:42.867223+0000","last_unstale":"2024-04-26T12:14:46.488588+0000","last_undegraded":"2024-04-26T12:14:46.488588+0000","last_fullsized":"2024-04-26T12:14:46.488588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866690+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:14:43.866690+0000","last_peered":"2024-04-26T12:14:43.866690+0000","last_clean":"2024-04-26T12:14:43.866690+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:14:43.866690+0000","last_undegraded":"2024-04-26T12:14:43.866690+0000","last_fullsized":"2024-04-26T12:14:43.866690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867693+0000","last_change":"2024-04-26T12:14:42.874005+0000","last_active":"2024-04-26T12:14:43.867693+0000","last_peered":"2024-04-26T12:14:43.867693+0000","last_clean":"2024-04-26T12:14:43.867693+0000","last_became_active":"2024-04-26T12:14:42.873631+0000","last_became_peered":"2024-04-26T12:14:42.873631+0000","last_unstale":"2024-04-26T12:14:43.867693+0000","last_undegraded":"2024-04-26T12:14:43.867693+0000","last_fullsized":"2024-04-26T12:14:43.867693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488765+0000","last_change":"2024-04-26T12:14:42.873571+0000","last_active":"2024-04-26T12:14:46.488765+0000","last_peered":"2024-04-26T12:14:46.488765+0000","last_clean":"2024-04-26T12:14:46.488765+0000","last_became_active":"2024-04-26T12:14:42.873286+0000","last_became_peered":"2024-04-26T12:14:42.873286+0000","last_unstale":"2024-04-26T12:14:46.488765+0000","last_undegraded":"2024-04-26T12:14:46.488765+0000","last_fullsized":"2024-04-26T12:14:46.488765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868004+0000","last_change":"2024-04-26T12:14:42.870555+0000","last_active":"2024-04-26T12:14:43.868004+0000","last_peered":"2024-04-26T12:14:43.868004+0000","last_clean":"2024-04-26T12:14:43.868004+0000","last_became_active":"2024-04-26T12:14:42.869400+0000","last_became_peered":"2024-04-26T12:14:42.869400+0000","last_unstale":"2024-04-26T12:14:43.868004+0000","last_undegraded":"2024-04-26T12:14:43.868004+0000","last_fullsized":"2024-04-26T12:14:43.868004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:23.492068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867621+0000","last_change":"2024-04-26T12:14:42.874272+0000","last_active":"2024-04-26T12:14:43.867621+0000","last_peered":"2024-04-26T12:14:43.867621+0000","last_clean":"2024-04-26T12:14:43.867621+0000","last_became_active":"2024-04-26T12:14:42.873934+0000","last_became_peered":"2024-04-26T12:14:42.873934+0000","last_unstale":"2024-04-26T12:14:43.867621+0000","last_undegraded":"2024-04-26T12:14:43.867621+0000","last_fullsized":"2024-04-26T12:14:43.867621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:05.149736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488690+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:14:46.488690+0000","last_peered":"2024-04-26T12:14:46.488690+0000","last_clean":"2024-04-26T12:14:46.488690+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:14:46.488690+0000","last_undegraded":"2024-04-26T12:14:46.488690+0000","last_fullsized":"2024-04-26T12:14:46.488690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867101+0000","last_change":"2024-04-26T12:14:42.867054+0000","last_active":"2024-04-26T12:14:43.867101+0000","last_peered":"2024-04-26T12:14:43.867101+0000","last_clean":"2024-04-26T12:14:43.867101+0000","last_became_active":"2024-04-26T12:14:42.866676+0000","last_became_peered":"2024-04-26T12:14:42.866676+0000","last_unstale":"2024-04-26T12:14:43.867101+0000","last_undegraded":"2024-04-26T12:14:43.867101+0000","last_fullsized":"2024-04-26T12:14:43.867101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488599+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:14:46.488599+0000","last_peered":"2024-04-26T12:14:46.488599+0000","last_clean":"2024-04-26T12:14:46.488599+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:14:46.488599+0000","last_undegraded":"2024-04-26T12:14:46.488599+0000","last_fullsized":"2024-04-26T12:14:46.488599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867023+0000","last_change":"2024-04-26T12:14:42.871222+0000","last_active":"2024-04-26T12:14:43.867023+0000","last_peered":"2024-04-26T12:14:43.867023+0000","last_clean":"2024-04-26T12:14:43.867023+0000","last_became_active":"2024-04-26T12:14:42.870454+0000","last_became_peered":"2024-04-26T12:14:42.870454+0000","last_unstale":"2024-04-26T12:14:43.867023+0000","last_undegraded":"2024-04-26T12:14:43.867023+0000","last_fullsized":"2024-04-26T12:14:43.867023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867584+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:14:43.867584+0000","last_peered":"2024-04-26T12:14:43.867584+0000","last_clean":"2024-04-26T12:14:43.867584+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:14:43.867584+0000","last_undegraded":"2024-04-26T12:14:43.867584+0000","last_fullsized":"2024-04-26T12:14:43.867584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867972+0000","last_change":"2024-04-26T12:14:42.527996+0000","last_active":"2024-04-26T12:14:43.867972+0000","last_peered":"2024-04-26T12:14:43.867972+0000","last_clean":"2024-04-26T12:14:43.867972+0000","last_became_active":"2024-04-26T12:14:42.527615+0000","last_became_peered":"2024-04-26T12:14:42.527615+0000","last_unstale":"2024-04-26T12:14:43.867972+0000","last_undegraded":"2024-04-26T12:14:43.867972+0000","last_fullsized":"2024-04-26T12:14:43.867972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867703+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:14:43.867703+0000","last_peered":"2024-04-26T12:14:43.867703+0000","last_clean":"2024-04-26T12:14:43.867703+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:14:43.867703+0000","last_undegraded":"2024-04-26T12:14:43.867703+0000","last_fullsized":"2024-04-26T12:14:43.867703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488669+0000","last_change":"2024-04-26T12:14:42.529666+0000","last_active":"2024-04-26T12:14:46.488669+0000","last_peered":"2024-04-26T12:14:46.488669+0000","last_clean":"2024-04-26T12:14:46.488669+0000","last_became_active":"2024-04-26T12:14:42.529366+0000","last_became_peered":"2024-04-26T12:14:42.529366+0000","last_unstale":"2024-04-26T12:14:46.488669+0000","last_undegraded":"2024-04-26T12:14:46.488669+0000","last_fullsized":"2024-04-26T12:14:46.488669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488798+0000","last_change":"2024-04-26T12:14:42.873577+0000","last_active":"2024-04-26T12:14:46.488798+0000","last_peered":"2024-04-26T12:14:46.488798+0000","last_clean":"2024-04-26T12:14:46.488798+0000","last_became_active":"2024-04-26T12:14:42.873183+0000","last_became_peered":"2024-04-26T12:14:42.873183+0000","last_unstale":"2024-04-26T12:14:46.488798+0000","last_undegraded":"2024-04-26T12:14:46.488798+0000","last_fullsized":"2024-04-26T12:14:46.488798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867161+0000","last_change":"2024-04-26T12:14:42.533710+0000","last_active":"2024-04-26T12:14:43.867161+0000","last_peered":"2024-04-26T12:14:43.867161+0000","last_clean":"2024-04-26T12:14:43.867161+0000","last_became_active":"2024-04-26T12:14:42.533436+0000","last_became_peered":"2024-04-26T12:14:42.533436+0000","last_unstale":"2024-04-26T12:14:43.867161+0000","last_undegraded":"2024-04-26T12:14:43.867161+0000","last_fullsized":"2024-04-26T12:14:43.867161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488840+0000","last_change":"2024-04-26T12:14:42.871019+0000","last_active":"2024-04-26T12:14:46.488840+0000","last_peered":"2024-04-26T12:14:46.488840+0000","last_clean":"2024-04-26T12:14:46.488840+0000","last_became_active":"2024-04-26T12:14:42.870630+0000","last_became_peered":"2024-04-26T12:14:42.870630+0000","last_unstale":"2024-04-26T12:14:46.488840+0000","last_undegraded":"2024-04-26T12:14:46.488840+0000","last_fullsized":"2024-04-26T12:14:46.488840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867164+0000","last_change":"2024-04-26T12:14:42.533517+0000","last_active":"2024-04-26T12:14:43.867164+0000","last_peered":"2024-04-26T12:14:43.867164+0000","last_clean":"2024-04-26T12:14:43.867164+0000","last_became_active":"2024-04-26T12:14:42.532693+0000","last_became_peered":"2024-04-26T12:14:42.532693+0000","last_unstale":"2024-04-26T12:14:43.867164+0000","last_undegraded":"2024-04-26T12:14:43.867164+0000","last_fullsized":"2024-04-26T12:14:43.867164+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868125+0000","last_change":"2024-04-26T12:14:42.532602+0000","last_active":"2024-04-26T12:14:43.868125+0000","last_peered":"2024-04-26T12:14:43.868125+0000","last_clean":"2024-04-26T12:14:43.868125+0000","last_became_active":"2024-04-26T12:14:42.531944+0000","last_became_peered":"2024-04-26T12:14:42.531944+0000","last_unstale":"2024-04-26T12:14:43.868125+0000","last_undegraded":"2024-04-26T12:14:43.868125+0000","last_fullsized":"2024-04-26T12:14:43.868125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866726+0000","last_change":"2024-04-26T12:14:42.871236+0000","last_active":"2024-04-26T12:14:43.866726+0000","last_peered":"2024-04-26T12:14:43.866726+0000","last_clean":"2024-04-26T12:14:43.866726+0000","last_became_active":"2024-04-26T12:14:42.871041+0000","last_became_peered":"2024-04-26T12:14:42.871041+0000","last_unstale":"2024-04-26T12:14:43.866726+0000","last_undegraded":"2024-04-26T12:14:43.866726+0000","last_fullsized":"2024-04-26T12:14:43.866726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:26.643464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867860+0000","last_change":"2024-04-26T12:14:42.534442+0000","last_active":"2024-04-26T12:14:43.867860+0000","last_peered":"2024-04-26T12:14:43.867860+0000","last_clean":"2024-04-26T12:14:43.867860+0000","last_became_active":"2024-04-26T12:14:42.534150+0000","last_became_peered":"2024-04-26T12:14:42.534150+0000","last_unstale":"2024-04-26T12:14:43.867860+0000","last_undegraded":"2024-04-26T12:14:43.867860+0000","last_fullsized":"2024-04-26T12:14:43.867860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:37.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868126+0000","last_change":"2024-04-26T12:14:42.530595+0000","last_active":"2024-04-26T12:14:43.868126+0000","last_peered":"2024-04-26T12:14:43.868126+0000","last_clean":"2024-04-26T12:14:43.868126+0000","last_became_active":"2024-04-26T12:14:42.529757+0000","last_became_peered":"2024-04-26T12:14:42.529757+0000","last_unstale":"2024-04-26T12:14:43.868126+0000","last_undegraded":"2024-04-26T12:14:43.868126+0000","last_fullsized":"2024-04-26T12:14:43.868126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867296+0000","last_change":"2024-04-26T12:14:42.869311+0000","last_active":"2024-04-26T12:14:43.867296+0000","last_peered":"2024-04-26T12:14:43.867296+0000","last_clean":"2024-04-26T12:14:43.867296+0000","last_became_active":"2024-04-26T12:14:42.868477+0000","last_became_peered":"2024-04-26T12:14:42.868477+0000","last_unstale":"2024-04-26T12:14:43.867296+0000","last_undegraded":"2024-04-26T12:14:43.867296+0000","last_fullsized":"2024-04-26T12:14:43.867296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867818+0000","last_change":"2024-04-26T12:14:42.528134+0000","last_active":"2024-04-26T12:14:43.867818+0000","last_peered":"2024-04-26T12:14:43.867818+0000","last_clean":"2024-04-26T12:14:43.867818+0000","last_became_active":"2024-04-26T12:14:42.527701+0000","last_became_peered":"2024-04-26T12:14:42.527701+0000","last_unstale":"2024-04-26T12:14:43.867818+0000","last_undegraded":"2024-04-26T12:14:43.867818+0000","last_fullsized":"2024-04-26T12:14:43.867818+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488699+0000","last_change":"2024-04-26T12:14:42.872162+0000","last_active":"2024-04-26T12:14:46.488699+0000","last_peered":"2024-04-26T12:14:46.488699+0000","last_clean":"2024-04-26T12:14:46.488699+0000","last_became_active":"2024-04-26T12:14:42.871777+0000","last_became_peered":"2024-04-26T12:14:42.871777+0000","last_unstale":"2024-04-26T12:14:46.488699+0000","last_undegraded":"2024-04-26T12:14:46.488699+0000","last_fullsized":"2024-04-26T12:14:46.488699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488710+0000","last_change":"2024-04-26T12:14:42.530739+0000","last_active":"2024-04-26T12:14:46.488710+0000","last_peered":"2024-04-26T12:14:46.488710+0000","last_clean":"2024-04-26T12:14:46.488710+0000","last_became_active":"2024-04-26T12:14:42.530380+0000","last_became_peered":"2024-04-26T12:14:42.530380+0000","last_unstale":"2024-04-26T12:14:46.488710+0000","last_undegraded":"2024-04-26T12:14:46.488710+0000","last_fullsized":"2024-04-26T12:14:46.488710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867734+0000","last_change":"2024-04-26T12:14:42.869606+0000","last_active":"2024-04-26T12:14:43.867734+0000","last_peered":"2024-04-26T12:14:43.867734+0000","last_clean":"2024-04-26T12:14:43.867734+0000","last_became_active":"2024-04-26T12:14:42.868445+0000","last_became_peered":"2024-04-26T12:14:42.868445+0000","last_unstale":"2024-04-26T12:14:43.867734+0000","last_undegraded":"2024-04-26T12:14:43.867734+0000","last_fullsized":"2024-04-26T12:14:43.867734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867653+0000","last_change":"2024-04-26T12:14:42.529285+0000","last_active":"2024-04-26T12:14:43.867653+0000","last_peered":"2024-04-26T12:14:43.867653+0000","last_clean":"2024-04-26T12:14:43.867653+0000","last_became_active":"2024-04-26T12:14:42.528618+0000","last_became_peered":"2024-04-26T12:14:42.528618+0000","last_unstale":"2024-04-26T12:14:43.867653+0000","last_undegraded":"2024-04-26T12:14:43.867653+0000","last_fullsized":"2024-04-26T12:14:43.867653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:10.595598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868242+0000","last_change":"2024-04-26T12:14:42.870080+0000","last_active":"2024-04-26T12:14:43.868242+0000","last_peered":"2024-04-26T12:14:43.868242+0000","last_clean":"2024-04-26T12:14:43.868242+0000","last_became_active":"2024-04-26T12:14:42.867542+0000","last_became_peered":"2024-04-26T12:14:42.867542+0000","last_unstale":"2024-04-26T12:14:43.868242+0000","last_undegraded":"2024-04-26T12:14:43.868242+0000","last_fullsized":"2024-04-26T12:14:43.868242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867192+0000","last_change":"2024-04-26T12:14:42.533248+0000","last_active":"2024-04-26T12:14:43.867192+0000","last_peered":"2024-04-26T12:14:43.867192+0000","last_clean":"2024-04-26T12:14:43.867192+0000","last_became_active":"2024-04-26T12:14:42.532987+0000","last_became_peered":"2024-04-26T12:14:42.532987+0000","last_unstale":"2024-04-26T12:14:43.867192+0000","last_undegraded":"2024-04-26T12:14:43.867192+0000","last_fullsized":"2024-04-26T12:14:43.867192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:03.860297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867786+0000","last_change":"2024-04-26T12:14:42.866349+0000","last_active":"2024-04-26T12:14:43.867786+0000","last_peered":"2024-04-26T12:14:43.867786+0000","last_clean":"2024-04-26T12:14:43.867786+0000","last_became_active":"2024-04-26T12:14:42.865989+0000","last_became_peered":"2024-04-26T12:14:42.865989+0000","last_unstale":"2024-04-26T12:14:43.867786+0000","last_undegraded":"2024-04-26T12:14:43.867786+0000","last_fullsized":"2024-04-26T12:14:43.867786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488849+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488849+0000","last_peered":"2024-04-26T12:14:46.488849+0000","last_clean":"2024-04-26T12:14:46.488849+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:14:46.488849+0000","last_undegraded":"2024-04-26T12:14:46.488849+0000","last_fullsized":"2024-04-26T12:14:46.488849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862558+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:42.862558+0000","last_peered":"2024-04-26T12:14:42.862558+0000","last_clean":"2024-04-26T12:14:42.862558+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:42.862558+0000","last_undegraded":"2024-04-26T12:14:42.862558+0000","last_fullsized":"2024-04-26T12:14:42.862558+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862638+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862638+0000","last_peered":"2024-04-26T12:14:42.862638+0000","last_clean":"2024-04-26T12:14:42.862638+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:42.862638+0000","last_undegraded":"2024-04-26T12:14:42.862638+0000","last_fullsized":"2024-04-26T12:14:42.862638+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488680+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:14:46.488680+0000","last_peered":"2024-04-26T12:14:46.488680+0000","last_clean":"2024-04-26T12:14:46.488680+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:14:46.488680+0000","last_undegraded":"2024-04-26T12:14:46.488680+0000","last_fullsized":"2024-04-26T12:14:46.488680+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868139+0000","last_change":"2024-04-26T12:14:42.869728+0000","last_active":"2024-04-26T12:14:43.868139+0000","last_peered":"2024-04-26T12:14:43.868139+0000","last_clean":"2024-04-26T12:14:43.868139+0000","last_became_active":"2024-04-26T12:14:42.867567+0000","last_became_peered":"2024-04-26T12:14:42.867567+0000","last_unstale":"2024-04-26T12:14:43.868139+0000","last_undegraded":"2024-04-26T12:14:43.868139+0000","last_fullsized":"2024-04-26T12:14:43.868139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862186+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:42.862186+0000","last_peered":"2024-04-26T12:14:42.862186+0000","last_clean":"2024-04-26T12:14:42.862186+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:42.862186+0000","last_undegraded":"2024-04-26T12:14:42.862186+0000","last_fullsized":"2024-04-26T12:14:42.862186+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488639+0000","last_change":"2024-04-26T12:14:42.529005+0000","last_active":"2024-04-26T12:14:46.488639+0000","last_peered":"2024-04-26T12:14:46.488639+0000","last_clean":"2024-04-26T12:14:46.488639+0000","last_became_active":"2024-04-26T12:14:42.528648+0000","last_became_peered":"2024-04-26T12:14:42.528648+0000","last_unstale":"2024-04-26T12:14:46.488639+0000","last_undegraded":"2024-04-26T12:14:46.488639+0000","last_fullsized":"2024-04-26T12:14:46.488639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867695+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:14:43.867695+0000","last_peered":"2024-04-26T12:14:43.867695+0000","last_clean":"2024-04-26T12:14:43.867695+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:14:43.867695+0000","last_undegraded":"2024-04-26T12:14:43.867695+0000","last_fullsized":"2024-04-26T12:14:43.867695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858931+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:42.858931+0000","last_peered":"2024-04-26T12:14:42.858931+0000","last_clean":"2024-04-26T12:14:42.858931+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:42.858931+0000","last_undegraded":"2024-04-26T12:14:42.858931+0000","last_fullsized":"2024-04-26T12:14:42.858931+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866866+0000","last_change":"2024-04-26T12:14:42.534422+0000","last_active":"2024-04-26T12:14:43.866866+0000","last_peered":"2024-04-26T12:14:43.866866+0000","last_clean":"2024-04-26T12:14:43.866866+0000","last_became_active":"2024-04-26T12:14:42.534055+0000","last_became_peered":"2024-04-26T12:14:42.534055+0000","last_unstale":"2024-04-26T12:14:43.866866+0000","last_undegraded":"2024-04-26T12:14:43.866866+0000","last_fullsized":"2024-04-26T12:14:43.866866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:07.197258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488858+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:14:46.488858+0000","last_peered":"2024-04-26T12:14:46.488858+0000","last_clean":"2024-04-26T12:14:46.488858+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488858+0000","last_undegraded":"2024-04-26T12:14:46.488858+0000","last_fullsized":"2024-04-26T12:14:46.488858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862986+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862986+0000","last_peered":"2024-04-26T12:14:42.862986+0000","last_clean":"2024-04-26T12:14:42.862986+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:42.862986+0000","last_undegraded":"2024-04-26T12:14:42.862986+0000","last_fullsized":"2024-04-26T12:14:42.862986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868018+0000","last_change":"2024-04-26T12:14:42.528091+0000","last_active":"2024-04-26T12:14:43.868018+0000","last_peered":"2024-04-26T12:14:43.868018+0000","last_clean":"2024-04-26T12:14:43.868018+0000","last_became_active":"2024-04-26T12:14:42.527707+0000","last_became_peered":"2024-04-26T12:14:42.527707+0000","last_unstale":"2024-04-26T12:14:43.868018+0000","last_undegraded":"2024-04-26T12:14:43.868018+0000","last_fullsized":"2024-04-26T12:14:43.868018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488728+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:14:46.488728+0000","last_peered":"2024-04-26T12:14:46.488728+0000","last_clean":"2024-04-26T12:14:46.488728+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:14:46.488728+0000","last_undegraded":"2024-04-26T12:14:46.488728+0000","last_fullsized":"2024-04-26T12:14:46.488728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868182+0000","last_change":"2024-04-26T12:14:42.530310+0000","last_active":"2024-04-26T12:14:43.868182+0000","last_peered":"2024-04-26T12:14:43.868182+0000","last_clean":"2024-04-26T12:14:43.868182+0000","last_became_active":"2024-04-26T12:14:42.529543+0000","last_became_peered":"2024-04-26T12:14:42.529543+0000","last_unstale":"2024-04-26T12:14:43.868182+0000","last_undegraded":"2024-04-26T12:14:43.868182+0000","last_fullsized":"2024-04-26T12:14:43.868182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858590+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:42.858590+0000","last_peered":"2024-04-26T12:14:42.858590+0000","last_clean":"2024-04-26T12:14:42.858590+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:42.858590+0000","last_undegraded":"2024-04-26T12:14:42.858590+0000","last_fullsized":"2024-04-26T12:14:42.858590+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867097+0000","last_change":"2024-04-26T12:14:42.870740+0000","last_active":"2024-04-26T12:14:43.867097+0000","last_peered":"2024-04-26T12:14:43.867097+0000","last_clean":"2024-04-26T12:14:43.867097+0000","last_became_active":"2024-04-26T12:14:42.870426+0000","last_became_peered":"2024-04-26T12:14:42.870426+0000","last_unstale":"2024-04-26T12:14:43.867097+0000","last_undegraded":"2024-04-26T12:14:43.867097+0000","last_fullsized":"2024-04-26T12:14:43.867097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488738+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:14:46.488738+0000","last_peered":"2024-04-26T12:14:46.488738+0000","last_clean":"2024-04-26T12:14:46.488738+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:14:46.488738+0000","last_undegraded":"2024-04-26T12:14:46.488738+0000","last_fullsized":"2024-04-26T12:14:46.488738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859224+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:42.859224+0000","last_peered":"2024-04-26T12:14:42.859224+0000","last_clean":"2024-04-26T12:14:42.859224+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:42.859224+0000","last_undegraded":"2024-04-26T12:14:42.859224+0000","last_fullsized":"2024-04-26T12:14:42.859224+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867149+0000","last_change":"2024-04-26T12:14:42.868394+0000","last_active":"2024-04-26T12:14:43.867149+0000","last_peered":"2024-04-26T12:14:43.867149+0000","last_clean":"2024-04-26T12:14:43.867149+0000","last_became_active":"2024-04-26T12:14:42.867469+0000","last_became_peered":"2024-04-26T12:14:42.867469+0000","last_unstale":"2024-04-26T12:14:43.867149+0000","last_undegraded":"2024-04-26T12:14:43.867149+0000","last_fullsized":"2024-04-26T12:14:43.867149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488919+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:14:46.488919+0000","last_peered":"2024-04-26T12:14:46.488919+0000","last_clean":"2024-04-26T12:14:46.488919+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:14:46.488919+0000","last_undegraded":"2024-04-26T12:14:46.488919+0000","last_fullsized":"2024-04-26T12:14:46.488919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859750+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:42.859750+0000","last_peered":"2024-04-26T12:14:42.859750+0000","last_clean":"2024-04-26T12:14:42.859750+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:42.859750+0000","last_undegraded":"2024-04-26T12:14:42.859750+0000","last_fullsized":"2024-04-26T12:14:42.859750+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488546+0000","last_change":"2024-04-26T12:14:42.872140+0000","last_active":"2024-04-26T12:14:46.488546+0000","last_peered":"2024-04-26T12:14:46.488546+0000","last_clean":"2024-04-26T12:14:46.488546+0000","last_became_active":"2024-04-26T12:14:42.871667+0000","last_became_peered":"2024-04-26T12:14:42.871667+0000","last_unstale":"2024-04-26T12:14:46.488546+0000","last_undegraded":"2024-04-26T12:14:46.488546+0000","last_fullsized":"2024-04-26T12:14:46.488546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.601045+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.601045+0000","last_peered":"2024-04-26T12:14:46.601045+0000","last_clean":"2024-04-26T12:14:46.601045+0000","last_became_active":"2024-04-26T12:14:42.530054+0000","last_became_peered":"2024-04-26T12:14:42.530054+0000","last_unstale":"2024-04-26T12:14:46.601045+0000","last_undegraded":"2024-04-26T12:14:46.601045+0000","last_fullsized":"2024-04-26T12:14:46.601045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.865382+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:42.865382+0000","last_peered":"2024-04-26T12:14:42.865382+0000","last_clean":"2024-04-26T12:14:42.865382+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:42.865382+0000","last_undegraded":"2024-04-26T12:14:42.865382+0000","last_fullsized":"2024-04-26T12:14:42.865382+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866908+0000","last_change":"2024-04-26T12:14:42.866932+0000","last_active":"2024-04-26T12:14:43.866908+0000","last_peered":"2024-04-26T12:14:43.866908+0000","last_clean":"2024-04-26T12:14:43.866908+0000","last_became_active":"2024-04-26T12:14:42.866555+0000","last_became_peered":"2024-04-26T12:14:42.866555+0000","last_unstale":"2024-04-26T12:14:43.866908+0000","last_undegraded":"2024-04-26T12:14:43.866908+0000","last_fullsized":"2024-04-26T12:14:43.866908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:35.495924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867685+0000","last_change":"2024-04-26T12:14:42.867426+0000","last_active":"2024-04-26T12:14:43.867685+0000","last_peered":"2024-04-26T12:14:43.867685+0000","last_clean":"2024-04-26T12:14:43.867685+0000","last_became_active":"2024-04-26T12:14:42.866597+0000","last_became_peered":"2024-04-26T12:14:42.866597+0000","last_unstale":"2024-04-26T12:14:43.867685+0000","last_undegraded":"2024-04-26T12:14:43.867685+0000","last_fullsized":"2024-04-26T12:14:43.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867778+0000","last_change":"2024-04-26T12:14:42.528956+0000","last_active":"2024-04-26T12:14:43.867778+0000","last_peered":"2024-04-26T12:14:43.867778+0000","last_clean":"2024-04-26T12:14:43.867778+0000","last_became_active":"2024-04-26T12:14:42.528543+0000","last_became_peered":"2024-04-26T12:14:42.528543+0000","last_unstale":"2024-04-26T12:14:43.867778+0000","last_undegraded":"2024-04-26T12:14:43.867778+0000","last_fullsized":"2024-04-26T12:14:43.867778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488657+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:14:46.488657+0000","last_peered":"2024-04-26T12:14:46.488657+0000","last_clean":"2024-04-26T12:14:46.488657+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:14:46.488657+0000","last_undegraded":"2024-04-26T12:14:46.488657+0000","last_fullsized":"2024-04-26T12:14:46.488657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867876+0000","last_change":"2024-04-26T12:14:42.534326+0000","last_active":"2024-04-26T12:14:43.867876+0000","last_peered":"2024-04-26T12:14:43.867876+0000","last_clean":"2024-04-26T12:14:43.867876+0000","last_became_active":"2024-04-26T12:14:42.534008+0000","last_became_peered":"2024-04-26T12:14:42.534008+0000","last_unstale":"2024-04-26T12:14:43.867876+0000","last_undegraded":"2024-04-26T12:14:43.867876+0000","last_fullsized":"2024-04-26T12:14:43.867876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:34.796560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868039+0000","last_change":"2024-04-26T12:14:42.533769+0000","last_active":"2024-04-26T12:14:43.868039+0000","last_peered":"2024-04-26T12:14:43.868039+0000","last_clean":"2024-04-26T12:14:43.868039+0000","last_became_active":"2024-04-26T12:14:42.533439+0000","last_became_peered":"2024-04-26T12:14:42.533439+0000","last_unstale":"2024-04-26T12:14:43.868039+0000","last_undegraded":"2024-04-26T12:14:43.868039+0000","last_fullsized":"2024-04-26T12:14:43.868039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488609+0000","last_change":"2024-04-26T12:14:42.870305+0000","last_active":"2024-04-26T12:14:46.488609+0000","last_peered":"2024-04-26T12:14:46.488609+0000","last_clean":"2024-04-26T12:14:46.488609+0000","last_became_active":"2024-04-26T12:14:42.869976+0000","last_became_peered":"2024-04-26T12:14:42.869976+0000","last_unstale":"2024-04-26T12:14:46.488609+0000","last_undegraded":"2024-04-26T12:14:46.488609+0000","last_fullsized":"2024-04-26T12:14:46.488609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488896+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.488896+0000","last_peered":"2024-04-26T12:14:46.488896+0000","last_clean":"2024-04-26T12:14:46.488896+0000","last_became_active":"2024-04-26T12:14:42.529967+0000","last_became_peered":"2024-04-26T12:14:42.529967+0000","last_unstale":"2024-04-26T12:14:46.488896+0000","last_undegraded":"2024-04-26T12:14:46.488896+0000","last_fullsized":"2024-04-26T12:14:46.488896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488516+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:14:46.488516+0000","last_peered":"2024-04-26T12:14:46.488516+0000","last_clean":"2024-04-26T12:14:46.488516+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:14:46.488516+0000","last_undegraded":"2024-04-26T12:14:46.488516+0000","last_fullsized":"2024-04-26T12:14:46.488516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867835+0000","last_change":"2024-04-26T12:14:42.874343+0000","last_active":"2024-04-26T12:14:43.867835+0000","last_peered":"2024-04-26T12:14:43.867835+0000","last_clean":"2024-04-26T12:14:43.867835+0000","last_became_active":"2024-04-26T12:14:42.874067+0000","last_became_peered":"2024-04-26T12:14:42.874067+0000","last_unstale":"2024-04-26T12:14:43.867835+0000","last_undegraded":"2024-04-26T12:14:43.867835+0000","last_fullsized":"2024-04-26T12:14:43.867835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488559+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:14:46.488559+0000","last_peered":"2024-04-26T12:14:46.488559+0000","last_clean":"2024-04-26T12:14:46.488559+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:14:46.488559+0000","last_undegraded":"2024-04-26T12:14:46.488559+0000","last_fullsized":"2024-04-26T12:14:46.488559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488775+0000","last_change":"2024-04-26T12:14:42.870189+0000","last_active":"2024-04-26T12:14:46.488775+0000","last_peered":"2024-04-26T12:14:46.488775+0000","last_clean":"2024-04-26T12:14:46.488775+0000","last_became_active":"2024-04-26T12:14:42.869808+0000","last_became_peered":"2024-04-26T12:14:42.869808+0000","last_unstale":"2024-04-26T12:14:46.488775+0000","last_undegraded":"2024-04-26T12:14:46.488775+0000","last_fullsized":"2024-04-26T12:14:46.488775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488619+0000","last_change":"2024-04-26T12:14:42.530759+0000","last_active":"2024-04-26T12:14:46.488619+0000","last_peered":"2024-04-26T12:14:46.488619+0000","last_clean":"2024-04-26T12:14:46.488619+0000","last_became_active":"2024-04-26T12:14:42.530393+0000","last_became_peered":"2024-04-26T12:14:42.530393+0000","last_unstale":"2024-04-26T12:14:46.488619+0000","last_undegraded":"2024-04-26T12:14:46.488619+0000","last_fullsized":"2024-04-26T12:14:46.488619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867656+0000","last_change":"2024-04-26T12:14:42.867217+0000","last_active":"2024-04-26T12:14:43.867656+0000","last_peered":"2024-04-26T12:14:43.867656+0000","last_clean":"2024-04-26T12:14:43.867656+0000","last_became_active":"2024-04-26T12:14:42.866778+0000","last_became_peered":"2024-04-26T12:14:42.866778+0000","last_unstale":"2024-04-26T12:14:43.867656+0000","last_undegraded":"2024-04-26T12:14:43.867656+0000","last_fullsized":"2024-04-26T12:14:43.867656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867244+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:14:43.867244+0000","last_peered":"2024-04-26T12:14:43.867244+0000","last_clean":"2024-04-26T12:14:43.867244+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:14:43.867244+0000","last_undegraded":"2024-04-26T12:14:43.867244+0000","last_fullsized":"2024-04-26T12:14:43.867244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867461+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:14:43.867461+0000","last_peered":"2024-04-26T12:14:43.867461+0000","last_clean":"2024-04-26T12:14:43.867461+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:14:43.867461+0000","last_undegraded":"2024-04-26T12:14:43.867461+0000","last_fullsized":"2024-04-26T12:14:43.867461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867373+0000","last_change":"2024-04-26T12:14:42.534341+0000","last_active":"2024-04-26T12:14:43.867373+0000","last_peered":"2024-04-26T12:14:43.867373+0000","last_clean":"2024-04-26T12:14:43.867373+0000","last_became_active":"2024-04-26T12:14:42.534034+0000","last_became_peered":"2024-04-26T12:14:42.534034+0000","last_unstale":"2024-04-26T12:14:43.867373+0000","last_undegraded":"2024-04-26T12:14:43.867373+0000","last_fullsized":"2024-04-26T12:14:43.867373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:49.137895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867226+0000","last_change":"2024-04-26T12:14:42.868865+0000","last_active":"2024-04-26T12:14:43.867226+0000","last_peered":"2024-04-26T12:14:43.867226+0000","last_clean":"2024-04-26T12:14:43.867226+0000","last_became_active":"2024-04-26T12:14:42.868331+0000","last_became_peered":"2024-04-26T12:14:42.868331+0000","last_unstale":"2024-04-26T12:14:43.867226+0000","last_undegraded":"2024-04-26T12:14:43.867226+0000","last_fullsized":"2024-04-26T12:14:43.867226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:48.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867662+0000","last_change":"2024-04-26T12:14:42.530621+0000","last_active":"2024-04-26T12:14:43.867662+0000","last_peered":"2024-04-26T12:14:43.867662+0000","last_clean":"2024-04-26T12:14:43.867662+0000","last_became_active":"2024-04-26T12:14:42.529635+0000","last_became_peered":"2024-04-26T12:14:42.529635+0000","last_unstale":"2024-04-26T12:14:43.867662+0000","last_undegraded":"2024-04-26T12:14:43.867662+0000","last_fullsized":"2024-04-26T12:14:43.867662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.073389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867450+0000","last_change":"2024-04-26T12:14:42.867354+0000","last_active":"2024-04-26T12:14:43.867450+0000","last_peered":"2024-04-26T12:14:43.867450+0000","last_clean":"2024-04-26T12:14:43.867450+0000","last_became_active":"2024-04-26T12:14:42.866550+0000","last_became_peered":"2024-04-26T12:14:42.866550+0000","last_unstale":"2024-04-26T12:14:43.867450+0000","last_undegraded":"2024-04-26T12:14:43.867450+0000","last_fullsized":"2024-04-26T12:14:43.867450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867761+0000","last_change":"2024-04-26T12:14:42.533661+0000","last_active":"2024-04-26T12:14:43.867761+0000","last_peered":"2024-04-26T12:14:43.867761+0000","last_clean":"2024-04-26T12:14:43.867761+0000","last_became_active":"2024-04-26T12:14:42.533454+0000","last_became_peered":"2024-04-26T12:14:42.533454+0000","last_unstale":"2024-04-26T12:14:43.867761+0000","last_undegraded":"2024-04-26T12:14:43.867761+0000","last_fullsized":"2024-04-26T12:14:43.867761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:06.330845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867306+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:14:43.867306+0000","last_peered":"2024-04-26T12:14:43.867306+0000","last_clean":"2024-04-26T12:14:43.867306+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:14:43.867306+0000","last_undegraded":"2024-04-26T12:14:43.867306+0000","last_fullsized":"2024-04-26T12:14:43.867306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488786+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:14:46.488786+0000","last_peered":"2024-04-26T12:14:46.488786+0000","last_clean":"2024-04-26T12:14:46.488786+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:14:46.488786+0000","last_undegraded":"2024-04-26T12:14:46.488786+0000","last_fullsized":"2024-04-26T12:14:46.488786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867425+0000","last_change":"2024-04-26T12:14:42.869979+0000","last_active":"2024-04-26T12:14:43.867425+0000","last_peered":"2024-04-26T12:14:43.867425+0000","last_clean":"2024-04-26T12:14:43.867425+0000","last_became_active":"2024-04-26T12:14:42.868687+0000","last_became_peered":"2024-04-26T12:14:42.868687+0000","last_unstale":"2024-04-26T12:14:43.867425+0000","last_undegraded":"2024-04-26T12:14:43.867425+0000","last_fullsized":"2024-04-26T12:14:43.867425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488886+0000","last_change":"2024-04-26T12:14:42.534167+0000","last_active":"2024-04-26T12:14:46.488886+0000","last_peered":"2024-04-26T12:14:46.488886+0000","last_clean":"2024-04-26T12:14:46.488886+0000","last_became_active":"2024-04-26T12:14:42.533826+0000","last_became_peered":"2024-04-26T12:14:42.533826+0000","last_unstale":"2024-04-26T12:14:46.488886+0000","last_undegraded":"2024-04-26T12:14:46.488886+0000","last_fullsized":"2024-04-26T12:14:46.488886+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35348,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336492,"statfs":{"total":96636764160,"available":96600567808,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:15:00.948 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:15:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:15:01.269 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:15:01.279 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T12:15:00.427524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94972,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020548,"statfs":{"total":289910292480,"available":289813041152,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002435"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867707+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:14:43.867707+0000","last_peered":"2024-04-26T12:14:43.867707+0000","last_clean":"2024-04-26T12:14:43.867707+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:14:43.867707+0000","last_undegraded":"2024-04-26T12:14:43.867707+0000","last_fullsized":"2024-04-26T12:14:43.867707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867546+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:14:43.867546+0000","last_peered":"2024-04-26T12:14:43.867546+0000","last_clean":"2024-04-26T12:14:43.867546+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:14:43.867546+0000","last_undegraded":"2024-04-26T12:14:43.867546+0000","last_fullsized":"2024-04-26T12:14:43.867546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867948+0000","last_change":"2024-04-26T12:14:42.872215+0000","last_active":"2024-04-26T12:14:43.867948+0000","last_peered":"2024-04-26T12:14:43.867948+0000","last_clean":"2024-04-26T12:14:43.867948+0000","last_became_active":"2024-04-26T12:14:42.871084+0000","last_became_peered":"2024-04-26T12:14:42.871084+0000","last_unstale":"2024-04-26T12:14:43.867948+0000","last_undegraded":"2024-04-26T12:14:43.867948+0000","last_fullsized":"2024-04-26T12:14:43.867948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:54.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867375+0000","last_change":"2024-04-26T12:14:42.869954+0000","last_active":"2024-04-26T12:14:43.867375+0000","last_peered":"2024-04-26T12:14:43.867375+0000","last_clean":"2024-04-26T12:14:43.867375+0000","last_became_active":"2024-04-26T12:14:42.869262+0000","last_became_peered":"2024-04-26T12:14:42.869262+0000","last_unstale":"2024-04-26T12:14:43.867375+0000","last_undegraded":"2024-04-26T12:14:43.867375+0000","last_fullsized":"2024-04-26T12:14:43.867375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:41.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867412+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:14:43.867412+0000","last_peered":"2024-04-26T12:14:43.867412+0000","last_clean":"2024-04-26T12:14:43.867412+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:14:43.867412+0000","last_undegraded":"2024-04-26T12:14:43.867412+0000","last_fullsized":"2024-04-26T12:14:43.867412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867032+0000","last_change":"2024-04-26T12:14:42.870198+0000","last_active":"2024-04-26T12:14:43.867032+0000","last_peered":"2024-04-26T12:14:43.867032+0000","last_clean":"2024-04-26T12:14:43.867032+0000","last_became_active":"2024-04-26T12:14:42.869783+0000","last_became_peered":"2024-04-26T12:14:42.869783+0000","last_unstale":"2024-04-26T12:14:43.867032+0000","last_undegraded":"2024-04-26T12:14:43.867032+0000","last_fullsized":"2024-04-26T12:14:43.867032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:03.272719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867135+0000","last_change":"2024-04-26T12:14:42.867620+0000","last_active":"2024-04-26T12:14:43.867135+0000","last_peered":"2024-04-26T12:14:43.867135+0000","last_clean":"2024-04-26T12:14:43.867135+0000","last_became_active":"2024-04-26T12:14:42.866727+0000","last_became_peered":"2024-04-26T12:14:42.866727+0000","last_unstale":"2024-04-26T12:14:43.867135+0000","last_undegraded":"2024-04-26T12:14:43.867135+0000","last_fullsized":"2024-04-26T12:14:43.867135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866936+0000","last_change":"2024-04-26T12:14:42.871957+0000","last_active":"2024-04-26T12:14:43.866936+0000","last_peered":"2024-04-26T12:14:43.866936+0000","last_clean":"2024-04-26T12:14:43.866936+0000","last_became_active":"2024-04-26T12:14:42.870987+0000","last_became_peered":"2024-04-26T12:14:42.870987+0000","last_unstale":"2024-04-26T12:14:43.866936+0000","last_undegraded":"2024-04-26T12:14:43.866936+0000","last_fullsized":"2024-04-26T12:14:43.866936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.657803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488830+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:14:46.488830+0000","last_peered":"2024-04-26T12:14:46.488830+0000","last_clean":"2024-04-26T12:14:46.488830+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:14:46.488830+0000","last_undegraded":"2024-04-26T12:14:46.488830+0000","last_fullsized":"2024-04-26T12:14:46.488830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867722+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:14:43.867722+0000","last_peered":"2024-04-26T12:14:43.867722+0000","last_clean":"2024-04-26T12:14:43.867722+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:14:43.867722+0000","last_undegraded":"2024-04-26T12:14:43.867722+0000","last_fullsized":"2024-04-26T12:14:43.867722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867635+0000","last_change":"2024-04-26T12:14:42.870737+0000","last_active":"2024-04-26T12:14:43.867635+0000","last_peered":"2024-04-26T12:14:43.867635+0000","last_clean":"2024-04-26T12:14:43.867635+0000","last_became_active":"2024-04-26T12:14:42.870218+0000","last_became_peered":"2024-04-26T12:14:42.870218+0000","last_unstale":"2024-04-26T12:14:43.867635+0000","last_undegraded":"2024-04-26T12:14:43.867635+0000","last_fullsized":"2024-04-26T12:14:43.867635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:47.108520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867459+0000","last_change":"2024-04-26T12:14:42.870694+0000","last_active":"2024-04-26T12:14:43.867459+0000","last_peered":"2024-04-26T12:14:43.867459+0000","last_clean":"2024-04-26T12:14:43.867459+0000","last_became_active":"2024-04-26T12:14:42.870325+0000","last_became_peered":"2024-04-26T12:14:42.870325+0000","last_unstale":"2024-04-26T12:14:43.867459+0000","last_undegraded":"2024-04-26T12:14:43.867459+0000","last_fullsized":"2024-04-26T12:14:43.867459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867047+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:14:43.867047+0000","last_peered":"2024-04-26T12:14:43.867047+0000","last_clean":"2024-04-26T12:14:43.867047+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:14:43.867047+0000","last_undegraded":"2024-04-26T12:14:43.867047+0000","last_fullsized":"2024-04-26T12:14:43.867047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867184+0000","last_change":"2024-04-26T12:14:42.868400+0000","last_active":"2024-04-26T12:14:43.867184+0000","last_peered":"2024-04-26T12:14:43.867184+0000","last_clean":"2024-04-26T12:14:43.867184+0000","last_became_active":"2024-04-26T12:14:42.867646+0000","last_became_peered":"2024-04-26T12:14:42.867646+0000","last_unstale":"2024-04-26T12:14:43.867184+0000","last_undegraded":"2024-04-26T12:14:43.867184+0000","last_fullsized":"2024-04-26T12:14:43.867184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867236+0000","last_change":"2024-04-26T12:14:42.867157+0000","last_active":"2024-04-26T12:14:43.867236+0000","last_peered":"2024-04-26T12:14:43.867236+0000","last_clean":"2024-04-26T12:14:43.867236+0000","last_became_active":"2024-04-26T12:14:42.865840+0000","last_became_peered":"2024-04-26T12:14:42.865840+0000","last_unstale":"2024-04-26T12:14:43.867236+0000","last_undegraded":"2024-04-26T12:14:43.867236+0000","last_fullsized":"2024-04-26T12:14:43.867236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866901+0000","last_change":"2024-04-26T12:14:42.871915+0000","last_active":"2024-04-26T12:14:43.866901+0000","last_peered":"2024-04-26T12:14:43.866901+0000","last_clean":"2024-04-26T12:14:43.866901+0000","last_became_active":"2024-04-26T12:14:42.870604+0000","last_became_peered":"2024-04-26T12:14:42.870604+0000","last_unstale":"2024-04-26T12:14:43.866901+0000","last_undegraded":"2024-04-26T12:14:43.866901+0000","last_fullsized":"2024-04-26T12:14:43.866901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:44.695787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488910+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:14:46.488910+0000","last_peered":"2024-04-26T12:14:46.488910+0000","last_clean":"2024-04-26T12:14:46.488910+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488910+0000","last_undegraded":"2024-04-26T12:14:46.488910+0000","last_fullsized":"2024-04-26T12:14:46.488910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867812+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:14:43.867812+0000","last_peered":"2024-04-26T12:14:43.867812+0000","last_clean":"2024-04-26T12:14:43.867812+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:14:43.867812+0000","last_undegraded":"2024-04-26T12:14:43.867812+0000","last_fullsized":"2024-04-26T12:14:43.867812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488755+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:14:46.488755+0000","last_peered":"2024-04-26T12:14:46.488755+0000","last_clean":"2024-04-26T12:14:46.488755+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:14:46.488755+0000","last_undegraded":"2024-04-26T12:14:46.488755+0000","last_fullsized":"2024-04-26T12:14:46.488755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867547+0000","last_change":"2024-04-26T12:14:42.869830+0000","last_active":"2024-04-26T12:14:43.867547+0000","last_peered":"2024-04-26T12:14:43.867547+0000","last_clean":"2024-04-26T12:14:43.867547+0000","last_became_active":"2024-04-26T12:14:42.869225+0000","last_became_peered":"2024-04-26T12:14:42.869225+0000","last_unstale":"2024-04-26T12:14:43.867547+0000","last_undegraded":"2024-04-26T12:14:43.867547+0000","last_fullsized":"2024-04-26T12:14:43.867547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:53.111870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867710+0000","last_change":"2024-04-26T12:14:42.868630+0000","last_active":"2024-04-26T12:14:43.867710+0000","last_peered":"2024-04-26T12:14:43.867710+0000","last_clean":"2024-04-26T12:14:43.867710+0000","last_became_active":"2024-04-26T12:14:42.867548+0000","last_became_peered":"2024-04-26T12:14:42.867548+0000","last_unstale":"2024-04-26T12:14:43.867710+0000","last_undegraded":"2024-04-26T12:14:43.867710+0000","last_fullsized":"2024-04-26T12:14:43.867710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866911+0000","last_change":"2024-04-26T12:14:42.870882+0000","last_active":"2024-04-26T12:14:43.866911+0000","last_peered":"2024-04-26T12:14:43.866911+0000","last_clean":"2024-04-26T12:14:43.866911+0000","last_became_active":"2024-04-26T12:14:42.870623+0000","last_became_peered":"2024-04-26T12:14:42.870623+0000","last_unstale":"2024-04-26T12:14:43.866911+0000","last_undegraded":"2024-04-26T12:14:43.866911+0000","last_fullsized":"2024-04-26T12:14:43.866911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:28.991884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488588+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488588+0000","last_peered":"2024-04-26T12:14:46.488588+0000","last_clean":"2024-04-26T12:14:46.488588+0000","last_became_active":"2024-04-26T12:14:42.867223+0000","last_became_peered":"2024-04-26T12:14:42.867223+0000","last_unstale":"2024-04-26T12:14:46.488588+0000","last_undegraded":"2024-04-26T12:14:46.488588+0000","last_fullsized":"2024-04-26T12:14:46.488588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866690+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:14:43.866690+0000","last_peered":"2024-04-26T12:14:43.866690+0000","last_clean":"2024-04-26T12:14:43.866690+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:14:43.866690+0000","last_undegraded":"2024-04-26T12:14:43.866690+0000","last_fullsized":"2024-04-26T12:14:43.866690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867693+0000","last_change":"2024-04-26T12:14:42.874005+0000","last_active":"2024-04-26T12:14:43.867693+0000","last_peered":"2024-04-26T12:14:43.867693+0000","last_clean":"2024-04-26T12:14:43.867693+0000","last_became_active":"2024-04-26T12:14:42.873631+0000","last_became_peered":"2024-04-26T12:14:42.873631+0000","last_unstale":"2024-04-26T12:14:43.867693+0000","last_undegraded":"2024-04-26T12:14:43.867693+0000","last_fullsized":"2024-04-26T12:14:43.867693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488765+0000","last_change":"2024-04-26T12:14:42.873571+0000","last_active":"2024-04-26T12:14:46.488765+0000","last_peered":"2024-04-26T12:14:46.488765+0000","last_clean":"2024-04-26T12:14:46.488765+0000","last_became_active":"2024-04-26T12:14:42.873286+0000","last_became_peered":"2024-04-26T12:14:42.873286+0000","last_unstale":"2024-04-26T12:14:46.488765+0000","last_undegraded":"2024-04-26T12:14:46.488765+0000","last_fullsized":"2024-04-26T12:14:46.488765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868004+0000","last_change":"2024-04-26T12:14:42.870555+0000","last_active":"2024-04-26T12:14:43.868004+0000","last_peered":"2024-04-26T12:14:43.868004+0000","last_clean":"2024-04-26T12:14:43.868004+0000","last_became_active":"2024-04-26T12:14:42.869400+0000","last_became_peered":"2024-04-26T12:14:42.869400+0000","last_unstale":"2024-04-26T12:14:43.868004+0000","last_undegraded":"2024-04-26T12:14:43.868004+0000","last_fullsized":"2024-04-26T12:14:43.868004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:23.492068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867621+0000","last_change":"2024-04-26T12:14:42.874272+0000","last_active":"2024-04-26T12:14:43.867621+0000","last_peered":"2024-04-26T12:14:43.867621+0000","last_clean":"2024-04-26T12:14:43.867621+0000","last_became_active":"2024-04-26T12:14:42.873934+0000","last_became_peered":"2024-04-26T12:14:42.873934+0000","last_unstale":"2024-04-26T12:14:43.867621+0000","last_undegraded":"2024-04-26T12:14:43.867621+0000","last_fullsized":"2024-04-26T12:14:43.867621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:05.149736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488690+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:14:46.488690+0000","last_peered":"2024-04-26T12:14:46.488690+0000","last_clean":"2024-04-26T12:14:46.488690+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:14:46.488690+0000","last_undegraded":"2024-04-26T12:14:46.488690+0000","last_fullsized":"2024-04-26T12:14:46.488690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867101+0000","last_change":"2024-04-26T12:14:42.867054+0000","last_active":"2024-04-26T12:14:43.867101+0000","last_peered":"2024-04-26T12:14:43.867101+0000","last_clean":"2024-04-26T12:14:43.867101+0000","last_became_active":"2024-04-26T12:14:42.866676+0000","last_became_peered":"2024-04-26T12:14:42.866676+0000","last_unstale":"2024-04-26T12:14:43.867101+0000","last_undegraded":"2024-04-26T12:14:43.867101+0000","last_fullsized":"2024-04-26T12:14:43.867101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488599+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:14:46.488599+0000","last_peered":"2024-04-26T12:14:46.488599+0000","last_clean":"2024-04-26T12:14:46.488599+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:14:46.488599+0000","last_undegraded":"2024-04-26T12:14:46.488599+0000","last_fullsized":"2024-04-26T12:14:46.488599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867023+0000","last_change":"2024-04-26T12:14:42.871222+0000","last_active":"2024-04-26T12:14:43.867023+0000","last_peered":"2024-04-26T12:14:43.867023+0000","last_clean":"2024-04-26T12:14:43.867023+0000","last_became_active":"2024-04-26T12:14:42.870454+0000","last_became_peered":"2024-04-26T12:14:42.870454+0000","last_unstale":"2024-04-26T12:14:43.867023+0000","last_undegraded":"2024-04-26T12:14:43.867023+0000","last_fullsized":"2024-04-26T12:14:43.867023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867584+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:14:43.867584+0000","last_peered":"2024-04-26T12:14:43.867584+0000","last_clean":"2024-04-26T12:14:43.867584+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:14:43.867584+0000","last_undegraded":"2024-04-26T12:14:43.867584+0000","last_fullsized":"2024-04-26T12:14:43.867584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867972+0000","last_change":"2024-04-26T12:14:42.527996+0000","last_active":"2024-04-26T12:14:43.867972+0000","last_peered":"2024-04-26T12:14:43.867972+0000","last_clean":"2024-04-26T12:14:43.867972+0000","last_became_active":"2024-04-26T12:14:42.527615+0000","last_became_peered":"2024-04-26T12:14:42.527615+0000","last_unstale":"2024-04-26T12:14:43.867972+0000","last_undegraded":"2024-04-26T12:14:43.867972+0000","last_fullsized":"2024-04-26T12:14:43.867972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867703+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:14:43.867703+0000","last_peered":"2024-04-26T12:14:43.867703+0000","last_clean":"2024-04-26T12:14:43.867703+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:14:43.867703+0000","last_undegraded":"2024-04-26T12:14:43.867703+0000","last_fullsized":"2024-04-26T12:14:43.867703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488669+0000","last_change":"2024-04-26T12:14:42.529666+0000","last_active":"2024-04-26T12:14:46.488669+0000","last_peered":"2024-04-26T12:14:46.488669+0000","last_clean":"2024-04-26T12:14:46.488669+0000","last_became_active":"2024-04-26T12:14:42.529366+0000","last_became_peered":"2024-04-26T12:14:42.529366+0000","last_unstale":"2024-04-26T12:14:46.488669+0000","last_undegraded":"2024-04-26T12:14:46.488669+0000","last_fullsized":"2024-04-26T12:14:46.488669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488798+0000","last_change":"2024-04-26T12:14:42.873577+0000","last_active":"2024-04-26T12:14:46.488798+0000","last_peered":"2024-04-26T12:14:46.488798+0000","last_clean":"2024-04-26T12:14:46.488798+0000","last_became_active":"2024-04-26T12:14:42.873183+0000","last_became_peered":"2024-04-26T12:14:42.873183+0000","last_unstale":"2024-04-26T12:14:46.488798+0000","last_undegraded":"2024-04-26T12:14:46.488798+0000","last_fullsized":"2024-04-26T12:14:46.488798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867161+0000","last_change":"2024-04-26T12:14:42.533710+0000","last_active":"2024-04-26T12:14:43.867161+0000","last_peered":"2024-04-26T12:14:43.867161+0000","last_clean":"2024-04-26T12:14:43.867161+0000","last_became_active":"2024-04-26T12:14:42.533436+0000","last_became_peered":"2024-04-26T12:14:42.533436+0000","last_unstale":"2024-04-26T12:14:43.867161+0000","last_undegraded":"2024-04-26T12:14:43.867161+0000","last_fullsized":"2024-04-26T12:14:43.867161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488840+0000","last_change":"2024-04-26T12:14:42.871019+0000","last_active":"2024-04-26T12:14:46.488840+0000","last_peered":"2024-04-26T12:14:46.488840+0000","last_clean":"2024-04-26T12:14:46.488840+0000","last_became_active":"2024-04-26T12:14:42.870630+0000","last_became_peered":"2024-04-26T12:14:42.870630+0000","last_unstale":"2024-04-26T12:14:46.488840+0000","last_undegraded":"2024-04-26T12:14:46.488840+0000","last_fullsized":"2024-04-26T12:14:46.488840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:14.204986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867164+0000","last_change":"2024-04-26T12:14:42.533517+0000","last_active":"2024-04-26T12:14:43.867164+0000","last_peered":"2024-04-26T12:14:43.867164+0000","last_clean":"2024-04-26T12:14:43.867164+0000","last_became_active":"2024-04-26T12:14:42.532693+0000","last_became_peered":"2024-04-26T12:14:42.532693+0000","last_unstale":"2024-04-26T12:14:43.867164+0000","last_undegraded":"2024-04-26T12:14:43.867164+0000","last_fullsized":"2024-04-26T12:14:43.867164+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868125+0000","last_change":"2024-04-26T12:14:42.532602+0000","last_active":"2024-04-26T12:14:43.868125+0000","last_peered":"2024-04-26T12:14:43.868125+0000","last_clean":"2024-04-26T12:14:43.868125+0000","last_became_active":"2024-04-26T12:14:42.531944+0000","last_became_peered":"2024-04-26T12:14:42.531944+0000","last_unstale":"2024-04-26T12:14:43.868125+0000","last_undegraded":"2024-04-26T12:14:43.868125+0000","last_fullsized":"2024-04-26T12:14:43.868125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866726+0000","last_change":"2024-04-26T12:14:42.871236+0000","last_active":"2024-04-26T12:14:43.866726+0000","last_peered":"2024-04-26T12:14:43.866726+0000","last_clean":"2024-04-26T12:14:43.866726+0000","last_became_active":"2024-04-26T12:14:42.871041+0000","last_became_peered":"2024-04-26T12:14:42.871041+0000","last_unstale":"2024-04-26T12:14:43.866726+0000","last_undegraded":"2024-04-26T12:14:43.866726+0000","last_fullsized":"2024-04-26T12:14:43.866726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:26.643464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867860+0000","last_change":"2024-04-26T12:14:42.534442+0000","last_active":"2024-04-26T12:14:43.867860+0000","last_peered":"2024-04-26T12:14:43.867860+0000","last_clean":"2024-04-26T12:14:43.867860+0000","last_became_active":"2024-04-26T12:14:42.534150+0000","last_became_peered":"2024-04-26T12:14:42.534150+0000","last_unstale":"2024-04-26T12:14:43.867860+0000","last_undegraded":"2024-04-26T12:14:43.867860+0000","last_fullsized":"2024-04-26T12:14:43.867860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:37.239499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868126+0000","last_change":"2024-04-26T12:14:42.530595+0000","last_active":"2024-04-26T12:14:43.868126+0000","last_peered":"2024-04-26T12:14:43.868126+0000","last_clean":"2024-04-26T12:14:43.868126+0000","last_became_active":"2024-04-26T12:14:42.529757+0000","last_became_peered":"2024-04-26T12:14:42.529757+0000","last_unstale":"2024-04-26T12:14:43.868126+0000","last_undegraded":"2024-04-26T12:14:43.868126+0000","last_fullsized":"2024-04-26T12:14:43.868126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867296+0000","last_change":"2024-04-26T12:14:42.869311+0000","last_active":"2024-04-26T12:14:43.867296+0000","last_peered":"2024-04-26T12:14:43.867296+0000","last_clean":"2024-04-26T12:14:43.867296+0000","last_became_active":"2024-04-26T12:14:42.868477+0000","last_became_peered":"2024-04-26T12:14:42.868477+0000","last_unstale":"2024-04-26T12:14:43.867296+0000","last_undegraded":"2024-04-26T12:14:43.867296+0000","last_fullsized":"2024-04-26T12:14:43.867296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867818+0000","last_change":"2024-04-26T12:14:42.528134+0000","last_active":"2024-04-26T12:14:43.867818+0000","last_peered":"2024-04-26T12:14:43.867818+0000","last_clean":"2024-04-26T12:14:43.867818+0000","last_became_active":"2024-04-26T12:14:42.527701+0000","last_became_peered":"2024-04-26T12:14:42.527701+0000","last_unstale":"2024-04-26T12:14:43.867818+0000","last_undegraded":"2024-04-26T12:14:43.867818+0000","last_fullsized":"2024-04-26T12:14:43.867818+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488699+0000","last_change":"2024-04-26T12:14:42.872162+0000","last_active":"2024-04-26T12:14:46.488699+0000","last_peered":"2024-04-26T12:14:46.488699+0000","last_clean":"2024-04-26T12:14:46.488699+0000","last_became_active":"2024-04-26T12:14:42.871777+0000","last_became_peered":"2024-04-26T12:14:42.871777+0000","last_unstale":"2024-04-26T12:14:46.488699+0000","last_undegraded":"2024-04-26T12:14:46.488699+0000","last_fullsized":"2024-04-26T12:14:46.488699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488710+0000","last_change":"2024-04-26T12:14:42.530739+0000","last_active":"2024-04-26T12:14:46.488710+0000","last_peered":"2024-04-26T12:14:46.488710+0000","last_clean":"2024-04-26T12:14:46.488710+0000","last_became_active":"2024-04-26T12:14:42.530380+0000","last_became_peered":"2024-04-26T12:14:42.530380+0000","last_unstale":"2024-04-26T12:14:46.488710+0000","last_undegraded":"2024-04-26T12:14:46.488710+0000","last_fullsized":"2024-04-26T12:14:46.488710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867734+0000","last_change":"2024-04-26T12:14:42.869606+0000","last_active":"2024-04-26T12:14:43.867734+0000","last_peered":"2024-04-26T12:14:43.867734+0000","last_clean":"2024-04-26T12:14:43.867734+0000","last_became_active":"2024-04-26T12:14:42.868445+0000","last_became_peered":"2024-04-26T12:14:42.868445+0000","last_unstale":"2024-04-26T12:14:43.867734+0000","last_undegraded":"2024-04-26T12:14:43.867734+0000","last_fullsized":"2024-04-26T12:14:43.867734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867653+0000","last_change":"2024-04-26T12:14:42.529285+0000","last_active":"2024-04-26T12:14:43.867653+0000","last_peered":"2024-04-26T12:14:43.867653+0000","last_clean":"2024-04-26T12:14:43.867653+0000","last_became_active":"2024-04-26T12:14:42.528618+0000","last_became_peered":"2024-04-26T12:14:42.528618+0000","last_unstale":"2024-04-26T12:14:43.867653+0000","last_undegraded":"2024-04-26T12:14:43.867653+0000","last_fullsized":"2024-04-26T12:14:43.867653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:10.595598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868242+0000","last_change":"2024-04-26T12:14:42.870080+0000","last_active":"2024-04-26T12:14:43.868242+0000","last_peered":"2024-04-26T12:14:43.868242+0000","last_clean":"2024-04-26T12:14:43.868242+0000","last_became_active":"2024-04-26T12:14:42.867542+0000","last_became_peered":"2024-04-26T12:14:42.867542+0000","last_unstale":"2024-04-26T12:14:43.868242+0000","last_undegraded":"2024-04-26T12:14:43.868242+0000","last_fullsized":"2024-04-26T12:14:43.868242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867192+0000","last_change":"2024-04-26T12:14:42.533248+0000","last_active":"2024-04-26T12:14:43.867192+0000","last_peered":"2024-04-26T12:14:43.867192+0000","last_clean":"2024-04-26T12:14:43.867192+0000","last_became_active":"2024-04-26T12:14:42.532987+0000","last_became_peered":"2024-04-26T12:14:42.532987+0000","last_unstale":"2024-04-26T12:14:43.867192+0000","last_undegraded":"2024-04-26T12:14:43.867192+0000","last_fullsized":"2024-04-26T12:14:43.867192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:03.860297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867786+0000","last_change":"2024-04-26T12:14:42.866349+0000","last_active":"2024-04-26T12:14:43.867786+0000","last_peered":"2024-04-26T12:14:43.867786+0000","last_clean":"2024-04-26T12:14:43.867786+0000","last_became_active":"2024-04-26T12:14:42.865989+0000","last_became_peered":"2024-04-26T12:14:42.865989+0000","last_unstale":"2024-04-26T12:14:43.867786+0000","last_undegraded":"2024-04-26T12:14:43.867786+0000","last_fullsized":"2024-04-26T12:14:43.867786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866814+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:14:43.866814+0000","last_peered":"2024-04-26T12:14:43.866814+0000","last_clean":"2024-04-26T12:14:43.866814+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:14:43.866814+0000","last_undegraded":"2024-04-26T12:14:43.866814+0000","last_fullsized":"2024-04-26T12:14:43.866814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488849+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:14:46.488849+0000","last_peered":"2024-04-26T12:14:46.488849+0000","last_clean":"2024-04-26T12:14:46.488849+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:14:46.488849+0000","last_undegraded":"2024-04-26T12:14:46.488849+0000","last_fullsized":"2024-04-26T12:14:46.488849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862558+0000","last_change":"2024-04-26T12:14:38.226703+0000","last_active":"2024-04-26T12:14:42.862558+0000","last_peered":"2024-04-26T12:14:42.862558+0000","last_clean":"2024-04-26T12:14:42.862558+0000","last_became_active":"2024-04-26T12:14:38.226457+0000","last_became_peered":"2024-04-26T12:14:38.226457+0000","last_unstale":"2024-04-26T12:14:42.862558+0000","last_undegraded":"2024-04-26T12:14:42.862558+0000","last_fullsized":"2024-04-26T12:14:42.862558+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862638+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862638+0000","last_peered":"2024-04-26T12:14:42.862638+0000","last_clean":"2024-04-26T12:14:42.862638+0000","last_became_active":"2024-04-26T12:14:38.228757+0000","last_became_peered":"2024-04-26T12:14:38.228757+0000","last_unstale":"2024-04-26T12:14:42.862638+0000","last_undegraded":"2024-04-26T12:14:42.862638+0000","last_fullsized":"2024-04-26T12:14:42.862638+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:46.340068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488680+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:14:46.488680+0000","last_peered":"2024-04-26T12:14:46.488680+0000","last_clean":"2024-04-26T12:14:46.488680+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:14:46.488680+0000","last_undegraded":"2024-04-26T12:14:46.488680+0000","last_fullsized":"2024-04-26T12:14:46.488680+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868139+0000","last_change":"2024-04-26T12:14:42.869728+0000","last_active":"2024-04-26T12:14:43.868139+0000","last_peered":"2024-04-26T12:14:43.868139+0000","last_clean":"2024-04-26T12:14:43.868139+0000","last_became_active":"2024-04-26T12:14:42.867567+0000","last_became_peered":"2024-04-26T12:14:42.867567+0000","last_unstale":"2024-04-26T12:14:43.868139+0000","last_undegraded":"2024-04-26T12:14:43.868139+0000","last_fullsized":"2024-04-26T12:14:43.868139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:33.778945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862186+0000","last_change":"2024-04-26T12:14:38.227028+0000","last_active":"2024-04-26T12:14:42.862186+0000","last_peered":"2024-04-26T12:14:42.862186+0000","last_clean":"2024-04-26T12:14:42.862186+0000","last_became_active":"2024-04-26T12:14:38.226791+0000","last_became_peered":"2024-04-26T12:14:38.226791+0000","last_unstale":"2024-04-26T12:14:42.862186+0000","last_undegraded":"2024-04-26T12:14:42.862186+0000","last_fullsized":"2024-04-26T12:14:42.862186+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488639+0000","last_change":"2024-04-26T12:14:42.529005+0000","last_active":"2024-04-26T12:14:46.488639+0000","last_peered":"2024-04-26T12:14:46.488639+0000","last_clean":"2024-04-26T12:14:46.488639+0000","last_became_active":"2024-04-26T12:14:42.528648+0000","last_became_peered":"2024-04-26T12:14:42.528648+0000","last_unstale":"2024-04-26T12:14:46.488639+0000","last_undegraded":"2024-04-26T12:14:46.488639+0000","last_fullsized":"2024-04-26T12:14:46.488639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:20.954265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867695+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:14:43.867695+0000","last_peered":"2024-04-26T12:14:43.867695+0000","last_clean":"2024-04-26T12:14:43.867695+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:14:43.867695+0000","last_undegraded":"2024-04-26T12:14:43.867695+0000","last_fullsized":"2024-04-26T12:14:43.867695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858931+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:14:42.858931+0000","last_peered":"2024-04-26T12:14:42.858931+0000","last_clean":"2024-04-26T12:14:42.858931+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:14:42.858931+0000","last_undegraded":"2024-04-26T12:14:42.858931+0000","last_fullsized":"2024-04-26T12:14:42.858931+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866866+0000","last_change":"2024-04-26T12:14:42.534422+0000","last_active":"2024-04-26T12:14:43.866866+0000","last_peered":"2024-04-26T12:14:43.866866+0000","last_clean":"2024-04-26T12:14:43.866866+0000","last_became_active":"2024-04-26T12:14:42.534055+0000","last_became_peered":"2024-04-26T12:14:42.534055+0000","last_unstale":"2024-04-26T12:14:43.866866+0000","last_undegraded":"2024-04-26T12:14:43.866866+0000","last_fullsized":"2024-04-26T12:14:43.866866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:07.197258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488858+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:14:46.488858+0000","last_peered":"2024-04-26T12:14:46.488858+0000","last_clean":"2024-04-26T12:14:46.488858+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:14:46.488858+0000","last_undegraded":"2024-04-26T12:14:46.488858+0000","last_fullsized":"2024-04-26T12:14:46.488858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.862986+0000","last_change":"2024-04-26T12:14:38.228992+0000","last_active":"2024-04-26T12:14:42.862986+0000","last_peered":"2024-04-26T12:14:42.862986+0000","last_clean":"2024-04-26T12:14:42.862986+0000","last_became_active":"2024-04-26T12:14:38.228716+0000","last_became_peered":"2024-04-26T12:14:38.228716+0000","last_unstale":"2024-04-26T12:14:42.862986+0000","last_undegraded":"2024-04-26T12:14:42.862986+0000","last_fullsized":"2024-04-26T12:14:42.862986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:27.697029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868018+0000","last_change":"2024-04-26T12:14:42.528091+0000","last_active":"2024-04-26T12:14:43.868018+0000","last_peered":"2024-04-26T12:14:43.868018+0000","last_clean":"2024-04-26T12:14:43.868018+0000","last_became_active":"2024-04-26T12:14:42.527707+0000","last_became_peered":"2024-04-26T12:14:42.527707+0000","last_unstale":"2024-04-26T12:14:43.868018+0000","last_undegraded":"2024-04-26T12:14:43.868018+0000","last_fullsized":"2024-04-26T12:14:43.868018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:47.197202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488728+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:14:46.488728+0000","last_peered":"2024-04-26T12:14:46.488728+0000","last_clean":"2024-04-26T12:14:46.488728+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:14:46.488728+0000","last_undegraded":"2024-04-26T12:14:46.488728+0000","last_fullsized":"2024-04-26T12:14:46.488728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868182+0000","last_change":"2024-04-26T12:14:42.530310+0000","last_active":"2024-04-26T12:14:43.868182+0000","last_peered":"2024-04-26T12:14:43.868182+0000","last_clean":"2024-04-26T12:14:43.868182+0000","last_became_active":"2024-04-26T12:14:42.529543+0000","last_became_peered":"2024-04-26T12:14:42.529543+0000","last_unstale":"2024-04-26T12:14:43.868182+0000","last_undegraded":"2024-04-26T12:14:43.868182+0000","last_fullsized":"2024-04-26T12:14:43.868182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.858590+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:14:42.858590+0000","last_peered":"2024-04-26T12:14:42.858590+0000","last_clean":"2024-04-26T12:14:42.858590+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:14:42.858590+0000","last_undegraded":"2024-04-26T12:14:42.858590+0000","last_fullsized":"2024-04-26T12:14:42.858590+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867097+0000","last_change":"2024-04-26T12:14:42.870740+0000","last_active":"2024-04-26T12:14:43.867097+0000","last_peered":"2024-04-26T12:14:43.867097+0000","last_clean":"2024-04-26T12:14:43.867097+0000","last_became_active":"2024-04-26T12:14:42.870426+0000","last_became_peered":"2024-04-26T12:14:42.870426+0000","last_unstale":"2024-04-26T12:14:43.867097+0000","last_undegraded":"2024-04-26T12:14:43.867097+0000","last_fullsized":"2024-04-26T12:14:43.867097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:18.552440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488738+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:14:46.488738+0000","last_peered":"2024-04-26T12:14:46.488738+0000","last_clean":"2024-04-26T12:14:46.488738+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:14:46.488738+0000","last_undegraded":"2024-04-26T12:14:46.488738+0000","last_fullsized":"2024-04-26T12:14:46.488738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859224+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:14:42.859224+0000","last_peered":"2024-04-26T12:14:42.859224+0000","last_clean":"2024-04-26T12:14:42.859224+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:14:42.859224+0000","last_undegraded":"2024-04-26T12:14:42.859224+0000","last_fullsized":"2024-04-26T12:14:42.859224+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867149+0000","last_change":"2024-04-26T12:14:42.868394+0000","last_active":"2024-04-26T12:14:43.867149+0000","last_peered":"2024-04-26T12:14:43.867149+0000","last_clean":"2024-04-26T12:14:43.867149+0000","last_became_active":"2024-04-26T12:14:42.867469+0000","last_became_peered":"2024-04-26T12:14:42.867469+0000","last_unstale":"2024-04-26T12:14:43.867149+0000","last_undegraded":"2024-04-26T12:14:43.867149+0000","last_fullsized":"2024-04-26T12:14:43.867149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488919+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:14:46.488919+0000","last_peered":"2024-04-26T12:14:46.488919+0000","last_clean":"2024-04-26T12:14:46.488919+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:14:46.488919+0000","last_undegraded":"2024-04-26T12:14:46.488919+0000","last_fullsized":"2024-04-26T12:14:46.488919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.859750+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:14:42.859750+0000","last_peered":"2024-04-26T12:14:42.859750+0000","last_clean":"2024-04-26T12:14:42.859750+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:14:42.859750+0000","last_undegraded":"2024-04-26T12:14:42.859750+0000","last_fullsized":"2024-04-26T12:14:42.859750+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488546+0000","last_change":"2024-04-26T12:14:42.872140+0000","last_active":"2024-04-26T12:14:46.488546+0000","last_peered":"2024-04-26T12:14:46.488546+0000","last_clean":"2024-04-26T12:14:46.488546+0000","last_became_active":"2024-04-26T12:14:42.871667+0000","last_became_peered":"2024-04-26T12:14:42.871667+0000","last_unstale":"2024-04-26T12:14:46.488546+0000","last_undegraded":"2024-04-26T12:14:46.488546+0000","last_fullsized":"2024-04-26T12:14:46.488546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.601045+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.601045+0000","last_peered":"2024-04-26T12:14:46.601045+0000","last_clean":"2024-04-26T12:14:46.601045+0000","last_became_active":"2024-04-26T12:14:42.530054+0000","last_became_peered":"2024-04-26T12:14:42.530054+0000","last_unstale":"2024-04-26T12:14:46.601045+0000","last_undegraded":"2024-04-26T12:14:46.601045+0000","last_fullsized":"2024-04-26T12:14:46.601045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:14.741677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:42.865382+0000","last_change":"2024-04-26T12:14:38.226291+0000","last_active":"2024-04-26T12:14:42.865382+0000","last_peered":"2024-04-26T12:14:42.865382+0000","last_clean":"2024-04-26T12:14:42.865382+0000","last_became_active":"2024-04-26T12:14:38.226084+0000","last_became_peered":"2024-04-26T12:14:38.226084+0000","last_unstale":"2024-04-26T12:14:42.865382+0000","last_undegraded":"2024-04-26T12:14:42.865382+0000","last_fullsized":"2024-04-26T12:14:42.865382+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:23.287154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.866908+0000","last_change":"2024-04-26T12:14:42.866932+0000","last_active":"2024-04-26T12:14:43.866908+0000","last_peered":"2024-04-26T12:14:43.866908+0000","last_clean":"2024-04-26T12:14:43.866908+0000","last_became_active":"2024-04-26T12:14:42.866555+0000","last_became_peered":"2024-04-26T12:14:42.866555+0000","last_unstale":"2024-04-26T12:14:43.866908+0000","last_undegraded":"2024-04-26T12:14:43.866908+0000","last_fullsized":"2024-04-26T12:14:43.866908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:35.495924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867685+0000","last_change":"2024-04-26T12:14:42.867426+0000","last_active":"2024-04-26T12:14:43.867685+0000","last_peered":"2024-04-26T12:14:43.867685+0000","last_clean":"2024-04-26T12:14:43.867685+0000","last_became_active":"2024-04-26T12:14:42.866597+0000","last_became_peered":"2024-04-26T12:14:42.866597+0000","last_unstale":"2024-04-26T12:14:43.867685+0000","last_undegraded":"2024-04-26T12:14:43.867685+0000","last_fullsized":"2024-04-26T12:14:43.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867778+0000","last_change":"2024-04-26T12:14:42.528956+0000","last_active":"2024-04-26T12:14:43.867778+0000","last_peered":"2024-04-26T12:14:43.867778+0000","last_clean":"2024-04-26T12:14:43.867778+0000","last_became_active":"2024-04-26T12:14:42.528543+0000","last_became_peered":"2024-04-26T12:14:42.528543+0000","last_unstale":"2024-04-26T12:14:43.867778+0000","last_undegraded":"2024-04-26T12:14:43.867778+0000","last_fullsized":"2024-04-26T12:14:43.867778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:59.460459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488657+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:14:46.488657+0000","last_peered":"2024-04-26T12:14:46.488657+0000","last_clean":"2024-04-26T12:14:46.488657+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:14:46.488657+0000","last_undegraded":"2024-04-26T12:14:46.488657+0000","last_fullsized":"2024-04-26T12:14:46.488657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867876+0000","last_change":"2024-04-26T12:14:42.534326+0000","last_active":"2024-04-26T12:14:43.867876+0000","last_peered":"2024-04-26T12:14:43.867876+0000","last_clean":"2024-04-26T12:14:43.867876+0000","last_became_active":"2024-04-26T12:14:42.534008+0000","last_became_peered":"2024-04-26T12:14:42.534008+0000","last_unstale":"2024-04-26T12:14:43.867876+0000","last_undegraded":"2024-04-26T12:14:43.867876+0000","last_fullsized":"2024-04-26T12:14:43.867876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:34.796560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.868039+0000","last_change":"2024-04-26T12:14:42.533769+0000","last_active":"2024-04-26T12:14:43.868039+0000","last_peered":"2024-04-26T12:14:43.868039+0000","last_clean":"2024-04-26T12:14:43.868039+0000","last_became_active":"2024-04-26T12:14:42.533439+0000","last_became_peered":"2024-04-26T12:14:42.533439+0000","last_unstale":"2024-04-26T12:14:43.868039+0000","last_undegraded":"2024-04-26T12:14:43.868039+0000","last_fullsized":"2024-04-26T12:14:43.868039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488609+0000","last_change":"2024-04-26T12:14:42.870305+0000","last_active":"2024-04-26T12:14:46.488609+0000","last_peered":"2024-04-26T12:14:46.488609+0000","last_clean":"2024-04-26T12:14:46.488609+0000","last_became_active":"2024-04-26T12:14:42.869976+0000","last_became_peered":"2024-04-26T12:14:42.869976+0000","last_unstale":"2024-04-26T12:14:46.488609+0000","last_undegraded":"2024-04-26T12:14:46.488609+0000","last_fullsized":"2024-04-26T12:14:46.488609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488896+0000","last_change":"2024-04-26T12:14:42.530410+0000","last_active":"2024-04-26T12:14:46.488896+0000","last_peered":"2024-04-26T12:14:46.488896+0000","last_clean":"2024-04-26T12:14:46.488896+0000","last_became_active":"2024-04-26T12:14:42.529967+0000","last_became_peered":"2024-04-26T12:14:42.529967+0000","last_unstale":"2024-04-26T12:14:46.488896+0000","last_undegraded":"2024-04-26T12:14:46.488896+0000","last_fullsized":"2024-04-26T12:14:46.488896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:28.712771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488516+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:14:46.488516+0000","last_peered":"2024-04-26T12:14:46.488516+0000","last_clean":"2024-04-26T12:14:46.488516+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:14:46.488516+0000","last_undegraded":"2024-04-26T12:14:46.488516+0000","last_fullsized":"2024-04-26T12:14:46.488516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867835+0000","last_change":"2024-04-26T12:14:42.874343+0000","last_active":"2024-04-26T12:14:43.867835+0000","last_peered":"2024-04-26T12:14:43.867835+0000","last_clean":"2024-04-26T12:14:43.867835+0000","last_became_active":"2024-04-26T12:14:42.874067+0000","last_became_peered":"2024-04-26T12:14:42.874067+0000","last_unstale":"2024-04-26T12:14:43.867835+0000","last_undegraded":"2024-04-26T12:14:43.867835+0000","last_fullsized":"2024-04-26T12:14:43.867835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:21.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488559+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:14:46.488559+0000","last_peered":"2024-04-26T12:14:46.488559+0000","last_clean":"2024-04-26T12:14:46.488559+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:14:46.488559+0000","last_undegraded":"2024-04-26T12:14:46.488559+0000","last_fullsized":"2024-04-26T12:14:46.488559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488775+0000","last_change":"2024-04-26T12:14:42.870189+0000","last_active":"2024-04-26T12:14:46.488775+0000","last_peered":"2024-04-26T12:14:46.488775+0000","last_clean":"2024-04-26T12:14:46.488775+0000","last_became_active":"2024-04-26T12:14:42.869808+0000","last_became_peered":"2024-04-26T12:14:42.869808+0000","last_unstale":"2024-04-26T12:14:46.488775+0000","last_undegraded":"2024-04-26T12:14:46.488775+0000","last_fullsized":"2024-04-26T12:14:46.488775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:11.557769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488619+0000","last_change":"2024-04-26T12:14:42.530759+0000","last_active":"2024-04-26T12:14:46.488619+0000","last_peered":"2024-04-26T12:14:46.488619+0000","last_clean":"2024-04-26T12:14:46.488619+0000","last_became_active":"2024-04-26T12:14:42.530393+0000","last_became_peered":"2024-04-26T12:14:42.530393+0000","last_unstale":"2024-04-26T12:14:46.488619+0000","last_undegraded":"2024-04-26T12:14:46.488619+0000","last_fullsized":"2024-04-26T12:14:46.488619+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.290674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867656+0000","last_change":"2024-04-26T12:14:42.867217+0000","last_active":"2024-04-26T12:14:43.867656+0000","last_peered":"2024-04-26T12:14:43.867656+0000","last_clean":"2024-04-26T12:14:43.867656+0000","last_became_active":"2024-04-26T12:14:42.866778+0000","last_became_peered":"2024-04-26T12:14:42.866778+0000","last_unstale":"2024-04-26T12:14:43.867656+0000","last_undegraded":"2024-04-26T12:14:43.867656+0000","last_fullsized":"2024-04-26T12:14:43.867656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:56.434565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867244+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:14:43.867244+0000","last_peered":"2024-04-26T12:14:43.867244+0000","last_clean":"2024-04-26T12:14:43.867244+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:14:43.867244+0000","last_undegraded":"2024-04-26T12:14:43.867244+0000","last_fullsized":"2024-04-26T12:14:43.867244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867461+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:14:43.867461+0000","last_peered":"2024-04-26T12:14:43.867461+0000","last_clean":"2024-04-26T12:14:43.867461+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:14:43.867461+0000","last_undegraded":"2024-04-26T12:14:43.867461+0000","last_fullsized":"2024-04-26T12:14:43.867461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867373+0000","last_change":"2024-04-26T12:14:42.534341+0000","last_active":"2024-04-26T12:14:43.867373+0000","last_peered":"2024-04-26T12:14:43.867373+0000","last_clean":"2024-04-26T12:14:43.867373+0000","last_became_active":"2024-04-26T12:14:42.534034+0000","last_became_peered":"2024-04-26T12:14:42.534034+0000","last_unstale":"2024-04-26T12:14:43.867373+0000","last_undegraded":"2024-04-26T12:14:43.867373+0000","last_fullsized":"2024-04-26T12:14:43.867373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:49.137895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867226+0000","last_change":"2024-04-26T12:14:42.868865+0000","last_active":"2024-04-26T12:14:43.867226+0000","last_peered":"2024-04-26T12:14:43.867226+0000","last_clean":"2024-04-26T12:14:43.867226+0000","last_became_active":"2024-04-26T12:14:42.868331+0000","last_became_peered":"2024-04-26T12:14:42.868331+0000","last_unstale":"2024-04-26T12:14:43.867226+0000","last_undegraded":"2024-04-26T12:14:43.867226+0000","last_fullsized":"2024-04-26T12:14:43.867226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:48.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867662+0000","last_change":"2024-04-26T12:14:42.530621+0000","last_active":"2024-04-26T12:14:43.867662+0000","last_peered":"2024-04-26T12:14:43.867662+0000","last_clean":"2024-04-26T12:14:43.867662+0000","last_became_active":"2024-04-26T12:14:42.529635+0000","last_became_peered":"2024-04-26T12:14:42.529635+0000","last_unstale":"2024-04-26T12:14:43.867662+0000","last_undegraded":"2024-04-26T12:14:43.867662+0000","last_fullsized":"2024-04-26T12:14:43.867662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.073389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867450+0000","last_change":"2024-04-26T12:14:42.867354+0000","last_active":"2024-04-26T12:14:43.867450+0000","last_peered":"2024-04-26T12:14:43.867450+0000","last_clean":"2024-04-26T12:14:43.867450+0000","last_became_active":"2024-04-26T12:14:42.866550+0000","last_became_peered":"2024-04-26T12:14:42.866550+0000","last_unstale":"2024-04-26T12:14:43.867450+0000","last_undegraded":"2024-04-26T12:14:43.867450+0000","last_fullsized":"2024-04-26T12:14:43.867450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867761+0000","last_change":"2024-04-26T12:14:42.533661+0000","last_active":"2024-04-26T12:14:43.867761+0000","last_peered":"2024-04-26T12:14:43.867761+0000","last_clean":"2024-04-26T12:14:43.867761+0000","last_became_active":"2024-04-26T12:14:42.533454+0000","last_became_peered":"2024-04-26T12:14:42.533454+0000","last_unstale":"2024-04-26T12:14:43.867761+0000","last_undegraded":"2024-04-26T12:14:43.867761+0000","last_fullsized":"2024-04-26T12:14:43.867761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:06.330845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867306+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:14:43.867306+0000","last_peered":"2024-04-26T12:14:43.867306+0000","last_clean":"2024-04-26T12:14:43.867306+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:14:43.867306+0000","last_undegraded":"2024-04-26T12:14:43.867306+0000","last_fullsized":"2024-04-26T12:14:43.867306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488786+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:14:46.488786+0000","last_peered":"2024-04-26T12:14:46.488786+0000","last_clean":"2024-04-26T12:14:46.488786+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:14:46.488786+0000","last_undegraded":"2024-04-26T12:14:46.488786+0000","last_fullsized":"2024-04-26T12:14:46.488786+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:14:43.867425+0000","last_change":"2024-04-26T12:14:42.869979+0000","last_active":"2024-04-26T12:14:43.867425+0000","last_peered":"2024-04-26T12:14:43.867425+0000","last_clean":"2024-04-26T12:14:43.867425+0000","last_became_active":"2024-04-26T12:14:42.868687+0000","last_became_peered":"2024-04-26T12:14:42.868687+0000","last_unstale":"2024-04-26T12:14:43.867425+0000","last_undegraded":"2024-04-26T12:14:43.867425+0000","last_fullsized":"2024-04-26T12:14:43.867425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:14:46.488886+0000","last_change":"2024-04-26T12:14:42.534167+0000","last_active":"2024-04-26T12:14:46.488886+0000","last_peered":"2024-04-26T12:14:46.488886+0000","last_clean":"2024-04-26T12:14:46.488886+0000","last_became_active":"2024-04-26T12:14:42.533826+0000","last_became_peered":"2024-04-26T12:14:42.533826+0000","last_unstale":"2024-04-26T12:14:46.488886+0000","last_undegraded":"2024-04-26T12:14:46.488886+0000","last_fullsized":"2024-04-26T12:14:46.488886+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:18.080914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35348,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336492,"statfs":{"total":96636764160,"available":96600567808,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:15:01.282 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:15:01.283 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T12:15:01.595 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 15 2024-04-26T12:15:01.595 INFO:teuthology.orchestra.run.smithi069.stdout:fsid 38aaef92-b73b-4053-b2f0-6b2ea75fb544 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:created 2024-04-26T12:14:27.921075+0000 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2024-04-26T12:14:43.852134+0000 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:crush_version 4 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:full_ratio 0.95 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:backfillfull_ratio 0.9 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:nearfull_ratio 0.85 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:require_min_compat_client luminous 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:min_compat_client jewel 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:require_osd_release reef 2024-04-26T12:15:01.596 INFO:teuthology.orchestra.run.smithi069.stdout:stretch_mode_enabled false 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:max_osd 3 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/28647,v1:172.21.15.70:6801/28647] [v2:172.21.15.70:6802/28647,v1:172.21.15.70:6803/28647] exists,up 89200742-a13d-457a-aef2-b2a7ff7adfa9 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.113:6800/28559,v1:172.21.15.113:6801/28559] [v2:172.21.15.113:6802/28559,v1:172.21.15.113:6803/28559] exists,up ea84835a-16c2-4100-a546-95ddfec7c9ae 2024-04-26T12:15:01.597 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/28763,v1:172.21.15.172:6801/28763] [v2:172.21.15.172:6802/28763,v1:172.21.15.172:6803/28763] exists,up ee2ef2ba-d976-41f8-811d-8b1131867aac 2024-04-26T12:15:01.608 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/28647,v1:172.21.15.70:6801/28647] [v2:172.21.15.70:6802/28647,v1:172.21.15.70:6803/28647] exists,up 89200742-a13d-457a-aef2-b2a7ff7adfa9', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.113:6800/28559,v1:172.21.15.113:6801/28559] [v2:172.21.15.113:6802/28559,v1:172.21.15.113:6803/28559] exists,up ea84835a-16c2-4100-a546-95ddfec7c9ae', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/28763,v1:172.21.15.172:6801/28763] [v2:172.21.15.172:6802/28763,v1:172.21.15.172:6803/28763] exists,up ee2ef2ba-d976-41f8-811d-8b1131867aac'] 2024-04-26T12:15:01.609 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mon.a", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster": "ceph", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "admin_socket_mode": "", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_client_required": "cephx, none", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_cluster_required": "cephx", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_debug": "true", 2024-04-26T12:15:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_service_required": "cephx", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_supported": "cephx", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_aio": "true", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_aio_reap_max": "16", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_async_discard": "false", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_block_size": "4096", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_debug_aio": "false", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T12:15:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_enable_discard": "false", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_flock_retry": "3", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_inject_crash": "0", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_ioring": "false", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_ioring_hipri": "false", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T12:15:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "bdev_type": "", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_allocator": "hybrid", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_buffered_io": "true", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T12:15:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_replay_recovery": "false", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_sync_write": "false", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_allocator": "hybrid", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T12:15:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_create": "true", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_db_create": "false", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_db_path": "", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_db_size": "0", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_path": "", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_size": "107374182400", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_wal_create": "false", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_wal_path": "", 2024-04-26T12:15:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_bluefs": "true", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_autotune": "true", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T12:15:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_size": "0", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_type": "2q", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_clone_cow": "true", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T12:15:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_mode": "none", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_freelist": "false", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T12:15:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T12:15:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fail_eio": "false", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T12:15:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T12:15:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_max_blob_size": "0", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T12:15:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T12:15:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_spdk_mem": "512", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_tracing": "false", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T12:15:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T12:15:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephx_cluster_require_version": "2", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephx_require_signatures": "false", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephx_require_version": "2", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephx_service_require_signatures": "false", 2024-04-26T12:15:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cephx_service_require_version": "2", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "cephx_sign_messages": "true", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "chdir": "", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_acl_type": "", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_asio_thread_count": "2", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_cache_mid": "0.750000", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_cache_size": "16384", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_caps_release_delay": "5", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_check_pool_perm": "true", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_debug_force_sync_read": "false", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_debug_getattr_caps": "false", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_die_on_failed_remount": "false", 2024-04-26T12:15:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "client_dirsize_rbytes": "true", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_force_lazyio": "false", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_fs": "", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_inject_release_failure": "false", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_max_inline_size": "4096", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_mds_namespace": "", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_metadata": "", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_mount_gid": "-1", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_mount_timeout": "300", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_mount_uid": "-1", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_mountpoint": "/", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_notify_timeout": "10", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_oc": "true", 2024-04-26T12:15:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_oc_max_objects": "1000", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_oc_size": "209715200", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_permissions": "true", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_quota": "true", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_quota_df": "true", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_readahead_max_bytes": "0", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_readahead_max_periods": "4", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_readahead_min": "131072", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_reconnect_stale": "false", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_shutdown_timeout": "30", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_snapdir": ".snap", 2024-04-26T12:15:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "client_tick_interval": "1", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "client_trace": "", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "client_use_faked_inos": "false", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "client_use_random_mds": "false", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "clog_to_graylog": "false", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "clog_to_graylog_port": "12201", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "clog_to_monitors": "default=true", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "clog_to_syslog": "false", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "clog_to_syslog_level": "info", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_addr": "-", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_network": "", 2024-04-26T12:15:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_network_interface": "", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "compressor_zlib_isal": "false", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "compressor_zlib_level": "5", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "compressor_zstd_level": "1", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crimson_seastar_smp": "1", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_location": "", 2024-04-26T12:15:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_location_hook": "", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_location_hook_timeout": "10", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "daemonize": "false", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "daos_pool": "tank", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_alienstore": "0/5", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_asok": "1/5", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_asok_assert_abort": "false", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_auth": "20/20", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_bdev": "1/3", 2024-04-26T12:15:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_bluefs": "1/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_bluestore": "1/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_buffer": "0/1", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_cephsqlite": "0/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_client": "0/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_compressor": "1/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_context": "0/1", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_crush": "1/1", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_crypto": "1/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_cyanstore": "0/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_dpdk": "1/5", 2024-04-26T12:15:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_eventtrace": "1/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_filer": "0/1", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_filestore": "1/3", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_finisher": "1/1", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_fuse": "1/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_javaclient": "1/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_journal": "1/3", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_journaler": "0/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_kstore": "1/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_leveldb": "4/5", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_lockdep": "0/1", 2024-04-26T12:15:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mclock": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mds": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mds_balancer": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mds_locker": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mds_log": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mds_migrator": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_memstore": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mgr": "2/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mgrc": "1/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_mon": "20/20", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_monc": "0/10", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_ms": "1/1", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_none": "0/5", 2024-04-26T12:15:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_objclass": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_objectcacher": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_objecter": "0/1", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_optracker": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_osd": "1/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_paxos": "20/20", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_perfcounter": "1/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_prioritycache": "1/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rados": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rbd": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rbd_replay": "0/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_refs": "0/0", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_reserver": "1/1", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rgw": "1/5", 2024-04-26T12:15:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rgw_access": "1/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rgw_flight": "1/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rgw_sync": "1/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_rocksdb": "4/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_backref": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_cache": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_device": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_epm": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_journal": "0/5", 2024-04-26T12:15:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_lba": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_odata": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_omap": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_onode": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_t": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_seastore_tm": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_striper": "0/1", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_test": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_throttle": "1/1", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_timer": "0/1", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "debug_tp": "0/5", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "device_failure_prediction_mode": "none", 2024-04-26T12:15:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "err_to_graylog": "false", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "err_to_journald": "false", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "err_to_stderr": "true", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "err_to_syslog": "false", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "event_tracing": "false", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "exporter_http_port": "9926", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "exporter_prio_limit": "5", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "exporter_sort_metrics": "true", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "exporter_stats_period": "5", 2024-04-26T12:15:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "fake_statfs_for_testing": "0", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "fatal_signal_handlers": "true", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filer_max_purge_ops": "10", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filer_max_truncate_ops": "128", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_blackhole": "false", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_btrfs_snap": "true", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_caller_concurrency": "10", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_debug_omap_check": "false", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_debug_verify_split": "false", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_dump_file": "", 2024-04-26T12:15:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_fadvise": "true", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_fail_eio": "true", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_fd_cache_size": "128", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_fiemap": "false", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_inject_stall": "0", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_journal_parallel": "false", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_journal_trailing": "false", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_journal_writeahead": "false", 2024-04-26T12:15:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_kill_at": "0", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T12:15:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_merge_threshold": "-10", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_odsync_write": "false", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_omap_backend_path": "", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_op_threads": "2", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_punch_hole": "false", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T12:15:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_queue_max_ops": "50", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_seek_data_hole": "false", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_sloppy_crc": "false", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_splice": "false", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_split_multiple": "2", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_split_rand_factor": "20", 2024-04-26T12:15:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_update_to": "1000", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T12:15:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_xfs_extsize": "false", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "filestore_zfs_snap": "false", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fio_dir": "/tmp/fio", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fsid": "38aaef92-b73b-4053-b2f0-6b2ea75fb544", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_allow_other": "true", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_big_writes": "true", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_debug": "false", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_default_permissions": "false", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_disable_pagecache": "false", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_max_write": "0", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_multithreaded": "true", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_require_active_mds": "true", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_set_user_groups": "true", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_splice_move": "true", 2024-04-26T12:15:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_splice_read": "true", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_splice_write": "true", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "gss_target_name": "ceph", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "heartbeat_file": "", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "heartbeat_inject_failure": "0", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "heartbeat_interval": "5", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "host": "smithi069", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T12:15:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "inject_early_sigterm": "false", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "jaeger_agent_port": "6799", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "jaeger_tracing_enable": "false", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_aio": "true", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_align_min_size": "65536", 2024-04-26T12:15:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_block_align": "true", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_block_size": "4096", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_dio": "true", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_discard": "false", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_force_aio": "false", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_ignore_corruption": "false", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_max_write_entries": "100", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_replay_from": "0", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_write_header_frequency": "0", 2024-04-26T12:15:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "journal_zero_on_create": "false", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "journaler_prefetch_periods": "10", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "journaler_prezero_periods": "5", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "journaler_write_head_interval": "15", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "keyfile": "", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_backend": "rocksdb", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_max_bytes": "67108864", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_max_ops": "512", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T12:15:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_onode_map_size": "1024", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "kstore_sync_transaction": "false", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_block_size": "65536", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_bloom_size": "0", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_cache_size": "536870912", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_compression": "false", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_log": "", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_max_open_files": "0", 2024-04-26T12:15:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_paranoid": "false", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "librados_thread_count": "2", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "lockdep": "false", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "lockdep_force_backtrace": "false", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_coarse_timestamps": "true", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_flush_on_exit": "false", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_graylog_port": "12201", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_max_new": "1000", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_max_recent": "10000", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_stderr_prefix": "", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T12:15:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": "true", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_graylog": "false", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_journald": "false", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_stderr": "false", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_syslog": "false", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_action_on_write_error": "1", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_alternate_name_max": "8192", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_asio_thread_count": "2", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_export_pin": "true", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T12:15:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_interval": "10", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_max": "-1", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_max_until": "-1", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_merge_size": "50", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_mode": "0", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T12:15:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_split_bits": "3", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_split_size": "10000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T12:15:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache_mid": "0.700000", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache_trim_interval": "1", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T12:15:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_debug_auth_pins": "false", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_debug_frag": "false", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_debug_scatterstat": "false", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_debug_subtrees": "false", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_default_dir_hash": "2", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_defer_session_stale": "true", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dir_max_entries": "0", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dir_prefetch": "true", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T12:15:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_early_reply": "true", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_enable_op_tracker": "true", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_enforce_unique_name": "true", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T12:15:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_inject_health_dummy": "false", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T12:15:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_join_fs": "", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_journal_format": "1", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_create_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_export_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_import_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_journal_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_link_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_openc_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_rename_at": "0", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T12:15:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log_max_events": "-1", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log_max_segments": "128", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log_pause": "false", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log_segment_size": "0", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_completed_requests": "100000", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_export_size": "20971520", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_file_recover": "32", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_purge_files": "64", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_purge_ops": "8192", 2024-04-26T12:15:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_metrics_update_interval": "2", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_min_caps_per_client": "100", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_numa_node": "-1", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_op_history_duration": "600", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_op_history_size": "20", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T12:15:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_op_log_threshold": "5", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_ping_grace": "15", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_ping_interval": "5", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_recall_max_caps": "30000", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_replay_interval": "1.000000", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T12:15:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_root_ino_gid": "0", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_root_ino_uid": "0", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_shutdown_check": "0", 2024-04-26T12:15:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_skip_ino": "0", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_snap_min_uid": "0", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_snap_rstat": "false", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_symlink_recovery": "true", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_thrash_exports": "0", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_thrash_fragments": "0", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_tick_interval": "5.000000", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_valgrind_exit": "false", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_verify_backtrace": "1", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_verify_scatter": "false", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T12:15:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_wipe_sessions": "false", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool_debug": "false", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "memstore_page_set": "false", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "memstore_page_size": "65536", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_client_bytes": "134217728", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_client_messages": "512", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_disabled_modules": "", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T12:15:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_mds_messages": "128", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_mon_messages": "128", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_osd_messages": "8192", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_pool": "true", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_standby_modules": "true", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_stats_period": "5", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_stats_threshold": "5", 2024-04-26T12:15:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_tick_period": "2", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_allow_pool_delete": "true", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_bytes": "104857600", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T12:15:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T12:15:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_compact_on_start": "false", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_compact_on_trim": "true", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_cpu_threads": "4", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_data_avail_crit": "5", 2024-04-26T12:15:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_data_avail_warn": "5", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_dump_json": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_extra_checks": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T12:15:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_election_default_strategy": "1", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_election_timeout": "5.000000", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_enable_op_tracker": "true", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_fake_pool_delete": "false", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_force_quorum_join": "false", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_health_log_update_period": "5", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_health_max_detail": "50", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_health_to_clog": "true", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T12:15:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_host": "172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790],[v2:172.21.15.69:3302,v1:172.21.15.69:6791]", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_host_override": "", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_initial_members": "", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_lease": "5.000000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_log_full_interval": "50", 2024-04-26T12:15:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_log_max": "10000", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_log_max_summary": "50", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_log_epochs": "500", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_osd": "10000", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T12:15:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_memory_autotune": "true", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_memory_target": "2147483648", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mgr_digest_period": "5", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_op_complaint_time": "30", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_op_history_duration": "600", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_op_history_size": "20", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T12:15:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_op_log_threshold": "5", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_cache_size": "500", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T12:15:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T12:15:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_report_timeout": "900", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T12:15:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_reweight_max_osds": "4", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T12:15:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_scrub_interval": "86400", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_scrub_max_keys": "100", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_scrub_timeout": "300", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_session_timeout": "300", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_smart_report_timeout": "5", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_stretch_pool_size": "4", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_sync_debug": "false", 2024-04-26T12:15:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_tick_interval": "5", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T12:15:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_older_version": "true", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T12:15:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "monmap": "", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "motr_tracing_enabled": "false", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_op_threads": "3", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_cm": "false", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_device_name": "", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T12:15:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_sl": "3", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_rdma_type": "ib", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_async_reap_threshold": "5", 2024-04-26T12:15:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_before_connect": "false", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_ipv4": "true", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_ipv6": "false", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_msgr1": "true", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_msgr2": "true", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_port_max": "7568", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_port_min": "6800", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_retry_count": "3", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_bind_retry_delay": "5", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_blackhole_client": "false", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_blackhole_mds": "false", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_blackhole_mgr": "false", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_blackhole_mon": "false", 2024-04-26T12:15:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_blackhole_osd": "false", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_client_mode": "crc secure", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_cluster_type": "", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_compress_secure": "false", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_crc_data": "true", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_crc_header": "true", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_die_on_bug": "true", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_die_on_old_message": "true", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T12:15:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_hugepages": "", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_lro": "true", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_pmd": "", 2024-04-26T12:15:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_port_id": "0", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_dump_on_send": "false", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_inject_delay_type": "", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_inject_network_congestion": "0", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_inject_socket_failures": "0", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_max_accept_failures": "4", 2024-04-26T12:15:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_max_backoff": "15.000000", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_osd_compress_mode": "none", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_pq_min_cost": "65536", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_public_type": "", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_service_mode": "crc secure", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_tcp_nodelay": "true", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T12:15:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "ms_type": "async+posix", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "no_config_file": "false", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_inflight_ops": "1024", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter_timeout": "10.000000", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "objectstore_blackhole": "false", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "openssl_engine_opts": "", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T12:15:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_agent_max_ops": "4", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_agent_slop": "0.020000", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_asio_thread_count": "2", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_backfill_scan_max": "512", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_backfill_scan_min": "64", 2024-04-26T12:15:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_backoff_on_peering": "false", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_beacon_report_interval": "300", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bench_duration": "30", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_blkin_trace_all": "false", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T12:15:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_class_update_on_start": "true", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_client_message_cap": "256", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_client_op_priority": "63", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_client_watch_timeout": "30", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_command_max_records": "256", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_compact_on_start": "false", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_crush_update_on_start": "true", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T12:15:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_op_order": "false", 2024-04-26T12:15:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_shutdown": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T12:15:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_default_notify_timeout": "30", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_enable_op_tracker": "true", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T12:15:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_fast_info": "true", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_fast_shutdown": "true", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_function_tracing": "false", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_heartbeat_grace": "20", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_heartbeat_interval": "6", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T12:15:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_heartbeat_stale": "600", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_journal_size": "5120", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_kill_backfill_at": "0", 2024-04-26T12:15:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_map_cache_size": "50", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_map_dedup": "true", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_map_message_max": "40", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_attr_name_len": "100", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_attr_size": "0", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_backfills": "1", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_markdown_count": "5", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_markdown_period": "600", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_object_name_len": "2048", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_object_size": "134217728", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T12:15:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_pgls": "1024", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_push_cost": "8388608", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_push_objects": "10", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_scrubs": "3", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_max_write_size": "90", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T12:15:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_profile": "balanced", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T12:15:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_memory_base": "805306368", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_memory_target": "4294967296", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_memory_target_autotune": "false", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_min_recovery_priority": "0", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T12:15:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mon_report_interval": "5", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_num_cache_shards": "32", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_numa_node": "-1", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_objecter_finishers": "1", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_objectstore": "bluestore", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_objectstore_fuse": "false", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_objectstore_tracing": "false", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T12:15:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_history_duration": "600", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_history_size": "20", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_log_threshold": "5", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_num_shards": "0", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T12:15:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_op_thread_timeout": "15", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_open_classes_on_start": "true", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_os_flags": "0", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_peering_op_priority": "255", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_delete_priority": "5", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T12:15:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_crimson": "false", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T12:15:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_flags": "0", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_min_size": "0", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_size": "2", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_default_type": "replicated", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T12:15:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_cost": "20971520", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_max_active": "0", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_op_priority": "3", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T12:15:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_priority": "5", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_repair_during_recovery": "false", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T12:15:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_cost": "52428800", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_end_hour": "0", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T12:15:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_priority": "5", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_skip_data_digest": "false", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_smart_report_timeout": "5", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_snap_trim_priority": "5", 2024-04-26T12:15:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_target_transaction_size": "30", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T12:15:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_tracing": "false", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_use_stale_snap": "false", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_kill_at": "0", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_max_join_drift": "10", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_min": "500", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_min_wait": "0.050000", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_service_trim_max": "500", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T12:15:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_service_trim_min": "250", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_stash_full_interval": "25", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_trim_max": "500", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "paxos_trim_min": "250", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "perf": "true", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "public_addr": "-", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "public_addrv": "", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "public_bind_addr": "-", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "public_network": "", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "public_network_interface": "", 2024-04-26T12:15:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "qat_compressor_enabled": "false", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rados_mon_op_timeout": "0", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rados_osd_op_timeout": "0", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rados_tracing": "false", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_atime_update_interval": "60", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache": "true", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T12:15:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_policy": "writearound", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_size": "33554432", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_compression_hint": "none", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_clone_format": "auto", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_data_pool": "", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_features": "61", 2024-04-26T12:15:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_format": "2", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_map_options": "", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_order": "22", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_pool": "rbd", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_stripe_count": "0", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_io_scheduler": "simple", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T12:15:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_order": "24", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_pool": "", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_journal_splay_width": "4", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T12:15:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T12:15:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T12:15:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_op_threads": "1", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_plugins": "", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T12:15:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T12:15:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_tracing": "false", 2024-04-26T12:15:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_validate_names": "true", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_validate_pool": "true", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "restapi_base_url": "", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "restapi_log_level": "", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_admin_entry": "admin", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_backend_store": "rados", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_barbican_url": "", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_beast_enable_async": "true", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T12:15:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_cache_enabled": "true", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_config_store": "rados", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_content_length_compat": "false", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T12:15:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_cross_domain_policy": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T12:15:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T12:15:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T12:15:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T12:15:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data_log_window": "30", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T12:15:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dns_name": "", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dns_s3website_name": "", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T12:15:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enable_ops_log": "false", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enable_static_website": "false", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enable_usage_log": "false", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_expose_bucket": "false", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_extended_http_attrs": "", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_filter": "none", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T12:15:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_max_objs": "32", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_init_timeout": "300", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T12:15:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_password": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_project": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_token": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_admin_user": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_api_version": "2", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T12:15:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_url": "", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lc_max_objs": "32", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lc_max_worker": "3", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T12:15:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_log_http_headers": "", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T12:15:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_attr_size": "0", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_listing_results": "1000", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_notify_retries": "10", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T12:15:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T12:15:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_num_control_oids": "8", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_numa_node": "-1", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T12:15:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_op_tracing": "false", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_opa_token": "", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_opa_url": "", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T12:15:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ops_log_rados": "false", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_print_continue": "true", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T12:15:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_rados_tracing": "false", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_realm": "", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_realm_id": "", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_region": "", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_request_uri": "", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T12:15:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_resolve_cname": "false", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_run_sync_thread": "true", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T12:15:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_script_uri": "", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_service_provider_name": "", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sts_client_id": "", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sts_client_secret": "", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sts_entry": "sts", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sts_key": "sts", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T12:15:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_auth_url": "", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_custom_header": "", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_need_stats": "true", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_tenant_name": "", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_url": "", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_lease_period": "120", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T12:15:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_thread_pool_size": "512", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_torrent_comment": "", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_torrent_createby": "", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_torrent_encoding": "", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_torrent_flag": "false", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_torrent_origin": "", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_torrent_tracker": "", 2024-04-26T12:15:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_usage_max_shards": "32", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_use_opa_authz": "false", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T12:15:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_user_unique_email": "true", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_verify_ssl": "true", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_zone": "", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_zone_id": "", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_zonegroup": "", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_zonegroup_id": "", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_block_size": "4096", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T12:15:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T12:15:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_partition_filters": "false", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_perf": "false", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "run_dir": "/var/run/ceph", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_block_create": "true", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_device_size": "53687091200", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T12:15:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_main_device_type": "SSD", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "seastore_segment_size": "67108864", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "set_keepcaps": "false", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "setgroup": "", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "setuser": "", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "setuser_match_path": "", 2024-04-26T12:15:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T12:15:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "thp": "false", 2024-04-26T12:15:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "threadpool_default_timeout": "60", 2024-04-26T12:15:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T12:15:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "throttler_perf_counter": "true" 2024-04-26T12:15:01.848 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-26T12:15:01.850 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T12:15:01.959 INFO:teuthology.orchestra.run.smithi069.stdout:mon.a: {} 2024-04-26T12:15:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:15:01.967 INFO:teuthology.orchestra.run.smithi069.stdout:mon.b: {} 2024-04-26T12:15:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:15:01.976 INFO:teuthology.orchestra.run.smithi069.stdout:mon.c: {} 2024-04-26T12:15:01.976 INFO:teuthology.orchestra.run.smithi069.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:15:01.987 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T12:15:01.987 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-26T12:15:01.998 INFO:tasks.radosbench:Beginning radosbench... 2024-04-26T12:15:01.998 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-26T12:15:01.999 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-26T12:15:01.999 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T12:15:01.999 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:15:01.999 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:15:02.000 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-26T12:15:02.000 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:15:02.000 INFO:teuthology.orchestra.console.smithi113:Power off 2024-04-26T12:15:02.000 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T12:15:02.008 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T12:15:02.009 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T12:15:02.010 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:02.010 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T12:15:02.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:02.011 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T12:15:02.011 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:15:02.013 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:02.008+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:02.023 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-04-26T12:15:02.023 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:15:02.047 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-26T12:15:02.112 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.110+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:02.125 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:02.125 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:02.126 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-04-26T12:15:02.126 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:02.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:02.143 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:02.143 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:02.161 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1: {} 2024-04-26T12:15:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:15:02.179 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:02.179 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:02.212 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.211+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:02.237 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:02.237 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:02.246 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:02.313 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.312+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:02.347 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:02.347 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:02.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:02.413 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.412+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:02.470 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:02.470 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:02.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:02.521 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.520+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:02.615 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.613+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:02.624 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:02.625 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:02.634 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:02.642 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'unique_pool_0' created 2024-04-26T12:15:02.642 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:15:02.657 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-26T12:15:02.718 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.717+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:02.776 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:02.776 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:02.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:02.828 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:02.827+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:02.889 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:02.889 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:02.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:02.917 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:02.916+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:03.018 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:03.016+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:03.040 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.040 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:03.133 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:03.132+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:03.189 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.189 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:03.242 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:03.241+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:03.301 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.301 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:03.320 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:03.319+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:03.421 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:03.420+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:03.451 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.451 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.460 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:03.544 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:03.543+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:03.601 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.601 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:03.645 INFO:teuthology.orchestra.run.smithi069.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-26T12:15:03.656 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:03.655+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:03.717 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.717 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.724 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:03.723+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:03.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:03.825 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:03.825+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:03.867 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.867 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:03.927 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:03.925+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:03.977 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:03.977 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:03.985 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:04.028 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:04.026+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:04.088 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:04.088 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:04.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:04.141 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:04.140+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:04.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:04.197 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:04.198 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:04.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:04.247 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:04.246+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:04.319 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:04.330 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:04.329+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:04.337 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1: {} 2024-04-26T12:15:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:15:04.348 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:04.348 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:04.353 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:04.353 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:04.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:04.432 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:04.430+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:04.458 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-04-26T12:15:04.459 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:04.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:04.532 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:04.531+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:04.568 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:04.568 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:04.568 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:04.568 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:04.568 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:04.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:04.657 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:15:04.660 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:04.659+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:04.662 DEBUG:teuthology.orchestra.run.smithi069:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-26T12:15:04.703 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-26T12:15:04.717 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-26T12:15:04.717 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.85689722, 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012842965, 2024-04-26T12:15:04.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860604+0000", 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860616+0000", 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-05 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860628+0000", 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860640+0000", 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1948e-05 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861144+0000", 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050421799999999996 2024-04-26T12:15:04.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861294+0000", 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149741 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861573+0000", 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027888300000000001 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:04.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865700+0000", 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041267869999999998 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873353+0000", 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076533549999999997 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873408+0000", 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4724e-05 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873449+0000", 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1130000000000001e-05 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.856758627000001, 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012872916, 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860751+0000", 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4989999999999997e-06 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860766+0000", 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5277999999999998e-05 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860777+0000", 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862196+0000", 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014194749999999999 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862357+0000", 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016099300000000001 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862626+0000", 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026869399999999999 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865793+0000", 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003167076 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873525+0000", 2024-04-26T12:15:04.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077318420000000001 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873574+0000", 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9444999999999998e-05 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873617+0000", 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3034000000000002e-05 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.856719737999999, 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011713941, 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860787+0000", 2024-04-26T12:15:04.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000002e-06 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860798+0000", 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0766e-05 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860807+0000", 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.081e-06 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862318+0000", 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015111739999999999 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862596+0000", 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027813799999999999 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862721+0000", 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425700000000001 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865738+0000", 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003017619 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872418+0000", 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066796609999999999 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872471+0000", 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3251000000000002e-05 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872497+0000", 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6071000000000002e-05 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.856546122000001, 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011656498, 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860956+0000", 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860964+0000", 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9489999999999996e-06 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860977+0000", 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3159999999999999e-05 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860988+0000", 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863879+0000", 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028914019999999999 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863983+0000", 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103947 2024-04-26T12:15:04.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864216+0000", 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023310400000000001 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866761+0000", 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025451940000000002 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872568+0000", 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058070329999999996 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872595+0000", 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6821999999999998e-05 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872613+0000", 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8343999999999999e-05 2024-04-26T12:15:04.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.856508813000001, 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012981602, 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860998+0000", 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1760000000000003e-06 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861005+0000", 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861013+0000", 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-06 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864442+0000", 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034288909999999999 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864579+0000", 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013655000000000001 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864726+0000", 2024-04-26T12:15:04.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146821 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867844+0000", 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031183880000000001 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873900+0000", 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060559790000000004 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873940+0000", 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9626999999999999e-05 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873976+0000", 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6327e-05 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:04.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.856483303000001, 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012198451000000001, 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861019+0000", 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861023+0000", 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861030+0000", 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861036+0000", 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5430000000000001e-06 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861491+0000", 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000455606 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861725+0000", 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023400100000000001 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861842+0000", 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116717 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866171+0000", 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043294830000000003 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873128+0000", 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069568080000000001 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873180+0000", 2024-04-26T12:15:04.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1792999999999997e-05 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873218+0000", 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:04.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.856050137, 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012135589, 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861452+0000", 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861458+0000", 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3740000000000003e-06 2024-04-26T12:15:04.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861469+0000", 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0251999999999999e-05 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861477+0000", 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862181+0000", 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070414999999999996 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862298+0000", 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011689899999999999 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873589+0000", 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011290432 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.856017199, 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012630707999999999, 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861485+0000", 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861488+0000", 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861495+0000", 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861501+0000", 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-04-26T12:15:04.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865278+0000", 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037777829999999998 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865405+0000", 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012616999999999999 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874117+0000", 2024-04-26T12:15:04.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087119399999999996 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861507+0000", 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.855996241, 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005406073, 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861507+0000", 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861507+0000", 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861506+0000", 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861517+0000", 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0572e-05 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861525+0000", 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861551+0000", 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6543e-05 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861636+0000", 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4727000000000004e-05 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861821+0000", 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018506600000000001 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866913+0000", 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050917180000000003 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(mds.0.3:30 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.864491+0000", 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.853012021000001, 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030151739999999998, 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864491+0000", 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864491+0000", 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864491+0000", 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864514+0000", 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3144000000000001e-05 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864523+0000", 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2180000000000005e-06 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864541+0000", 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7626e-05 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864881+0000", 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034066899999999999 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864933+0000", 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1873000000000003e-05 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867267+0000", 2024-04-26T12:15:04.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023338130000000001 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867506+0000", 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023912400000000001 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.866028+0000", 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.851474987, 2024-04-26T12:15:04.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002555398, 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866028+0000", 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866028+0000", 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866027+0000", 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866034+0000", 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6619999999999999e-06 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866045+0000", 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0618999999999999e-05 2024-04-26T12:15:04.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866053+0000", 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0509999999999997e-06 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866089+0000", 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6721000000000003e-05 2024-04-26T12:15:04.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866112+0000", 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3118000000000001e-05 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.868555+0000", 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024422960000000001 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.868583+0000", 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8680999999999999e-05 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.866309+0000", 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.851193722000001, 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022064060000000002, 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866309+0000", 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866309+0000", 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866309+0000", 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866317+0000", 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866330+0000", 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3018e-05 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866343+0000", 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2892e-05 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866559+0000", 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021646799999999999 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.868516+0000", 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001956401 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 2 lcod 14'1)", 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.866638+0000", 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.850864994999998, 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028088800000000003, 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866638+0000", 2024-04-26T12:15:04.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866638+0000", 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866637+0000", 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866642+0000", 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6829999999999999e-06 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866655+0000", 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3393999999999999e-05 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866663+0000", 2024-04-26T12:15:04.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0670000000000003e-06 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866804+0000", 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000141686 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866919+0000", 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114707 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.871230+0000", 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.846272843000001, 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001632524, 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871230+0000", 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871230+0000", 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871230+0000", 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871241+0000", 2024-04-26T12:15:04.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1175999999999999e-05 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871248+0000", 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871257+0000", 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9609999999999994e-06 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871317+0000", 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9735999999999999e-05 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871334+0000", 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7452000000000002e-05 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872825+0000", 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001490896 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872863+0000", 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7827999999999998e-05 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.871491+0000", 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.846011728000001, 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001405066, 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871491+0000", 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871491+0000", 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871491+0000", 2024-04-26T12:15:04.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871501+0000", 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0259e-05 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871510+0000", 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4009999999999997e-06 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871528+0000", 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8726e-05 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871629+0000", 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010085 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.871653+0000", 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3490999999999999e-05 2024-04-26T12:15:04.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872867+0000", 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012143060000000001 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872896+0000", 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9385000000000001e-05 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.873195+0000", 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.844307887999999, 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000267259, 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873195+0000", 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873195+0000", 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873195+0000", 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873197+0000", 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873205+0000", 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1389999999999998e-06 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873222+0000", 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7467999999999999e-05 2024-04-26T12:15:04.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873338+0000", 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011601 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873346+0000", 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3899999999999993e-06 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873462+0000", 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011602199999999999 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.873356+0000", 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.844146945999999, 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027616799999999998, 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873356+0000", 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873356+0000", 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873356+0000", 2024-04-26T12:15:04.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873360+0000", 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9020000000000001e-06 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873367+0000", 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8269999999999998e-06 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873387+0000", 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0064999999999998e-05 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873510+0000", 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012270200000000001 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873519+0000", 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0310000000000004e-06 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873632+0000", 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113056 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.873933+0000", 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.843570331999999, 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019466700000000001, 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:15:04.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873933+0000", 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873933+0000", 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873933+0000", 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967296 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873934+0000", 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3030000000000001e-06 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873938+0000", 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873950+0000", 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1782e-05 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874010+0000", 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0557000000000003e-05 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874127+0000", 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117037 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:48.316221+0000", 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.401282101, 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001785935, 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316221+0000", 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316221+0000", 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316219+0000", 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999976 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316232+0000", 2024-04-26T12:15:04.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3322999999999999e-05 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316263+0000", 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0998999999999999e-05 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316284+0000", 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0699e-05 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316413+0000", 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949700000000001 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316625+0000", 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021176100000000001 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.316737+0000", 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112038 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:04.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317366+0000", 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062890099999999996 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317935+0000", 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056902999999999999 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317980+0000", 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5042e-05 2024-04-26T12:15:04.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.318007+0000", 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7055000000000001e-05 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e15/12 ondisk, result = 0)", 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:48.317828+0000", 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.399674802, 2024-04-26T12:15:04.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018582599999999999, 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317828+0000", 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317828+0000", 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:04.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317827+0000", 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317833+0000", 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4110000000000004e-06 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317846+0000", 2024-04-26T12:15:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3521e-05 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317855+0000", 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6889999999999993e-06 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317925+0000", 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9732000000000003e-05 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.317931+0000", 2024-04-26T12:15:04.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:48.318014+0000", 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2863999999999998e-05 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:04.814 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:04.817 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:hints = 1 2024-04-26T12:15:04.817 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-26T12:15:04.817 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Object prefix: benchmark_data_smithi069_31227 2024-04-26T12:15:04.817 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T12:15:04.817 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 0 0 0 0 0 0 - 0 2024-04-26T12:15:04.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:04.818 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:04.814+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:04.916 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:04.915+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:04.963 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1210 5.8 5:1580734d:::benchmark_data_smithi069_31227_object1209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.959801+0000", 2024-04-26T12:15:04.963 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001677343, 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017036519999999999, 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1210 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959801+0000", 2024-04-26T12:15:04.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959801+0000", 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959800+0000", 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:04.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959824+0000", 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3618999999999999e-05 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959832+0000", 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.551e-06 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959837+0000", 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8010000000000003e-06 2024-04-26T12:15:04.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959874+0000", 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6641999999999999e-05 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959993+0000", 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011916 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960116+0000", 2024-04-26T12:15:04.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012328799999999999 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960702+0000", 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00058528699999999998 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961435+0000", 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00073313800000000004 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:04.968 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1211 5.d 5:b5dfe5db:::benchmark_data_smithi069_31227_object1210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.959845+0000", 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016331329999999999, 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017638420000000001, 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.969 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1211 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959845+0000", 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959845+0000", 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959844+0000", 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959879+0000", 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4298999999999998e-05 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959884+0000", 2024-04-26T12:15:04.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7299999999999996e-06 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959888+0000", 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.561e-06 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959922+0000", 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3639000000000001e-05 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960033+0000", 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110838 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960124+0000", 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1257999999999999e-05 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960737+0000", 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00061295299999999996 2024-04-26T12:15:04.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961281+0000", 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00054378 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1212 5.0 5:08598f3f:::benchmark_data_smithi069_31227_object1211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.959894+0000", 2024-04-26T12:15:04.974 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001583845, 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018118990000000001, 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1212 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959894+0000", 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959894+0000", 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959894+0000", 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959922+0000", 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8226999999999999e-05 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959937+0000", 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4902999999999999e-05 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959943+0000", 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6679999999999998e-06 2024-04-26T12:15:04.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.959982+0000", 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960093+0000", 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111087 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:04.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960238+0000", 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014535500000000001 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960892+0000", 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00065346800000000004 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1214 5.e 5:71079de6:::benchmark_data_smithi069_31227_object1213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.960057+0000", 2024-04-26T12:15:04.979 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014213240000000001, 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001732157, 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1214 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960057+0000", 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960057+0000", 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960056+0000", 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960164+0000", 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108261 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960172+0000", 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8329999999999994e-06 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960179+0000", 2024-04-26T12:15:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9829999999999999e-06 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960225+0000", 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5911000000000001e-05 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960331+0000", 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105549 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960454+0000", 2024-04-26T12:15:04.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012295399999999999 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961157+0000", 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070385300000000005 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1219 5.b 5:d0b14f23:::benchmark_data_smithi069_31227_object1218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.960462+0000", 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001015892, 2024-04-26T12:15:04.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001410517, 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1219 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960462+0000", 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960462+0000", 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960461+0000", 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960540+0000", 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8382999999999998e-05 2024-04-26T12:15:04.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960550+0000", 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0145e-05 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960557+0000", 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0010000000000004e-06 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:04.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960602+0000", 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5401999999999997e-05 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960735+0000", 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132502 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960856+0000", 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012087999999999999 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1221 5.4 5:2621beca:::benchmark_data_smithi069_31227_object1220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.960714+0000", 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00076404000000000001, 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00124142, 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1221 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960714+0000", 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960714+0000", 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960713+0000", 2024-04-26T12:15:04.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960786+0000", 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2961999999999997e-05 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960796+0000", 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960802+0000", 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3130000000000004e-06 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960836+0000", 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3757999999999998e-05 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960947+0000", 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110788 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961065+0000", 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118415 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961649+0000", 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00058378 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1222 5.0 5:04d7e138:::benchmark_data_smithi069_31227_object1221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.960898+0000", 2024-04-26T12:15:04.993 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00058058899999999995, 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011383599999999999, 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1222 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960898+0000", 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960898+0000", 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960897+0000", 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960991+0000", 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3716999999999997e-05 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.960999+0000", 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6109999999999994e-06 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961006+0000", 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4930000000000003e-06 2024-04-26T12:15:04.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961041+0000", 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5126000000000002e-05 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961304+0000", 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000263558 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:04.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961435+0000", 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130331 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1223 5.e 5:7accb88e:::benchmark_data_smithi069_31227_object1222:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.961095+0000", 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000383569, 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00099427000000000001, 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:04.998 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1223 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961095+0000", 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:04.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961095+0000", 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961094+0000", 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961146+0000", 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2275999999999999e-05 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961157+0000", 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0348e-05 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961163+0000", 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2659999999999998e-06 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961220+0000", 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7624000000000003e-05 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961327+0000", 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010602700000000001 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961449+0000", 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012207299999999999 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1224 5.b 5:de54808e:::benchmark_data_smithi069_31227_object1223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.002 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.961268+0000", 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00021008499999999999, 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00086812, 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1224 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961268+0000", 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961268+0000", 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961267+0000", 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961299+0000", 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1297000000000002e-05 2024-04-26T12:15:05.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961307+0000", 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0539999999999995e-06 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961313+0000", 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7189999999999998e-06 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961350+0000", 2024-04-26T12:15:05.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7045000000000002e-05 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961478+0000", 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128467 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961608+0000", 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012989300000000001 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:1225 5.d 5:b11150e5:::benchmark_data_smithi069_31227_object1224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.961861+0000", 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996171, 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034610499999999998, 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 1225 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.007 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961861+0000", 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961861+0000", 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961860+0000", 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961889+0000", 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9067000000000001e-05 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961900+0000", 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0733e-05 2024-04-26T12:15:05.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961907+0000", 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8480000000000003e-06 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961946+0000", 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8872000000000003e-05 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.962051+0000", 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104798 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.962179+0000", 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012854699999999999 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:1218 5.9 e18/16 5:90700662:::benchmark_data_smithi069_31227_object1217:head v 18'76, mlcod=18'73)", 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.961924+0000", 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995546, 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00034518400000000001, 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961924+0000", 2024-04-26T12:15:05.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961924+0000", 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961923+0000", 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961953+0000", 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0221000000000001e-05 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961961+0000", 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2230000000000001e-06 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.961971+0000", 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0599e-05 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.962004+0000", 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2617999999999998e-05 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.962020+0000", 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6458999999999999e-05 2024-04-26T12:15:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.016 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.016 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.016 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.016 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:05.016 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-26T12:15:05.016 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:05.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:05.018 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.016+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.118 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.117+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.201 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:05.202 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:05.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:05.254 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.253+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.320 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:05.318+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.971022+0000", 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.426260070000001, 2024-04-26T12:15:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059784299999999999, 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971022+0000", 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971022+0000", 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971022+0000", 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971079+0000", 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7420999999999998e-05 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971086+0000", 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8539999999999999e-06 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971092+0000", 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9089999999999997e-06 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971118+0000", 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5979999999999999e-05 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971130+0000", 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2527999999999999e-05 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.976971+0000", 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058406639999999998 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.977001+0000", 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9464000000000001e-05 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.425612233999999, 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082564849999999992, 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.405 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971669+0000", 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971676+0000", 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5390000000000004e-06 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971686+0000", 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8409999999999995e-06 2024-04-26T12:15:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971690+0000", 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4580000000000003e-06 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974072+0000", 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023813910000000001 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974091+0000", 2024-04-26T12:15:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9655000000000001e-05 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979896+0000", 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058048279999999997 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979926+0000", 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0371000000000001e-05 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'145)", 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.425238369999999, 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078962200000000007, 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972043+0000", 2024-04-26T12:15:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972050+0000", 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9249999999999998e-06 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972060+0000", 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0108999999999999e-05 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972065+0000", 2024-04-26T12:15:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974396+0000", 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002331058 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974416+0000", 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9749e-05 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979929+0000", 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055127910000000004 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979940+0000", 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1552000000000001e-05 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-26T12:15:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.424789304000001, 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074578040000000002, 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972487+0000", 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999943 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972537+0000", 2024-04-26T12:15:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972563+0000", 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5165999999999999e-05 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972575+0000", 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2164000000000001e-05 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974676+0000", 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002101407 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974696+0000", 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9568e-05 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979941+0000", 2024-04-26T12:15:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052450880000000002 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979951+0000", 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.973519+0000", 2024-04-26T12:15:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.423763580999999, 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00644241, 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973519+0000", 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973519+0000", 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973512+0000", 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999938 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973529+0000", 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7047000000000001e-05 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973554+0000", 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4888999999999998e-05 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973566+0000", 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.137e-05 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.975266+0000", 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001700027 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.975278+0000", 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2704000000000001e-05 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979951+0000", 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046729700000000002 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979961+0000", 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.537617085000001, 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014073476999999999, 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859663+0000", 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859674+0000", 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0736e-05 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859689+0000", 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5318000000000001e-05 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859702+0000", 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2091e-05 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862268+0000", 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025663650000000001 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862403+0000", 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134812 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862516+0000", 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011333299999999999 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866182+0000", 2024-04-26T12:15:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003666019 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873647+0000", 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074652499999999997 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873699+0000", 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1894999999999997e-05 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873739+0000", 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9360999999999998e-05 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.537112775000001, 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013691603, 2024-04-26T12:15:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860176+0000", 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7719999999999994e-06 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860187+0000", 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0922e-05 2024-04-26T12:15:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860238+0000", 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1189000000000001e-05 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862855+0000", 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026161460000000002 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862933+0000", 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8714999999999994e-05 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863088+0000", 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154902 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866289+0000", 2024-04-26T12:15:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032008169999999999 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873783+0000", 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074935100000000001 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873829+0000", 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6181999999999999e-05 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873861+0000", 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2320000000000002e-05 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.536397525000002, 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013456986000000001, 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860884+0000", 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860891+0000", 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9120000000000001e-06 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860900+0000", 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1980000000000007e-06 2024-04-26T12:15:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860953+0000", 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3451e-05 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863286+0000", 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023325360000000001 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863386+0000", 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100498 2024-04-26T12:15:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863481+0000", 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4388000000000005e-05 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866407+0000", 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029256899999999999 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874251+0000", 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078446680000000008 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874299+0000", 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8154e-05 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874342+0000", 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2330999999999998e-05 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.535809506, 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013022891999999999, 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861472+0000", 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861481+0000", 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7339999999999997e-06 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861494+0000", 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2826999999999999e-05 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861502+0000", 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863795+0000", 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002292845 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863844+0000", 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9531999999999999e-05 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863938+0000", 2024-04-26T12:15:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3962999999999995e-05 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869387+0000", 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054482080000000004 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874431+0000", 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050444599999999997 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874472+0000", 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0717000000000003e-05 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874496+0000", 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3836999999999999e-05 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.535773396, 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012184309000000001, 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861508+0000", 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861512+0000", 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9299999999999996e-06 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861552+0000", 2024-04-26T12:15:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9684999999999997e-05 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861559+0000", 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8499999999999996e-06 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861620+0000", 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1048000000000002e-05 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861781+0000", 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000161075 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861951+0000", 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170447 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864200+0000", 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002248758 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873592+0000", 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093917219999999999 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873643+0000", 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1413999999999999e-05 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873693+0000", 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0099000000000003e-05 2024-04-26T12:15:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.535702015999998, 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01226267, 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861579+0000", 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861585+0000", 2024-04-26T12:15:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4160000000000003e-06 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861591+0000", 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5980000000000002e-06 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861598+0000", 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5080000000000002e-06 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862487+0000", 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088919800000000001 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862578+0000", 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0879999999999997e-05 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862715+0000", 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013701699999999999 2024-04-26T12:15:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866365+0000", 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036497589999999998 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873759+0000", 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073938679999999996 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873810+0000", 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0958999999999998e-05 2024-04-26T12:15:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873843+0000", 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3232000000000003e-05 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.535663271000001, 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012846606999999999, 2024-04-26T12:15:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861618+0000", 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861626+0000", 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7829999999999999e-06 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861634+0000", 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7170000000000008e-06 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861639+0000", 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864257+0000", 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002617308 2024-04-26T12:15:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864354+0000", 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7211000000000002e-05 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864457+0000", 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010295599999999999 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869597+0000", 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051396849999999997 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874383+0000", 2024-04-26T12:15:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004786106 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874435+0000", 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2473999999999999e-05 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874466+0000", 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0485e-05 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.535632777, 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012237605, 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861652+0000", 2024-04-26T12:15:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0709999999999999e-06 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861670+0000", 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7694999999999999e-05 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861677+0000", 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9109999999999993e-06 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862368+0000", 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069049699999999999 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863241+0000", 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00087347900000000003 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873887+0000", 2024-04-26T12:15:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010645635000000001 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.535093494000002, 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074800040000000002, 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862188+0000", 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862200+0000", 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2529e-05 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862212+0000", 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2079000000000001e-05 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862222+0000", 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862495+0000", 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027301499999999999 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862602+0000", 2024-04-26T12:15:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106858 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869669+0000", 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007066658 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(mds.0.3:13 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'8, mlcod=14'3)", 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.875120+0000", 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.522162208000001, 2024-04-26T12:15:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059489169999999997, 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875120+0000", 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875120+0000", 2024-04-26T12:15:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875119+0000", 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875124+0000", 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8080000000000004e-06 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875132+0000", 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875137+0000", 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6659999999999999e-06 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875174+0000", 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6789999999999998e-05 2024-04-26T12:15:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.875192+0000", 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8372e-05 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.881045+0000", 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058527639999999999 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.881069+0000", 2024-04-26T12:15:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4023999999999999e-05 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:550 5.e 5:78015471:::benchmark_data_smithi069_31227_object549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.844981+0000", 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.55230116600000001, 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057379390000000001, 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 550 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.844981+0000", 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.844981+0000", 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.844980+0000", 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.845045+0000", 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5289000000000005e-05 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.845055+0000", 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3980000000000005e-06 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.845061+0000", 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5309999999999998e-06 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.845097+0000", 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5361999999999998e-05 2024-04-26T12:15:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.845198+0000", 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010195400000000001 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.845309+0000", 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110511 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.846172+0000", 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00086344600000000003 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.850640+0000", 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044677629999999996 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.850678+0000", 2024-04-26T12:15:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8139000000000002e-05 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.850719+0000", 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0658999999999998e-05 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:565 5.d 5:bcd1abf0:::benchmark_data_smithi069_31227_object564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.848169+0000", 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.54911339199999998, 2024-04-26T12:15:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005738707, 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 565 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848169+0000", 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848169+0000", 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848168+0000", 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848246+0000", 2024-04-26T12:15:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8401999999999999e-05 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848258+0000", 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1378e-05 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848267+0000", 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0589999999999992e-06 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848311+0000", 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4261000000000002e-05 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848409+0000", 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7664000000000005e-05 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.848539+0000", 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130321 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.850522+0000", 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001983112 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853846+0000", 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033235019999999999 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853881+0000", 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5639999999999998e-05 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853908+0000", 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6258000000000002e-05 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:578 5.d 5:b05a7faf:::benchmark_data_smithi069_31227_object577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.851262+0000", 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.54602034899999996, 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006862969, 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 578 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851262+0000", 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851262+0000", 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851261+0000", 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851392+0000", 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130841 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851439+0000", 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6424999999999997e-05 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851446+0000", 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0439999999999998e-06 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851483+0000", 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7259999999999999e-05 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851589+0000", 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105648 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851710+0000", 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121508 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853974+0000", 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022639079999999998 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858085+0000", 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041105940000000004 2024-04-26T12:15:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858107+0000", 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2869000000000001e-05 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858125+0000", 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7418000000000002e-05 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:580 5.d 5:b5307ae6:::benchmark_data_smithi069_31227_object579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.54576107500000004, 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066795320000000002, 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 580 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851597+0000", 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6674999999999993e-05 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851605+0000", 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6490000000000008e-06 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851610+0000", 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5300000000000004e-06 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852135+0000", 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00052503200000000004 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852245+0000", 2024-04-26T12:15:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109936 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852381+0000", 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013573599999999999 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853977+0000", 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015957460000000001 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858157+0000", 2024-04-26T12:15:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041796200000000002 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858182+0000", 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5729999999999999e-05 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858201+0000", 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8448999999999999e-05 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:585 5.d 5:b6162cef:::benchmark_data_smithi069_31227_object584:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.852533+0000", 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.54474882400000002, 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005722731, 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 585 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852533+0000", 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852533+0000", 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852532+0000", 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852554+0000", 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1313000000000001e-05 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852562+0000", 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9160000000000001e-06 2024-04-26T12:15:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852567+0000", 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3000000000000001e-06 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852682+0000", 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114851 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852757+0000", 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5247000000000006e-05 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852837+0000", 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0340999999999995e-05 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853979+0000", 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001141534 2024-04-26T12:15:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858219+0000", 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042403939999999998 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858241+0000", 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1758000000000001e-05 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858256+0000", 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5097e-05 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:05.511 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:05.513 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.511+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:05.613 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.612+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.662 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:15:05.678 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5350 5.5 5:aaaff4d3:::benchmark_data_smithi069_31227_object5349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.660679+0000", 2024-04-26T12:15:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015780788, 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015800972999999999, 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5350 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660679+0000", 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660679+0000", 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660679+0000", 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660704+0000", 2024-04-26T12:15:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5428000000000001e-05 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660712+0000", 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1529999999999997e-06 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660718+0000", 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4709999999999998e-06 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660876+0000", 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015803400000000001 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660981+0000", 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010526699999999999 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661105+0000", 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124158 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662040+0000", 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093538900000000001 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.666442+0000", 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044011390000000001 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.666449+0000", 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1749999999999999e-06 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5356 5.3 5:c910de2a:::benchmark_data_smithi069_31227_object5355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.661847+0000", 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01461323, 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014688247999999999, 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5356 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661847+0000", 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661847+0000", 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661846+0000", 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661871+0000", 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5119000000000001e-05 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661880+0000", 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2250000000000006e-06 2024-04-26T12:15:05.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661887+0000", 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662068+0000", 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018158599999999999 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662174+0000", 2024-04-26T12:15:05.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105634 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662294+0000", 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012005100000000001 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673636+0000", 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011341982 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673644+0000", 2024-04-26T12:15:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5333 5.2 5.44becfe2 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.667019+0000", 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0094405229999999993, 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095581290000000003, 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5333 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667019+0000", 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667019+0000", 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667018+0000", 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667136+0000", 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011797400000000001 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668005+0000", 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00086812800000000002 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668013+0000", 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8529999999999998e-06 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672456+0000", 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044424119999999997 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672757+0000", 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030120499999999997 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5347 5.2 5.92850f82 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.668023+0000", 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0084370650000000005, 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085882319999999995, 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5347 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668023+0000", 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668023+0000", 2024-04-26T12:15:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668022+0000", 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668063+0000", 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0991000000000001e-05 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668072+0000", 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0159999999999997e-06 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668077+0000", 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0599999999999998e-06 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672779+0000", 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047021379999999998 2024-04-26T12:15:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672786+0000", 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9190000000000002e-06 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5358 5.7 5.d972eba7 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.668083+0000", 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0083774169999999998, 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085608909999999993, 2024-04-26T12:15:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5358 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668083+0000", 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668083+0000", 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668082+0000", 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668114+0000", 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1714999999999997e-05 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668121+0000", 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8650000000000003e-06 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668126+0000", 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0599999999999998e-06 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668159+0000", 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3674999999999999e-05 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668166+0000", 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.353e-06 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5359 5.1 5.e220f211 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.668177+0000", 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0082825350000000006, 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084984680000000003, 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5359 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668177+0000", 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668177+0000", 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668177+0000", 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668221+0000", 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4484999999999998e-05 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668228+0000", 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0430000000000002e-06 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668233+0000", 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0200000000000002e-06 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668271+0000", 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7206999999999998e-05 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668277+0000", 2024-04-26T12:15:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6290000000000004e-06 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5360 5.7 5.d906b077 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.668244+0000", 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0082156460000000001, 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084636260000000001, 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5360 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668244+0000", 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668244+0000", 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668244+0000", 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668270+0000", 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6307000000000001e-05 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668277+0000", 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8070000000000002e-06 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668281+0000", 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5519999999999998e-06 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668311+0000", 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9901000000000001e-05 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668317+0000", 2024-04-26T12:15:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4670000000000003e-06 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5362 5.5 5.ce16d685 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.670888+0000", 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0055716660000000003, 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058592160000000004, 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5362 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670888+0000", 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670888+0000", 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670887+0000", 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670955+0000", 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7209e-05 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670966+0000", 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1072e-05 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.671525+0000", 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055889500000000001 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.671580+0000", 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4954000000000003e-05 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.671587+0000", 2024-04-26T12:15:05.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3019999999999997e-06 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5366 5.c 5.bd8034ec (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.672524+0000", 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039358680000000004, 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042865179999999996, 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5366 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672524+0000", 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672524+0000", 2024-04-26T12:15:05.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672523+0000", 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672580+0000", 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6045999999999998e-05 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672758+0000", 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000178374 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672766+0000", 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0299999999999994e-06 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672804+0000", 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7682000000000003e-05 2024-04-26T12:15:05.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672811+0000", 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.396e-06 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5369 5.a 5:5a760bec:::benchmark_data_smithi069_31227_object5368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.674169+0000", 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022910349999999999, 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027052320000000001, 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5369 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674169+0000", 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674169+0000", 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674168+0000", 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674236+0000", 2024-04-26T12:15:05.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7924999999999998e-05 2024-04-26T12:15:05.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674246+0000", 2024-04-26T12:15:05.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674253+0000", 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6769999999999998e-06 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674281+0000", 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8319000000000001e-05 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674377+0000", 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674477+0000", 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9495999999999997e-05 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.675048+0000", 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057127199999999995 2024-04-26T12:15:05.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676824+0000", 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017759500000000001 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676856+0000", 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2033000000000003e-05 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5371 5.6 5.8cfaf946 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.674633+0000", 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001826902, 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023004050000000002, 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5371 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674633+0000", 2024-04-26T12:15:05.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674633+0000", 2024-04-26T12:15:05.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674633+0000", 2024-04-26T12:15:05.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674691+0000", 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8434000000000003e-05 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674697+0000", 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2079999999999997e-06 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674701+0000", 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674733+0000", 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1612999999999997e-05 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.674738+0000", 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2349999999999999e-06 2024-04-26T12:15:05.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5348 5.5 5:a24cdad3:::benchmark_data_smithi069_31227_object5347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659970+0000", 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016490286, 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017040689000000001, 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5348 2024-04-26T12:15:05.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659970+0000", 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659970+0000", 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659969+0000", 2024-04-26T12:15:05.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660090+0000", 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121382 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660100+0000", 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3090000000000001e-06 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660107+0000", 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660151+0000", 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4045000000000003e-05 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660285+0000", 2024-04-26T12:15:05.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013438600000000001 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660451+0000", 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016608500000000001 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661528+0000", 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010765390000000001 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.666400+0000", 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048719289999999997 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.666410+0000", 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8740000000000007e-06 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5372 5.c 5.2a2599ac (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.676857+0000", 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9996028, 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022278599999999999, 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5372 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676857+0000", 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676857+0000", 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676857+0000", 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676965+0000", 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108497 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676974+0000", 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.676979+0000", 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677011+0000", 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677017+0000", 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.02e-06 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5374 5.2 5.49a17682 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.677006+0000", 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.999454, 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011034100000000001, 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:05.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5374 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677006+0000", 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677006+0000", 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677006+0000", 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677060+0000", 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3958000000000001e-05 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677070+0000", 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0573e-05 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677077+0000", 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677104+0000", 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.677108+0000", 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0330000000000002e-06 2024-04-26T12:15:05.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.745 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:05.745 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 14 2024-04-26T12:15:05.745 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:05.747 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-26T12:15:05.747 DEBUG:teuthology.orchestra.run.smithi069:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T12:15:05.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:05.748 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.745+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 1 16 5376 5360 334.983 335 0.00206419 0.00273459 2024-04-26T12:15:05.847 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.846+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.848 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:05.848 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:05.848 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:05.848 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:05.849 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:05.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:05.948 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:05.947+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:05.959 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.096855925, 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012842965, 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860604+0000", 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860616+0000", 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-05 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860628+0000", 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860640+0000", 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1948e-05 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861144+0000", 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050421799999999996 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861294+0000", 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149741 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861573+0000", 2024-04-26T12:15:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027888300000000001 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865700+0000", 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041267869999999998 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873353+0000", 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076533549999999997 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873408+0000", 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4724e-05 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873449+0000", 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1130000000000001e-05 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.096717332000001, 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012872916, 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860751+0000", 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4989999999999997e-06 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860766+0000", 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5277999999999998e-05 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860777+0000", 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862196+0000", 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014194749999999999 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862357+0000", 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016099300000000001 2024-04-26T12:15:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862626+0000", 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026869399999999999 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865793+0000", 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003167076 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873525+0000", 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077318420000000001 2024-04-26T12:15:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873574+0000", 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9444999999999998e-05 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873617+0000", 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3034000000000002e-05 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.096678442999998, 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011713941, 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860787+0000", 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000002e-06 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860798+0000", 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0766e-05 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860807+0000", 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.081e-06 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862318+0000", 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015111739999999999 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862596+0000", 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027813799999999999 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862721+0000", 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425700000000001 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865738+0000", 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003017619 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872418+0000", 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066796609999999999 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872471+0000", 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3251000000000002e-05 2024-04-26T12:15:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872497+0000", 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6071000000000002e-05 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.096504827, 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011656498, 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860956+0000", 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860964+0000", 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9489999999999996e-06 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860977+0000", 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3159999999999999e-05 2024-04-26T12:15:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860988+0000", 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863879+0000", 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028914019999999999 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863983+0000", 2024-04-26T12:15:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103947 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864216+0000", 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023310400000000001 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866761+0000", 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025451940000000002 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872568+0000", 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058070329999999996 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872595+0000", 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6821999999999998e-05 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872613+0000", 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8343999999999999e-05 2024-04-26T12:15:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.096467518000001, 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012981602, 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860998+0000", 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1760000000000003e-06 2024-04-26T12:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861005+0000", 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861013+0000", 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-06 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864442+0000", 2024-04-26T12:15:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034288909999999999 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864579+0000", 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013655000000000001 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864726+0000", 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146821 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867844+0000", 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031183880000000001 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873900+0000", 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060559790000000004 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873940+0000", 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9626999999999999e-05 2024-04-26T12:15:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873976+0000", 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6327e-05 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.096442008, 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012198451000000001, 2024-04-26T12:15:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861019+0000", 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861023+0000", 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861030+0000", 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861036+0000", 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5430000000000001e-06 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861491+0000", 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000455606 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861725+0000", 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023400100000000001 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861842+0000", 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116717 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866171+0000", 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043294830000000003 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873128+0000", 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069568080000000001 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873180+0000", 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1792999999999997e-05 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873218+0000", 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.096008842, 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012135589, 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861452+0000", 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861458+0000", 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3740000000000003e-06 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861469+0000", 2024-04-26T12:15:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0251999999999999e-05 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861477+0000", 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862181+0000", 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070414999999999996 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862298+0000", 2024-04-26T12:15:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011689899999999999 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873589+0000", 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011290432 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.095975903999999, 2024-04-26T12:15:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012630707999999999, 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861485+0000", 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861488+0000", 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861495+0000", 2024-04-26T12:15:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861501+0000", 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865278+0000", 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037777829999999998 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865405+0000", 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012616999999999999 2024-04-26T12:15:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874117+0000", 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087119399999999996 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:1 5.3 5:c324fb4d:::benchmark_data_smithi069_31227_object0:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:04.751745+0000", 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2057171630000001, 2024-04-26T12:15:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076303209999999998, 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.751745+0000", 2024-04-26T12:15:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.751745+0000", 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.751743+0000", 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.751927+0000", 2024-04-26T12:15:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018412999999999999 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.751938+0000", 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.751953+0000", 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5017e-05 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.751999+0000", 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6313999999999997e-05 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752003+0000", 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1540000000000004e-06 2024-04-26T12:15:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.755190+0000", 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031868600000000001 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.755283+0000", 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3059999999999993e-05 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.755563+0000", 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028000399999999998 2024-04-26T12:15:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757743+0000", 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021797050000000001 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759285+0000", 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00154199 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759336+0000", 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1337e-05 2024-04-26T12:15:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759375+0000", 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8846e-05 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:8 5.5 5:a2fb7c0a:::benchmark_data_smithi069_31227_object7:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:04.752056+0000", 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2054061, 2024-04-26T12:15:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072112490000000003, 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 8 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752056+0000", 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752056+0000", 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752055+0000", 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752136+0000", 2024-04-26T12:15:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0926000000000004e-05 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752143+0000", 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8199999999999999e-06 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752150+0000", 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7150000000000001e-06 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752173+0000", 2024-04-26T12:15:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3635e-05 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752176+0000", 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5969999999999999e-06 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.754820+0000", 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026441160000000002 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.754956+0000", 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135613 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.755088+0000", 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013218 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757128+0000", 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020401709999999999 2024-04-26T12:15:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759218+0000", 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020900129999999999 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759245+0000", 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6614999999999998e-05 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759267+0000", 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2158e-05 2024-04-26T12:15:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:11 5.5 5:ab372b2f:::benchmark_data_smithi069_31227_object10:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:04.752225+0000", 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.205236644, 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076751450000000004, 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 11 2024-04-26T12:15:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752225+0000", 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752225+0000", 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752225+0000", 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752271+0000", 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6286999999999999e-05 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752276+0000", 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4070000000000001e-06 2024-04-26T12:15:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752280+0000", 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2320000000000001e-06 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752304+0000", 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4615999999999999e-05 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752306+0000", 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0789999999999999e-06 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.755707+0000", 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034008860000000001 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.755844+0000", 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000136508 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.756038+0000", 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000194045 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757315+0000", 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012769350000000001 2024-04-26T12:15:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759839+0000", 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025241230000000001 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759871+0000", 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2039999999999998e-05 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.759900+0000", 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9357e-05 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:13 5.3 5:c7f26f10:::benchmark_data_smithi069_31227_object12:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:04.752284+0000", 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2051776809999999, 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078282779999999993, 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 13 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752284+0000", 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752284+0000", 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752284+0000", 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752353+0000", 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9692999999999998e-05 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752366+0000", 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2187999999999999e-05 2024-04-26T12:15:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752371+0000", 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0980000000000001e-06 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752394+0000", 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2898e-05 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752396+0000", 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.181e-06 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.756329+0000", 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039335359999999996 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.756687+0000", 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000357781 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.756816+0000", 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012877099999999999 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757750+0000", 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093386100000000002 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.760013+0000", 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002263227 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.760076+0000", 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3077999999999995e-05 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.760112+0000", 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6245999999999998e-05 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:15 5.3 5:c8e48cb8:::benchmark_data_smithi069_31227_object14:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:04.752379+0000", 2024-04-26T12:15:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.205082963, 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007888539, 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752379+0000", 2024-04-26T12:15:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752379+0000", 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752378+0000", 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752445+0000", 2024-04-26T12:15:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6324999999999999e-05 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752454+0000", 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1030000000000008e-06 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752466+0000", 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752488+0000", 2024-04-26T12:15:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1687000000000001e-05 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.752493+0000", 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757234+0000", 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047411709999999998 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757340+0000", 2024-04-26T12:15:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106331 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757462+0000", 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121531 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.757911+0000", 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044925400000000001 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.760193+0000", 2024-04-26T12:15:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002281918 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.760235+0000", 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005999999999997e-05 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.760267+0000", 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2563e-05 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:574 5.c 5:3d7cda42:::benchmark_data_smithi069_31227_object573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:04.850958+0000", 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.106504057, 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072098580000000004, 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.850958+0000", 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.850958+0000", 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.850957+0000", 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.851057+0000", 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100188 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.851068+0000", 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1092e-05 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.851074+0000", 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3850000000000001e-06 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.851122+0000", 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8384999999999998e-05 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.851289+0000", 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016700800000000001 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.851471+0000", 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000182385 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.852465+0000", 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099357999999999998 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.858123+0000", 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056574879999999996 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.858150+0000", 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7185000000000001e-05 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:04.858168+0000", 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7866000000000001e-05 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5342 5.a 5:55424964:::benchmark_data_smithi069_31227_object5341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.29818376800000002, 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013003953, 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5342 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659277+0000", 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659408+0000", 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130579 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659416+0000", 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659421+0000", 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5450000000000003e-06 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659713+0000", 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029148299999999999 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659919+0000", 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020655700000000001 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660098+0000", 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179039 2024-04-26T12:15:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662447+0000", 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023482540000000001 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672214+0000", 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097676150000000003 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672248+0000", 2024-04-26T12:15:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4103000000000002e-05 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672282+0000", 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3584999999999998e-05 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5346 5.a 5:563f63a2:::benchmark_data_smithi069_31227_object5345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.297738436, 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012632412000000001, 2024-04-26T12:15:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5346 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659722+0000", 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659782+0000", 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9444999999999998e-05 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659791+0000", 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659799+0000", 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.515e-06 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660621+0000", 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082202999999999996 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660743+0000", 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122562 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660872+0000", 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012882 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663166+0000", 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022937859999999999 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672308+0000", 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009142397 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672336+0000", 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7509e-05 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672356+0000", 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0114000000000001e-05 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5349 5.a 5:50d05031:::benchmark_data_smithi069_31227_object5348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.29693853199999998, 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011904534, 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5349 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660522+0000", 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660647+0000", 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124566 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660657+0000", 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660672+0000", 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5221e-05 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661256+0000", 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058376299999999995 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661382+0000", 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012674799999999999 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661496+0000", 2024-04-26T12:15:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113675 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668095+0000", 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065989789999999996 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672382+0000", 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004287005 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672405+0000", 2024-04-26T12:15:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2569e-05 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672428+0000", 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3169000000000001e-05 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:5353 5.b e18/16 5:d3c8c78e:::benchmark_data_smithi069_31227_object5352:head v 18'334, mlcod=18'330)", 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.29604994800000001, 2024-04-26T12:15:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089410759999999992, 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661411+0000", 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661493+0000", 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1619000000000006e-05 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661502+0000", 2024-04-26T12:15:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4739999999999994e-06 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661508+0000", 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5729999999999998e-06 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661610+0000", 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101613 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661629+0000", 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9352e-05 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670312+0000", 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086831660000000008 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670353+0000", 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0815000000000001e-05 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5357 5.a 5:5fa00d19:::benchmark_data_smithi069_31227_object5356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.29549960199999997, 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010883591999999999, 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5357 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662062+0000", 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100047 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662072+0000", 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.045e-05 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662079+0000", 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4590000000000003e-06 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663188+0000", 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011097609999999999 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667518+0000", 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043295060000000003 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667663+0000", 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014561500000000001 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.669650+0000", 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001986617 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672776+0000", 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031263179999999999 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672817+0000", 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0522999999999998e-05 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672846+0000", 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8895e-05 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:5355 5.b e18/16 5:d8bc4a2c:::benchmark_data_smithi069_31227_object5354:head v 18'335, mlcod=18'331)", 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.29486435599999999, 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011117659, 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662626+0000", 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8875000000000001e-05 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662632+0000", 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662637+0000", 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6800000000000001e-06 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670544+0000", 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079072650000000001 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670564+0000", 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9766e-05 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673688+0000", 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031234449999999999 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673715+0000", 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7474000000000002e-05 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:06.073 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:06.073 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:15:06.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:06.083 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:06.073+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:06.174 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:06.173+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:06.183 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5368 5.f 5.d87ee57f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.674078+0000", 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.51343371699999996, 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.51345280000000004, 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:06.188 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5368 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674078+0000", 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674078+0000", 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674077+0000", 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674149+0000", 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2434999999999993e-05 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674158+0000", 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9600000000000006e-06 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674164+0000", 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.083e-06 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674189+0000", 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4958999999999999e-05 2024-04-26T12:15:06.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.674194+0000", 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4580000000000003e-06 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5352 5.f 5.8414b35f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.667242+0000", 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.52026923999999997, 2024-04-26T12:15:06.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.52032919899999996, 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for peered", 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5352 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667242+0000", 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667242+0000", 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667241+0000", 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667273+0000", 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2033999999999999e-05 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667283+0000", 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5300000000000002e-06 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667289+0000", 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5320000000000003e-06 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667345+0000", 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5551999999999999e-05 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for peered", 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667353+0000", 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 2 2024-04-26T12:15:06.196 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:06.197 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:06.275 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:06.274+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:06.299 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:06.299 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:06.299 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:06.299 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:06.299 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:06.308 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:06.365 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:06.392 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:06.391+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:06.436 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-26T12:15:06.452 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-26T12:15:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.478231942000001, 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082564849999999992, 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971669+0000", 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971676+0000", 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5390000000000004e-06 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971686+0000", 2024-04-26T12:15:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8409999999999995e-06 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971690+0000", 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4580000000000003e-06 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974072+0000", 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023813910000000001 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974091+0000", 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9655000000000001e-05 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979896+0000", 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058048279999999997 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979926+0000", 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0371000000000001e-05 2024-04-26T12:15:06.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'145)", 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.477858078000001, 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078962200000000007, 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972043+0000", 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972050+0000", 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9249999999999998e-06 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972060+0000", 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0108999999999999e-05 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972065+0000", 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974396+0000", 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002331058 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974416+0000", 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9749e-05 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979929+0000", 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055127910000000004 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979940+0000", 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1552000000000001e-05 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.477409011999999, 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074578040000000002, 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972487+0000", 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999943 2024-04-26T12:15:06.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972537+0000", 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972563+0000", 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5165999999999999e-05 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972575+0000", 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2164000000000001e-05 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974676+0000", 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002101407 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974696+0000", 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9568e-05 2024-04-26T12:15:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979941+0000", 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052450880000000002 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979951+0000", 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.465 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.973519+0000", 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.476383289000001, 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00644241, 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973519+0000", 2024-04-26T12:15:06.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973519+0000", 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973512+0000", 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999938 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973529+0000", 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7047000000000001e-05 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973554+0000", 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4888999999999998e-05 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.973566+0000", 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.137e-05 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.975266+0000", 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001700027 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.975278+0000", 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2704000000000001e-05 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979951+0000", 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046729700000000002 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979961+0000", 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.590236792999999, 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014073476999999999, 2024-04-26T12:15:06.470 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859663+0000", 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859674+0000", 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0736e-05 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859689+0000", 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5318000000000001e-05 2024-04-26T12:15:06.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859702+0000", 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2091e-05 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862268+0000", 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025663650000000001 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862403+0000", 2024-04-26T12:15:06.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134812 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862516+0000", 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011333299999999999 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866182+0000", 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003666019 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873647+0000", 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074652499999999997 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873699+0000", 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1894999999999997e-05 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873739+0000", 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9360999999999998e-05 2024-04-26T12:15:06.475 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.589732482999999, 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013691603, 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:06.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860176+0000", 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7719999999999994e-06 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860187+0000", 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0922e-05 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860238+0000", 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1189000000000001e-05 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862855+0000", 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026161460000000002 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862933+0000", 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8714999999999994e-05 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863088+0000", 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154902 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866289+0000", 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032008169999999999 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873783+0000", 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074935100000000001 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873829+0000", 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6181999999999999e-05 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873861+0000", 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2320000000000002e-05 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:06.481 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.589017233, 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013456986000000001, 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860884+0000", 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860891+0000", 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9120000000000001e-06 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860900+0000", 2024-04-26T12:15:06.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1980000000000007e-06 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860953+0000", 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3451e-05 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863286+0000", 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023325360000000001 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863386+0000", 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100498 2024-04-26T12:15:06.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863481+0000", 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4388000000000005e-05 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866407+0000", 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029256899999999999 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874251+0000", 2024-04-26T12:15:06.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078446680000000008 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874299+0000", 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8154e-05 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874342+0000", 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2330999999999998e-05 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.588429214000001, 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013022891999999999, 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861472+0000", 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861481+0000", 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7339999999999997e-06 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861494+0000", 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2826999999999999e-05 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861502+0000", 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863795+0000", 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002292845 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863844+0000", 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9531999999999999e-05 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863938+0000", 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3962999999999995e-05 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869387+0000", 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054482080000000004 2024-04-26T12:15:06.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874431+0000", 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050444599999999997 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874472+0000", 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0717000000000003e-05 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874496+0000", 2024-04-26T12:15:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3836999999999999e-05 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.588393104000001, 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012184309000000001, 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861508+0000", 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861512+0000", 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9299999999999996e-06 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861552+0000", 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9684999999999997e-05 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861559+0000", 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8499999999999996e-06 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861620+0000", 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1048000000000002e-05 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861781+0000", 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000161075 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861951+0000", 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170447 2024-04-26T12:15:06.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864200+0000", 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002248758 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873592+0000", 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093917219999999999 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873643+0000", 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1413999999999999e-05 2024-04-26T12:15:06.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873693+0000", 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0099000000000003e-05 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.588321724, 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01226267, 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.497 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861579+0000", 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861585+0000", 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4160000000000003e-06 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861591+0000", 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5980000000000002e-06 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861598+0000", 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5080000000000002e-06 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862487+0000", 2024-04-26T12:15:06.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088919800000000001 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862578+0000", 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0879999999999997e-05 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862715+0000", 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013701699999999999 2024-04-26T12:15:06.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866365+0000", 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036497589999999998 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873759+0000", 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073938679999999996 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873810+0000", 2024-04-26T12:15:06.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0958999999999998e-05 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873843+0000", 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3232000000000003e-05 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.588282978999999, 2024-04-26T12:15:06.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012846606999999999, 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861618+0000", 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861626+0000", 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7829999999999999e-06 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861634+0000", 2024-04-26T12:15:06.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7170000000000008e-06 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861639+0000", 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864257+0000", 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002617308 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864354+0000", 2024-04-26T12:15:06.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7211000000000002e-05 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864457+0000", 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010295599999999999 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869597+0000", 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051396849999999997 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874383+0000", 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004786106 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874435+0000", 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2473999999999999e-05 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874466+0000", 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0485e-05 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.588252485000002, 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012237605, 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861652+0000", 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0709999999999999e-06 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861670+0000", 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7694999999999999e-05 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861677+0000", 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9109999999999993e-06 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862368+0000", 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069049699999999999 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863241+0000", 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00087347900000000003 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873887+0000", 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010645635000000001 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.512 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.587713202, 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074800040000000002, 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862188+0000", 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862200+0000", 2024-04-26T12:15:06.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2529e-05 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862212+0000", 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2079000000000001e-05 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862222+0000", 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862495+0000", 2024-04-26T12:15:06.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027301499999999999 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862602+0000", 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106858 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869669+0000", 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007066658 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:578 5.d 5:b05a7faf:::benchmark_data_smithi069_31227_object577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.851262+0000", 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.5986400569999999, 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006862969, 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.517 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 578 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851262+0000", 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851262+0000", 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851261+0000", 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851392+0000", 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130841 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851439+0000", 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6424999999999997e-05 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851446+0000", 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0439999999999998e-06 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851483+0000", 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7259999999999999e-05 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851589+0000", 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105648 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851710+0000", 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121508 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853974+0000", 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022639079999999998 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858085+0000", 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041105940000000004 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858107+0000", 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2869000000000001e-05 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858125+0000", 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7418000000000002e-05 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.522 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:580 5.d 5:b5307ae6:::benchmark_data_smithi069_31227_object579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.5983807830000001, 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066795320000000002, 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.523 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 580 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851521+0000", 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851597+0000", 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6674999999999993e-05 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851605+0000", 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6490000000000008e-06 2024-04-26T12:15:06.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.851610+0000", 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5300000000000004e-06 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852135+0000", 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00052503200000000004 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852245+0000", 2024-04-26T12:15:06.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109936 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.852381+0000", 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013573599999999999 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.853977+0000", 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015957460000000001 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858157+0000", 2024-04-26T12:15:06.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041796200000000002 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858182+0000", 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5729999999999999e-05 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:04.858201+0000", 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8448999999999999e-05 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.528 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5344 5.b 5:de699416:::benchmark_data_smithi069_31227_object5343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.659527+0000", 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.790375257, 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076875019999999997, 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.529 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5344 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659527+0000", 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659527+0000", 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659526+0000", 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659609+0000", 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2534999999999995e-05 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659619+0000", 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0525e-05 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659625+0000", 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7790000000000001e-06 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660110+0000", 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00048452199999999998 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660186+0000", 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6654000000000002e-05 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660290+0000", 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103865 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660908+0000", 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00061822000000000005 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667137+0000", 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062284080000000004 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667179+0000", 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1924e-05 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667214+0000", 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5351 5.4 5:2ab9df2e:::benchmark_data_smithi069_31227_object5350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.660900+0000", 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.78900188100000002, 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060397879999999999, 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5351 2024-04-26T12:15:06.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660900+0000", 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660900+0000", 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660899+0000", 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660949+0000", 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0145999999999997e-05 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660960+0000", 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0671e-05 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660973+0000", 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3212e-05 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661019+0000", 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6205000000000002e-05 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661108+0000", 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8774000000000001e-05 2024-04-26T12:15:06.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661194+0000", 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5442e-05 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.663786+0000", 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025927179999999999 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.666859+0000", 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030727020000000001 2024-04-26T12:15:06.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.666908+0000", 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8702999999999998e-05 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.666940+0000", 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2106000000000001e-05 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5353 5.b 5:d3c8c78e:::benchmark_data_smithi069_31227_object5352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.78889051799999999, 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009750201, 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5353 2024-04-26T12:15:06.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:06.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661108+0000", 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7223000000000001e-05 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661117+0000", 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6449999999999994e-06 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661123+0000", 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.93e-06 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661157+0000", 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4618e-05 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661254+0000", 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6766000000000002e-05 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661351+0000", 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7199000000000002e-05 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.664847+0000", 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003495667 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670710+0000", 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058631710000000004 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670741+0000", 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1340000000000001e-05 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670762+0000", 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0316e-05 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5354 5.4 5:2e9904f4:::benchmark_data_smithi069_31227_object5353:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.546 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.78877073600000003, 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080305930000000008, 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5354 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661163+0000", 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2762000000000002e-05 2024-04-26T12:15:06.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661171+0000", 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2690000000000002e-06 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661176+0000", 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0209999999999999e-06 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661578+0000", 2024-04-26T12:15:06.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00040194299999999998 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661730+0000", 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015264200000000001 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661822+0000", 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1347999999999993e-05 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667346+0000", 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055242449999999997 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.669117+0000", 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001771339 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.669144+0000", 2024-04-26T12:15:06.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6628999999999999e-05 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.669162+0000", 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7929999999999999e-05 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5355 5.b 5:d8bc4a2c:::benchmark_data_smithi069_31227_object5354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:06.552 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.78865249400000004, 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012663186999999999, 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5355 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:06.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:06.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661339+0000", 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0095999999999999e-05 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661347+0000", 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0600000000000008e-06 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661352+0000", 2024-04-26T12:15:06.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2800000000000003e-06 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661882+0000", 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00053007300000000005 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661996+0000", 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113459 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.662126+0000", 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013037899999999999 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.664852+0000", 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027257689999999998 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673852+0000", 2024-04-26T12:15:06.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090002499999999996 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673893+0000", 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0401000000000002e-05 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673913+0000", 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0013e-05 2024-04-26T12:15:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:06.559 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:06.560 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:06.560 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:06.560 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:06.561 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:06.561 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:06.559+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:06.562 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:06.562 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:06.563 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:06.563 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "ops": [ 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5333, 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.44becfe2", 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5332", 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5332", 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.821534s", 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86498059800000004, 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 2, 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.657655+0000", 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5347, 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.92850f82", 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5346", 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5346", 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.821534s", 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86498059800000004, 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 2, 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.659787+0000", 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5348, 2024-04-26T12:15:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.cb5b3245", 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5347", 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5347", 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.814534s", 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.87198043999999997, 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.659856+0000", 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5350, 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.cb2ff555", 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5349", 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5349", 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.815534s", 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.87098046299999998, 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.660505+0000", 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5356, 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.547b0893", 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5355", 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5355", 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.816534s", 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86998048500000003, 2024-04-26T12:15:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.661718+0000", 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5358, 2024-04-26T12:15:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.d972eba7", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5357", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5357", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.821534s", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86498059800000004, 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 2, 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.662579+0000", 2024-04-26T12:15:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5359, 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.e220f211", 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5358", 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5358", 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.822534s", 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86398061999999998, 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.667398+0000", 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5360, 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.d906b077", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5359", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5359", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.822534s", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86398061999999998, 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.667425+0000", 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5362, 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.ce16d685", 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5361", 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5361", 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.825534s", 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86098068699999997, 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.670838+0000", 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5366, 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.bd8034ec", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5365", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5365", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.827534s", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.85898073200000002, 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.672478+0000", 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5371, 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.8cfaf946", 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5370", 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5370", 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.829534s", 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.85698077699999997, 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.674592+0000", 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5372, 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.2a2599ac", 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5371", 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5371", 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.831534s", 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.85498082200000003, 2024-04-26T12:15:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.676798+0000", 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5374, 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.49a17682", 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5373", 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5373", 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.831534s", 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.85498082200000003, 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.676954+0000", 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5376, 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.22662bb1", 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 0, 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5375", 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5375", 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.835534s", 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.85098091099999995, 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.680265+0000", 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5352, 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.8414b35f", 2024-04-26T12:15:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 2, 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5351", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5351", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.821534s", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.86498059800000004, 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 2, 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.660890+0000", 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "tid": 5368, 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "pg": "5.d87ee57f", 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": 2, 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "object_id": "benchmark_data_smithi069_31227_object5367", 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "object_locator": "@5", 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_id": "benchmark_data_smithi069_31227_object5367", 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "target_object_locator": "@5", 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "paused": 0, 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "used_replica": 0, 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "precalc_pgid": 0, 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "last_sent": "507.828534s", 2024-04-26T12:15:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.85798075399999996, 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "attempts": 1, 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "snapid": "head", 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_context": "0=[]", 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "mtime": "2024-04-26T12:15:05.673997+0000", 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_ops": [ 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "write 0~65536 in=65536b" 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ops": [], 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ops": [], 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_stat_ops": [], 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_ops": [], 2024-04-26T12:15:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "command_ops": [] 2024-04-26T12:15:06.590 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-26T12:15:06.590 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 5333, "pg": "5.44becfe2", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5332", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5332", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.821534s", "age": 0.86498059800000004, "attempts": 2, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.657655+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5347, "pg": "5.92850f82", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5346", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5346", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.821534s", "age": 0.86498059800000004, "attempts": 2, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.659787+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5348, "pg": "5.cb5b3245", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5347", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5347", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.814534s", "age": 0.87198043999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.659856+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5350, "pg": "5.cb2ff555", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5349", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5349", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.815534s", "age": 0.87098046299999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.660505+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5356, "pg": "5.547b0893", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5355", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5355", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.816534s", "age": 0.86998048500000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.661718+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5358, "pg": "5.d972eba7", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5357", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5357", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.821534s", "age": 0.86498059800000004, "attempts": 2, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.662579+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5359, "pg": "5.e220f211", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5358", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5358", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.822534s", "age": 0.86398061999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.667398+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5360, "pg": "5.d906b077", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5359", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5359", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.822534s", "age": 0.86398061999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.667425+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5362, "pg": "5.ce16d685", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5361", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5361", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.825534s", "age": 0.86098068699999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.670838+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5366, "pg": "5.bd8034ec", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5365", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5365", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.827534s", "age": 0.85898073200000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.672478+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5371, "pg": "5.8cfaf946", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5370", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5370", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.829534s", "age": 0.85698077699999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.674592+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5372, "pg": "5.2a2599ac", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5371", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5371", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.831534s", "age": 0.85498082200000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.676798+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5374, "pg": "5.49a17682", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5373", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5373", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.831534s", "age": 0.85498082200000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.676954+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5376, "pg": "5.22662bb1", "osd": 0, "object_id": "benchmark_data_smithi069_31227_object5375", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5375", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.835534s", "age": 0.85098091099999995, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.680265+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5352, "pg": "5.8414b35f", "osd": 2, "object_id": "benchmark_data_smithi069_31227_object5351", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5351", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.821534s", "age": 0.86498059800000004, "attempts": 2, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.660890+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5368, "pg": "5.d87ee57f", "osd": 2, "object_id": "benchmark_data_smithi069_31227_object5367", "object_locator": "@5", "target_object_id": "benchmark_data_smithi069_31227_object5367", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "507.828534s", "age": 0.85798075399999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:15:05.673997+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-26T12:15:06.590 DEBUG:teuthology.orchestra.run.smithi069:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T12:15:06.627 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-26T12:15:06.661 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:06.660+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:06.682 DEBUG:teuthology.parallel:result is None 2024-04-26T12:15:06.682 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-26T12:15:06.695 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-26T12:15:06.695 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-26T12:15:06.735 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:06.735 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:06.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:06.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 2 16 5869 5853 182.895 30.8125 0.00326845 0.00546342 2024-04-26T12:15:06.761 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:06.760+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:06.862 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:06.861+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:06.953 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:06.953 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:06.963 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:06.962+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:06.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:07.064 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:07.063+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:07.165 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:07.164+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:07.168 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:07.169 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:07.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:07.266 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:07.265+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:07.339 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:07.339 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:07.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:07.396 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:07.395+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:07.468 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:07.466+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:07.509 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:07.509 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:07.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:07.606 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:07.605+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:07.669 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:07.668+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:07.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:15:07.712 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:07.713 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:07.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:07.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 3 16 11833 11817 246.172 372.75 0.00423412 0.00405801 2024-04-26T12:15:07.770 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:07.769+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:07.871 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:07.870+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:07.889 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:07.889 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:07.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:07.987 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:07.986+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:08.073 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:08.071+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:08.106 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:08.106 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:08.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:08.205 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:08.204+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:08.275 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:08.274+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:08.327 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:08.327 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:08.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:08.380 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:08.379+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:08.476 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:08.474+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:08.480 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:08.480 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:08.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:08.564 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:08.576 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:08.575+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:08.670 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:15:08.677 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:08.676+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:08.686 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:08.687 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:08.697 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:08.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:08.717 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:08.720 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:08.720 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:08.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 4 16 16646 16630 259.827 300.812 0.0036083 0.0038451 2024-04-26T12:15:08.778 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:08.777+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:08.849 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.875061192, 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082564849999999992, 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971670+0000", 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971669+0000", 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971676+0000", 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5390000000000004e-06 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971686+0000", 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8409999999999995e-06 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.971690+0000", 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4580000000000003e-06 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974072+0000", 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023813910000000001 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974091+0000", 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9655000000000001e-05 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979896+0000", 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058048279999999997 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979926+0000", 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0371000000000001e-05 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:205 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'151, mlcod=10'145)", 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.874687328, 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078962200000000007, 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972044+0000", 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972043+0000", 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972050+0000", 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9249999999999998e-06 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972060+0000", 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0108999999999999e-05 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972065+0000", 2024-04-26T12:15:08.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974396+0000", 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002331058 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974416+0000", 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9749e-05 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979929+0000", 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055127910000000004 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979940+0000", 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1552000000000001e-05 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4148.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:08.858 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.874238261999999, 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074578040000000002, 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972493+0000", 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972487+0000", 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999943 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972537+0000", 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972563+0000", 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5165999999999999e-05 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.972575+0000", 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2164000000000001e-05 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974676+0000", 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002101407 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.974696+0000", 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9568e-05 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979941+0000", 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052450880000000002 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:38.979951+0000", 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.862 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.987066042999999, 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014073476999999999, 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859663+0000", 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859674+0000", 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0736e-05 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859689+0000", 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5318000000000001e-05 2024-04-26T12:15:08.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859702+0000", 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2091e-05 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862268+0000", 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025663650000000001 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862403+0000", 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134812 2024-04-26T12:15:08.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862516+0000", 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011333299999999999 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866182+0000", 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003666019 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873647+0000", 2024-04-26T12:15:08.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074652499999999997 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873699+0000", 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1894999999999997e-05 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873739+0000", 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9360999999999998e-05 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.867 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.986561732999998, 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013691603, 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:08.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860176+0000", 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7719999999999994e-06 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860187+0000", 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0922e-05 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860238+0000", 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1189000000000001e-05 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862855+0000", 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026161460000000002 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862933+0000", 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8714999999999994e-05 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863088+0000", 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154902 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866289+0000", 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032008169999999999 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873783+0000", 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074935100000000001 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873829+0000", 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6181999999999999e-05 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873861+0000", 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2320000000000002e-05 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.872 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.985846483, 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013456986000000001, 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860884+0000", 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860891+0000", 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9120000000000001e-06 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860900+0000", 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1980000000000007e-06 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860953+0000", 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3451e-05 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863286+0000", 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023325360000000001 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863386+0000", 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100498 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863481+0000", 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4388000000000005e-05 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866407+0000", 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029256899999999999 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874251+0000", 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078446680000000008 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874299+0000", 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8154e-05 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874342+0000", 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2330999999999998e-05 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.985258464000001, 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013022891999999999, 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861472+0000", 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861481+0000", 2024-04-26T12:15:08.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7339999999999997e-06 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861494+0000", 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2826999999999999e-05 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861502+0000", 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863795+0000", 2024-04-26T12:15:08.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002292845 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863844+0000", 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9531999999999999e-05 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863938+0000", 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3962999999999995e-05 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869387+0000", 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054482080000000004 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874431+0000", 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050444599999999997 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874472+0000", 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0717000000000003e-05 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874496+0000", 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3836999999999999e-05 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.985222354000001, 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012184309000000001, 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.883 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861508+0000", 2024-04-26T12:15:08.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861512+0000", 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9299999999999996e-06 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861552+0000", 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9684999999999997e-05 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861559+0000", 2024-04-26T12:15:08.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8499999999999996e-06 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861620+0000", 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1048000000000002e-05 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861781+0000", 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000161075 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861951+0000", 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170447 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864200+0000", 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002248758 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873592+0000", 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093917219999999999 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873643+0000", 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1413999999999999e-05 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873693+0000", 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0099000000000003e-05 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.888 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.985150974, 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01226267, 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861579+0000", 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861585+0000", 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4160000000000003e-06 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861591+0000", 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5980000000000002e-06 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861598+0000", 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5080000000000002e-06 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862487+0000", 2024-04-26T12:15:08.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088919800000000001 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862578+0000", 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0879999999999997e-05 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862715+0000", 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013701699999999999 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866365+0000", 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036497589999999998 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873759+0000", 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073938679999999996 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873810+0000", 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0958999999999998e-05 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873843+0000", 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3232000000000003e-05 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.985112228999999, 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012846606999999999, 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861618+0000", 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861626+0000", 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7829999999999999e-06 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861634+0000", 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7170000000000008e-06 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861639+0000", 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864257+0000", 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002617308 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864354+0000", 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7211000000000002e-05 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864457+0000", 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010295599999999999 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869597+0000", 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051396849999999997 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874383+0000", 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004786106 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874435+0000", 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2473999999999999e-05 2024-04-26T12:15:08.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874466+0000", 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0485e-05 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.985081735000001, 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012237605, 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.899 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861652+0000", 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0709999999999999e-06 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861670+0000", 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7694999999999999e-05 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861677+0000", 2024-04-26T12:15:08.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9109999999999993e-06 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862368+0000", 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069049699999999999 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863241+0000", 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00087347900000000003 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873887+0000", 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010645635000000001 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.984542451999999, 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074800040000000002, 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.903 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862189+0000", 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862188+0000", 2024-04-26T12:15:08.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862200+0000", 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2529e-05 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862212+0000", 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2079000000000001e-05 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862222+0000", 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862495+0000", 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027301499999999999 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862602+0000", 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106858 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869669+0000", 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007066658 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5344 5.b 5:de699416:::benchmark_data_smithi069_31227_object5343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.659527+0000", 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1872045070000001, 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076875019999999997, 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.907 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5344 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659527+0000", 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659527+0000", 2024-04-26T12:15:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659526+0000", 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659609+0000", 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2534999999999995e-05 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659619+0000", 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0525e-05 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.659625+0000", 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7790000000000001e-06 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660110+0000", 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00048452199999999998 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660186+0000", 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6654000000000002e-05 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660290+0000", 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103865 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.660908+0000", 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00061822000000000005 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667137+0000", 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062284080000000004 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667179+0000", 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1924e-05 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667214+0000", 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.912 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5353 5.b 5:d3c8c78e:::benchmark_data_smithi069_31227_object5352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1857197680000002, 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009750201, 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5353 2024-04-26T12:15:08.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661108+0000", 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7223000000000001e-05 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661117+0000", 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6449999999999994e-06 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661123+0000", 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.93e-06 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661157+0000", 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4618e-05 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661254+0000", 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6766000000000002e-05 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661351+0000", 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7199000000000002e-05 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.664847+0000", 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003495667 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670710+0000", 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058631710000000004 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670741+0000", 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1340000000000001e-05 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670762+0000", 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0316e-05 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5354 5.4 5:2e9904f4:::benchmark_data_smithi069_31227_object5353:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:08.918 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1855999860000002, 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080305930000000008, 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5354 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:08.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661131+0000", 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661163+0000", 2024-04-26T12:15:08.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2762000000000002e-05 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661171+0000", 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2690000000000002e-06 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661176+0000", 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0209999999999999e-06 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661578+0000", 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00040194299999999998 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661730+0000", 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015264200000000001 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661822+0000", 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1347999999999993e-05 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.667346+0000", 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055242449999999997 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.669117+0000", 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001771339 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.669144+0000", 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6628999999999999e-05 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.669162+0000", 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7929999999999999e-05 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5355 5.b 5:d8bc4a2c:::benchmark_data_smithi069_31227_object5354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1854817440000001, 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012663186999999999, 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.924 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5355 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661339+0000", 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0095999999999999e-05 2024-04-26T12:15:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661347+0000", 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0600000000000008e-06 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661352+0000", 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2800000000000003e-06 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661882+0000", 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00053007300000000005 2024-04-26T12:15:08.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661996+0000", 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113459 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.662126+0000", 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013037899999999999 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.664852+0000", 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027257689999999998 2024-04-26T12:15:08.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673852+0000", 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090002499999999996 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673893+0000", 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0401000000000002e-05 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673913+0000", 2024-04-26T12:15:08.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0013e-05 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:16686 5.0 5:039f822f:::benchmark_data_smithi069_31227_object16685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.758583+0000", 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.088148044999999994, 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083342780000000005, 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.930 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 16686 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.758583+0000", 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.758583+0000", 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.758583+0000", 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.758613+0000", 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9944e-05 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.758619+0000", 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.545e-06 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.758624+0000", 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8520000000000003e-06 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.759990+0000", 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013659830000000001 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.760102+0000", 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111457 2024-04-26T12:15:08.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.760220+0000", 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118485 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.762239+0000", 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020188810000000001 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.766832+0000", 2024-04-26T12:15:08.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045928460000000003 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.766883+0000", 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1603e-05 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.766917+0000", 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4096e-05 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:16687 5.0 5:07427a52:::benchmark_data_smithi069_31227_object16686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.759211+0000", 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.087520589999999995, 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089276900000000003, 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 16687 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.759211+0000", 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.759211+0000", 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.759210+0000", 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.759307+0000", 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7313999999999997e-05 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.759325+0000", 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7802999999999999e-05 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.759332+0000", 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8210000000000004e-06 2024-04-26T12:15:08.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.760988+0000", 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016567120000000001 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.761104+0000", 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115365 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.761244+0000", 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013969500000000001 2024-04-26T12:15:08.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.762793+0000", 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001549431 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.768060+0000", 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052666140000000002 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.768104+0000", 2024-04-26T12:15:08.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4209999999999999e-05 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.768138+0000", 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4533999999999998e-05 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:17004 5.b 5:dbcb6123:::benchmark_data_smithi069_31227_object17003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.021092559, 2024-04-26T12:15:08.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012910595, 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 17004 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825638+0000", 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825720+0000", 2024-04-26T12:15:08.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1680000000000004e-05 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825729+0000", 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3689999999999996e-06 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825736+0000", 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5629999999999997e-06 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826284+0000", 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00054786500000000003 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826399+0000", 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011549599999999999 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826501+0000", 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010169400000000001 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.830165+0000", 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003664662 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838471+0000", 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083052679999999993 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838515+0000", 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4165999999999997e-05 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838549+0000", 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4403000000000002e-05 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:17012 5.b 5:d4221d34:::benchmark_data_smithi069_31227_object17011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.827918+0000", 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.018813389999999999, 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010711185999999999, 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:08.947 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 17012 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.827918+0000", 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.827918+0000", 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.827917+0000", 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828026+0000", 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010916000000000001 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828033+0000", 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6370000000000002e-06 2024-04-26T12:15:08.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828038+0000", 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1109999999999999e-06 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828092+0000", 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3572999999999997e-05 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828227+0000", 2024-04-26T12:15:08.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000135587 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828385+0000", 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015827300000000001 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.830200+0000", 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018147199999999999 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838557+0000", 2024-04-26T12:15:08.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083567650000000004 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838598+0000", 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0666e-05 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838629+0000", 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1344999999999999e-05 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:08.952 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:08.953 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:08.954 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:08.952+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:08.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:09.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T12:15:09.054 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:09.053+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18384 5.c 5:3811ab55:::benchmark_data_smithi069_31227_object18383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119290+0000", 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001649005, 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001679025, 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18384 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119290+0000", 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119290+0000", 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119290+0000", 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119406+0000", 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116371 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119414+0000", 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0490000000000004e-06 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119421+0000", 2024-04-26T12:15:09.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8959999999999997e-06 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120628+0000", 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001207147 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120768+0000", 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013987799999999999 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:18380 5.b e21/16 5:d8b128f2:::benchmark_data_smithi069_31227_object18379:head v 21'1175, mlcod=21'1171)", 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119481+0000", 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014579370000000001, 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015552980000000001, 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119481+0000", 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119481+0000", 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119481+0000", 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119531+0000", 2024-04-26T12:15:09.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0136999999999998e-05 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119540+0000", 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8140000000000007e-06 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119545+0000", 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3589999999999999e-06 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119719+0000", 2024-04-26T12:15:09.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000174086 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119736+0000", 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7108e-05 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18385 5.1 5:84d3878c:::benchmark_data_smithi069_31227_object18384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119429+0000", 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001510492, 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016646059999999999, 2024-04-26T12:15:09.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18385 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119429+0000", 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119429+0000", 2024-04-26T12:15:09.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119428+0000", 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119589+0000", 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016052699999999999 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119597+0000", 2024-04-26T12:15:09.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119603+0000", 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119662+0000", 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9128e-05 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119770+0000", 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010817 2024-04-26T12:15:09.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18387 5.c 5.742ab45c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119611+0000", 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001328355, 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001538452, 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18387 2024-04-26T12:15:09.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119611+0000", 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119611+0000", 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119610+0000", 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119642+0000", 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1467000000000002e-05 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119649+0000", 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2030000000000003e-06 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119654+0000", 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.181e-06 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:18382 5.e e21/16 5:7b014c21:::benchmark_data_smithi069_31227_object18381:head v 21'1177, mlcod=21'1175)", 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119769+0000", 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011707740000000001, 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001430841, 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119769+0000", 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119769+0000", 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119768+0000", 2024-04-26T12:15:09.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119850+0000", 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2328000000000002e-05 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119859+0000", 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4370000000000007e-06 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119864+0000", 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2329999999999997e-06 2024-04-26T12:15:09.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120098+0000", 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023398000000000001 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120115+0000", 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7119e-05 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18388 5.2 5:4e8115fc:::benchmark_data_smithi069_31227_object18387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119780+0000", 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011589969999999999, 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014767420000000001, 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18388 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119780+0000", 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119780+0000", 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119780+0000", 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119871+0000", 2024-04-26T12:15:09.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1401000000000001e-05 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119881+0000", 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7259999999999997e-06 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119887+0000", 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.63e-06 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119955+0000", 2024-04-26T12:15:09.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120069+0000", 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113519 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18389 5.2 5:42aed4ef:::benchmark_data_smithi069_31227_object18388:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119898+0000", 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001041256, 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00142946, 2024-04-26T12:15:09.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18389 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119898+0000", 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119898+0000", 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119897+0000", 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119931+0000", 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3890000000000002e-05 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119939+0000", 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.374e-06 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119950+0000", 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1303e-05 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121150+0000", 2024-04-26T12:15:09.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011998200000000001 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121274+0000", 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123922 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:18386 5.4 e21/16 5:20e45193:::benchmark_data_smithi069_31227_object18385:head v 21'1147, mlcod=21'1145)", 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.119951+0000", 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00098791099999999995, 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014416590000000001, 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119951+0000", 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119951+0000", 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119951+0000", 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120019+0000", 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7606000000000003e-05 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120026+0000", 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4510000000000003e-06 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120031+0000", 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3530000000000002e-06 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120628+0000", 2024-04-26T12:15:09.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059680300000000003 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120646+0000", 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7655999999999998e-05 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18390 5.a 5:532cc88d:::benchmark_data_smithi069_31227_object18389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.120598+0000", 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00034171000000000001, 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000857378, 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18390 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120598+0000", 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120598+0000", 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120597+0000", 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120624+0000", 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7163999999999999e-05 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120631+0000", 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.046e-06 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120637+0000", 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.507e-06 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121116+0000", 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047964500000000001 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121201+0000", 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4914999999999996e-05 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121271+0000", 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9871999999999998e-05 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18391 5.3 5:c973a472:::benchmark_data_smithi069_31227_object18390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.120641+0000", 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00029788999999999998, 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089011699999999995, 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18391 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120641+0000", 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120641+0000", 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120641+0000", 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120662+0000", 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0596999999999999e-05 2024-04-26T12:15:09.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120665+0000", 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7809999999999999e-06 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120669+0000", 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120714+0000", 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4400999999999997e-05 2024-04-26T12:15:09.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.120840+0000", 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126737 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:18392 5.8 e21/16 5:197ff9f6:::benchmark_data_smithi069_31227_object18391:head v 21'1163, mlcod=21'1161)", 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.121306+0000", 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9996338, 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029158800000000001, 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121306+0000", 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121306+0000", 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121305+0000", 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121399+0000", 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3955000000000004e-05 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121408+0000", 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7779999999999996e-06 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121414+0000", 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7590000000000003e-06 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121458+0000", 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706000000000002e-05 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.121476+0000", 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7657999999999999e-05 2024-04-26T12:15:09.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18378 5.c 5:3e449bcf:::benchmark_data_smithi069_31227_object18377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.118419+0000", 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0025203439999999999, 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032421239999999999, 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18378 2024-04-26T12:15:09.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118419+0000", 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118419+0000", 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118418+0000", 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118497+0000", 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8980000000000006e-05 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118515+0000", 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7686999999999999e-05 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118522+0000", 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4290000000000004e-06 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118560+0000", 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7866e-05 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118665+0000", 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105306 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:18379 5.c 5:3e2c6240:::benchmark_data_smithi069_31227_object18378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.118598+0000", 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0023414059999999999, 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003133135, 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18379 2024-04-26T12:15:09.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118598+0000", 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118598+0000", 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118597+0000", 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118725+0000", 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012740700000000001 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118746+0000", 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1403000000000002e-05 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.118752+0000", 2024-04-26T12:15:09.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.545e-06 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119727+0000", 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097473199999999996 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.119841+0000", 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011422 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.172 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:09.173 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 13 2024-04-26T12:15:09.173 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:09.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:09.174 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:09.172+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:09.275 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:09.273+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:09.332 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:09.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:09.375 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:09.374+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:09.475 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:09.474+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:09.504 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.640428851999999, 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012842965, 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860604+0000", 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860616+0000", 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-05 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860628+0000", 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860640+0000", 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1948e-05 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861144+0000", 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050421799999999996 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861294+0000", 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149741 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861573+0000", 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027888300000000001 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865700+0000", 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041267869999999998 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873353+0000", 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076533549999999997 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873408+0000", 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4724e-05 2024-04-26T12:15:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873449+0000", 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1130000000000001e-05 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.640290259, 2024-04-26T12:15:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012872916, 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860751+0000", 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4989999999999997e-06 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860766+0000", 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5277999999999998e-05 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860777+0000", 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862196+0000", 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014194749999999999 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862357+0000", 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016099300000000001 2024-04-26T12:15:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862626+0000", 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026869399999999999 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865793+0000", 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003167076 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873525+0000", 2024-04-26T12:15:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077318420000000001 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873574+0000", 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9444999999999998e-05 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873617+0000", 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3034000000000002e-05 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.640251370000001, 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011713941, 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860787+0000", 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000002e-06 2024-04-26T12:15:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860798+0000", 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0766e-05 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860807+0000", 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.081e-06 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862318+0000", 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015111739999999999 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862596+0000", 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027813799999999999 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862721+0000", 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425700000000001 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865738+0000", 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003017619 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872418+0000", 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066796609999999999 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872471+0000", 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3251000000000002e-05 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872497+0000", 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6071000000000002e-05 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.640077754, 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011656498, 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860956+0000", 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860964+0000", 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9489999999999996e-06 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860977+0000", 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3159999999999999e-05 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860988+0000", 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-04-26T12:15:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863879+0000", 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028914019999999999 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863983+0000", 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103947 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864216+0000", 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023310400000000001 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866761+0000", 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025451940000000002 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872568+0000", 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058070329999999996 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872595+0000", 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6821999999999998e-05 2024-04-26T12:15:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872613+0000", 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8343999999999999e-05 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.640040445, 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012981602, 2024-04-26T12:15:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860998+0000", 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1760000000000003e-06 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861005+0000", 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861013+0000", 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-06 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864442+0000", 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034288909999999999 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864579+0000", 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013655000000000001 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864726+0000", 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146821 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867844+0000", 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031183880000000001 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873900+0000", 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060559790000000004 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873940+0000", 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9626999999999999e-05 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873976+0000", 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6327e-05 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.640014935, 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012198451000000001, 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861019+0000", 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861023+0000", 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861030+0000", 2024-04-26T12:15:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861036+0000", 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5430000000000001e-06 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861491+0000", 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000455606 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861725+0000", 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023400100000000001 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861842+0000", 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116717 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866171+0000", 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043294830000000003 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873128+0000", 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069568080000000001 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873180+0000", 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1792999999999997e-05 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873218+0000", 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.639581768999999, 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012135589, 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861452+0000", 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861458+0000", 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3740000000000003e-06 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861469+0000", 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0251999999999999e-05 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861477+0000", 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862181+0000", 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070414999999999996 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862298+0000", 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011689899999999999 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873589+0000", 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011290432 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.639548830999999, 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012630707999999999, 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861485+0000", 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861488+0000", 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861495+0000", 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861501+0000", 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865278+0000", 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037777829999999998 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865405+0000", 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012616999999999999 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874117+0000", 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087119399999999996 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5342 5.a 5:55424964:::benchmark_data_smithi069_31227_object5341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8417566949999999, 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013003953, 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5342 2024-04-26T12:15:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659277+0000", 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659408+0000", 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130579 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659416+0000", 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659421+0000", 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5450000000000003e-06 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659713+0000", 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029148299999999999 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659919+0000", 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020655700000000001 2024-04-26T12:15:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660098+0000", 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179039 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662447+0000", 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023482540000000001 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672214+0000", 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097676150000000003 2024-04-26T12:15:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672248+0000", 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4103000000000002e-05 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672282+0000", 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3584999999999998e-05 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5346 5.a 5:563f63a2:::benchmark_data_smithi069_31227_object5345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.841311363, 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012632412000000001, 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5346 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659722+0000", 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659782+0000", 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9444999999999998e-05 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659791+0000", 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659799+0000", 2024-04-26T12:15:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.515e-06 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660621+0000", 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082202999999999996 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660743+0000", 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122562 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660872+0000", 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012882 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663166+0000", 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022937859999999999 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672308+0000", 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009142397 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672336+0000", 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7509e-05 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672356+0000", 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0114000000000001e-05 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5349 5.a 5:50d05031:::benchmark_data_smithi069_31227_object5348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.840511459, 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011904534, 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5349 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660522+0000", 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660647+0000", 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124566 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660657+0000", 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660672+0000", 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5221e-05 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661256+0000", 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058376299999999995 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661382+0000", 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012674799999999999 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661496+0000", 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113675 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668095+0000", 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065989789999999996 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672382+0000", 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004287005 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672405+0000", 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2569e-05 2024-04-26T12:15:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672428+0000", 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3169000000000001e-05 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:5353 5.b e18/16 5:d3c8c78e:::benchmark_data_smithi069_31227_object5352:head v 18'334, mlcod=18'330)", 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8396228749999999, 2024-04-26T12:15:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089410759999999992, 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661411+0000", 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661493+0000", 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1619000000000006e-05 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661502+0000", 2024-04-26T12:15:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4739999999999994e-06 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661508+0000", 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5729999999999998e-06 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661610+0000", 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101613 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661629+0000", 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9352e-05 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670312+0000", 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086831660000000008 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670353+0000", 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0815000000000001e-05 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5357 5.a 5:5fa00d19:::benchmark_data_smithi069_31227_object5356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8390725290000001, 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010883591999999999, 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5357 2024-04-26T12:15:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662062+0000", 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100047 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662072+0000", 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.045e-05 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662079+0000", 2024-04-26T12:15:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4590000000000003e-06 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663188+0000", 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011097609999999999 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667518+0000", 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043295060000000003 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667663+0000", 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014561500000000001 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.669650+0000", 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001986617 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672776+0000", 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031263179999999999 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672817+0000", 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0522999999999998e-05 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672846+0000", 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8895e-05 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:5355 5.b e18/16 5:d8bc4a2c:::benchmark_data_smithi069_31227_object5354:head v 18'335, mlcod=18'331)", 2024-04-26T12:15:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8384372830000002, 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011117659, 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662626+0000", 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8875000000000001e-05 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662632+0000", 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662637+0000", 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6800000000000001e-06 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670544+0000", 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079072650000000001 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670564+0000", 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9766e-05 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673688+0000", 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031234449999999999 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673715+0000", 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7474000000000002e-05 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:17281 5.a 5:5874f52a:::benchmark_data_smithi069_31227_object17280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:08.884080+0000", 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.61695483399999995, 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084542820000000005, 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17281 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884080+0000", 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884080+0000", 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884079+0000", 2024-04-26T12:15:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884153+0000", 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4266999999999999e-05 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884164+0000", 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0183000000000001e-05 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884171+0000", 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0870000000000001e-06 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.886010+0000", 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018394290000000001 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.886138+0000", 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012748800000000001 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.886270+0000", 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013223600000000001 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.887341+0000", 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010709230000000001 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.892458+0000", 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051176340000000002 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.892502+0000", 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3350000000000003e-05 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.892534+0000", 2024-04-26T12:15:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2339000000000003e-05 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:17649 5.a 5:5ffd7120:::benchmark_data_smithi069_31227_object17648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:08.957659+0000", 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.54337529699999998, 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082164409999999997, 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17649 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.957659+0000", 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.957659+0000", 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.957659+0000", 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.957684+0000", 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5709000000000001e-05 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.957694+0000", 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1700000000000003e-06 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.957700+0000", 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.958329+0000", 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062951700000000001 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.958517+0000", 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018720100000000001 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.958671+0000", 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015436900000000001 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.962121+0000", 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034503630000000001 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.965790+0000", 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00366906 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.965836+0000", 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.965876+0000", 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9378000000000001e-05 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:17723 5.a 5:5938e71d:::benchmark_data_smithi069_31227_object17722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:08.975545+0000", 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52548935500000005, 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081708270000000003, 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17723 2024-04-26T12:15:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975545+0000", 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975545+0000", 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975545+0000", 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975571+0000", 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6438e-05 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975580+0000", 2024-04-26T12:15:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.268e-06 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975599+0000", 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8926000000000001e-05 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.976538+0000", 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093855100000000003 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.976650+0000", 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112049 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.976877+0000", 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022687099999999999 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.980229+0000", 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003352027 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.983665+0000", 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034357569999999998 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.983691+0000", 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6305e-05 2024-04-26T12:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.983716+0000", 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5327e-05 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:17724 5.a 5:5770c3ed:::benchmark_data_smithi069_31227_object17723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:08.975789+0000", 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52524578600000005, 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081690430000000008, 2024-04-26T12:15:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17724 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975789+0000", 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975789+0000", 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975788+0000", 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975815+0000", 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6877e-05 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975824+0000", 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4069999999999993e-06 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.975829+0000", 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.977572+0000", 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017434989999999999 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.977678+0000", 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105538 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.977792+0000", 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113856 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.980616+0000", 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028241220000000001 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.983877+0000", 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032606929999999998 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.983921+0000", 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4533999999999997e-05 2024-04-26T12:15:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.983958+0000", 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6777999999999999e-05 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:19554 5.a 5:57c9f391:::benchmark_data_smithi069_31227_object19553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.372747+0000", 2024-04-26T12:15:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.12828777099999999, 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081255049999999999, 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 19554 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.372747+0000", 2024-04-26T12:15:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.372747+0000", 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.372746+0000", 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.372836+0000", 2024-04-26T12:15:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9956000000000004e-05 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.372844+0000", 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-06 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.372851+0000", 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1820000000000003e-06 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.374379+0000", 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001528321 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.374461+0000", 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1613999999999995e-05 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.374585+0000", 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012392999999999999 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.376408+0000", 2024-04-26T12:15:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018235110000000001 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.380795+0000", 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043866909999999999 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.380839+0000", 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4365e-05 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.380872+0000", 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3319999999999999e-05 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:19727 5.a 5:59b75644:::benchmark_data_smithi069_31227_object19726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.414071+0000", 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.086963736, 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089428000000000007, 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 19727 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414071+0000", 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414071+0000", 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414070+0000", 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414196+0000", 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126095 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414204+0000", 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0220000000000004e-06 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414223+0000", 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8502e-05 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.415059+0000", 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083655399999999999 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.415189+0000", 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012978499999999999 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.415340+0000", 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015076600000000001 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.418524+0000", 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003184395 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.422930+0000", 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044058530000000004 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.422979+0000", 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8483999999999999e-05 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.423014+0000", 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5154999999999998e-05 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:09.613 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:09.614 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:09.615 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:09.612+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:09.715 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:09.714+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:09.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 5 16 21251 21235 265.419 287.812 0.00169125 0.00376438 2024-04-26T12:15:09.771 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21338 5.0 5:00e32b4f:::benchmark_data_smithi069_31227_object21337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.769993+0000", 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00056888800000000003, 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00059698200000000002, 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:09.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21338 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.769993+0000", 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.769993+0000", 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.769992+0000", 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770055+0000", 2024-04-26T12:15:09.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2957e-05 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770064+0000", 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1900000000000001e-06 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770071+0000", 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.263e-06 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770113+0000", 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2577999999999998e-05 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770243+0000", 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013025600000000001 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770389+0000", 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014547799999999999 2024-04-26T12:15:09.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21341 5.e 5:73c5cf39:::benchmark_data_smithi069_31227_object21340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.770227+0000", 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00033544800000000002, 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044580500000000002, 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:09.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21341 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770227+0000", 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770227+0000", 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770226+0000", 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770314+0000", 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7808999999999999e-05 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770326+0000", 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2492e-05 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770331+0000", 2024-04-26T12:15:09.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0420000000000002e-06 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770365+0000", 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3414999999999998e-05 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770473+0000", 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108288 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770593+0000", 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012044099999999999 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:21321 5.e e21/16)", 2024-04-26T12:15:09.782 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.770356+0000", 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000206274, 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00035478000000000002, 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770356+0000", 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770356+0000", 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770355+0000", 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770357+0000", 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9659999999999999e-06 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770363+0000", 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5820000000000001e-06 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770367+0000", 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5429999999999998e-06 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:21322 5.e e21/16)", 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.770372+0000", 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00019022200000000001, 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00036190700000000002, 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:09.786 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770372+0000", 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770372+0000", 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770372+0000", 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770373+0000", 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6750000000000001e-06 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770379+0000", 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770382+0000", 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5489999999999998e-06 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21342 5.f 5:f9dffd43:::benchmark_data_smithi069_31227_object21341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.770339+0000", 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00022325099999999999, 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00042463899999999998, 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.790 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21342 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770339+0000", 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770339+0000", 2024-04-26T12:15:09.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770338+0000", 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770444+0000", 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105253 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770450+0000", 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3899999999999998e-06 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770455+0000", 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8940000000000001e-06 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:09.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770505+0000", 2024-04-26T12:15:09.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9957000000000003e-05 2024-04-26T12:15:09.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:09.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770619+0000", 2024-04-26T12:15:09.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011387600000000001 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21344 5.9 5:9a7cc710:::benchmark_data_smithi069_31227_object21343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.770476+0000", 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.5993000000000002e-05, 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032362200000000003, 2024-04-26T12:15:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21344 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770476+0000", 2024-04-26T12:15:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770476+0000", 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770475+0000", 2024-04-26T12:15:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770591+0000", 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011534100000000001 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770604+0000", 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3541e-05 2024-04-26T12:15:09.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770610+0000", 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0859999999999998e-06 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:09.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770663+0000", 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2422000000000001e-05 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770744+0000", 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1213999999999999e-05 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.800 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21321 5.e 5:7b859d10:::benchmark_data_smithi069_31227_object21320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.765070+0000", 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0054924040000000002, 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057724109999999999, 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21321 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.801 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765070+0000", 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765070+0000", 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765069+0000", 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765166+0000", 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7399999999999996e-05 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765187+0000", 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0976e-05 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765203+0000", 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5679e-05 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:09.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.766399+0000", 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011958559999999999 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.766478+0000", 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9628000000000004e-05 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.766551+0000", 2024-04-26T12:15:09.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2557000000000003e-05 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770017+0000", 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034661200000000001 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21322 5.e 5:780fb82a:::benchmark_data_smithi069_31227_object21321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:09.806 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.765210+0000", 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0053519459999999998, 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056883200000000002, 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21322 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765210+0000", 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765210+0000", 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765209+0000", 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:09.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765241+0000", 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1801000000000003e-05 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765250+0000", 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.765256+0000", 2024-04-26T12:15:09.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0909999999999998e-06 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.767343+0000", 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002086741 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.767478+0000", 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013456500000000001 2024-04-26T12:15:09.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.767623+0000", 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145325 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.770080+0000", 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024573360000000001 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:09.812 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:09.812 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-26T12:15:09.812 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:09.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:09.816 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:09.815+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:09.917 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:09.916+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:10.005 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:10.005 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:10.005 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:10.005 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:10.005 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:10.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:10.018 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:10.016+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:10.117 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:10.116+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:10.183 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:15:10.211 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.211 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.347610021000001, 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014073476999999999, 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859663+0000", 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859674+0000", 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0736e-05 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859689+0000", 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5318000000000001e-05 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859702+0000", 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2091e-05 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862268+0000", 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025663650000000001 2024-04-26T12:15:10.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862403+0000", 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134812 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862516+0000", 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011333299999999999 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866182+0000", 2024-04-26T12:15:10.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003666019 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873647+0000", 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074652499999999997 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873699+0000", 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1894999999999997e-05 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873739+0000", 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9360999999999998e-05 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.347105711000001, 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013691603, 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860176+0000", 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7719999999999994e-06 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860187+0000", 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0922e-05 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860238+0000", 2024-04-26T12:15:10.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1189000000000001e-05 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862855+0000", 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026161460000000002 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862933+0000", 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8714999999999994e-05 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863088+0000", 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154902 2024-04-26T12:15:10.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866289+0000", 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032008169999999999 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873783+0000", 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074935100000000001 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873829+0000", 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6181999999999999e-05 2024-04-26T12:15:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873861+0000", 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2320000000000002e-05 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.346390460999999, 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013456986000000001, 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.222 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860884+0000", 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860891+0000", 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9120000000000001e-06 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860900+0000", 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1980000000000007e-06 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860953+0000", 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3451e-05 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863286+0000", 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023325360000000001 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863386+0000", 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100498 2024-04-26T12:15:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863481+0000", 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4388000000000005e-05 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866407+0000", 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029256899999999999 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874251+0000", 2024-04-26T12:15:10.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078446680000000008 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874299+0000", 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8154e-05 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874342+0000", 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2330999999999998e-05 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.345802442, 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013022891999999999, 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861472+0000", 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861481+0000", 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7339999999999997e-06 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861494+0000", 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2826999999999999e-05 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861502+0000", 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863795+0000", 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002292845 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863844+0000", 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9531999999999999e-05 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863938+0000", 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3962999999999995e-05 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869387+0000", 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054482080000000004 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874431+0000", 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050444599999999997 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874472+0000", 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0717000000000003e-05 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874496+0000", 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3836999999999999e-05 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.345766332, 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012184309000000001, 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861508+0000", 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861512+0000", 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9299999999999996e-06 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861552+0000", 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9684999999999997e-05 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861559+0000", 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8499999999999996e-06 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861620+0000", 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1048000000000002e-05 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861781+0000", 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000161075 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861951+0000", 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170447 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864200+0000", 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002248758 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873592+0000", 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093917219999999999 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873643+0000", 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1413999999999999e-05 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873693+0000", 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0099000000000003e-05 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.345694951999999, 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01226267, 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:10.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861579+0000", 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861585+0000", 2024-04-26T12:15:10.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4160000000000003e-06 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861591+0000", 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5980000000000002e-06 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861598+0000", 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5080000000000002e-06 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862487+0000", 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088919800000000001 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862578+0000", 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0879999999999997e-05 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862715+0000", 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013701699999999999 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866365+0000", 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036497589999999998 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873759+0000", 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073938679999999996 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873810+0000", 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0958999999999998e-05 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873843+0000", 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3232000000000003e-05 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.345656207000001, 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012846606999999999, 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861618+0000", 2024-04-26T12:15:10.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861626+0000", 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7829999999999999e-06 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861634+0000", 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7170000000000008e-06 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861639+0000", 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:10.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864257+0000", 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002617308 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864354+0000", 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7211000000000002e-05 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864457+0000", 2024-04-26T12:15:10.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010295599999999999 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869597+0000", 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051396849999999997 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874383+0000", 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004786106 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874435+0000", 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2473999999999999e-05 2024-04-26T12:15:10.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874466+0000", 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0485e-05 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.345625713, 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012237605, 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:10.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861652+0000", 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0709999999999999e-06 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861670+0000", 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7694999999999999e-05 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861677+0000", 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9109999999999993e-06 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862368+0000", 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069049699999999999 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863241+0000", 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00087347900000000003 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873887+0000", 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010645635000000001 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5353 5.b 5:d3c8c78e:::benchmark_data_smithi069_31227_object5352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.5462637460000002, 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009750201, 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.252 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5353 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:10.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661011+0000", 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661108+0000", 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7223000000000001e-05 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661117+0000", 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6449999999999994e-06 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661123+0000", 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.93e-06 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661157+0000", 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4618e-05 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661254+0000", 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6766000000000002e-05 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661351+0000", 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7199000000000002e-05 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.664847+0000", 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003495667 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670710+0000", 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058631710000000004 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670741+0000", 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1340000000000001e-05 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.670762+0000", 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0316e-05 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5355 5.b 5:d8bc4a2c:::benchmark_data_smithi069_31227_object5354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.5460257219999995, 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012663186999999999, 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5355 2024-04-26T12:15:10.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661339+0000", 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0095999999999999e-05 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661347+0000", 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0600000000000008e-06 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661352+0000", 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2800000000000003e-06 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661882+0000", 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00053007300000000005 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661996+0000", 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113459 2024-04-26T12:15:10.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.662126+0000", 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013037899999999999 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.664852+0000", 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027257689999999998 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673852+0000", 2024-04-26T12:15:10.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090002499999999996 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673893+0000", 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0401000000000002e-05 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673913+0000", 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0013e-05 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:17004 5.b 5:dbcb6123:::benchmark_data_smithi069_31227_object17003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.3816365369999999, 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012910595, 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 17004 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825638+0000", 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825720+0000", 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1680000000000004e-05 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825729+0000", 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3689999999999996e-06 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825736+0000", 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5629999999999997e-06 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826284+0000", 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00054786500000000003 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826399+0000", 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011549599999999999 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826501+0000", 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010169400000000001 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.830165+0000", 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003664662 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838471+0000", 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083052679999999993 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838515+0000", 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4165999999999997e-05 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838549+0000", 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4403000000000002e-05 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:17012 5.b 5:d4221d34:::benchmark_data_smithi069_31227_object17011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.827918+0000", 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.379357368, 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010711185999999999, 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 17012 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.827918+0000", 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.827918+0000", 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.827917+0000", 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828026+0000", 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010916000000000001 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828033+0000", 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6370000000000002e-06 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828038+0000", 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1109999999999999e-06 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828092+0000", 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3572999999999997e-05 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828227+0000", 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000135587 2024-04-26T12:15:10.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.828385+0000", 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015827300000000001 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.830200+0000", 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018147199999999999 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838557+0000", 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083567650000000004 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838598+0000", 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0666e-05 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838629+0000", 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1344999999999999e-05 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.274 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:17492 5.9 5:954bdc8f:::benchmark_data_smithi069_31227_object17491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.925039+0000", 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.2822365819999999, 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010432490000000001, 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 17492 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925039+0000", 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925039+0000", 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925038+0000", 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925074+0000", 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6458000000000002e-05 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925085+0000", 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0804e-05 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925092+0000", 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2559999999999999e-06 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925141+0000", 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9922000000000001e-05 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.925222+0000", 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0376000000000004e-05 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.935406+0000", 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010183842 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.935433+0000", 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7487999999999998e-05 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.935471+0000", 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7926999999999998e-05 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21154 5.b 5:d7d66f20:::benchmark_data_smithi069_31227_object21153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.279 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.727998+0000", 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.47927722099999998, 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011693634, 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21154 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.727998+0000", 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.727998+0000", 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.727997+0000", 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.728035+0000", 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7629000000000002e-05 2024-04-26T12:15:10.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.728046+0000", 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1375999999999999e-05 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.728052+0000", 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.729528+0000", 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014750939999999999 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.729648+0000", 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012047 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.729847+0000", 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000199087 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.732668+0000", 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028205489999999999 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.739633+0000", 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069657089999999996 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.739669+0000", 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5556000000000003e-05 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.739692+0000", 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2636000000000001e-05 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21812 5.0 5:06769dd0:::benchmark_data_smithi069_31227_object21811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.866806+0000", 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.34046939500000001, 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012099967, 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.285 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21812 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866806+0000", 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866806+0000", 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866805+0000", 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866889+0000", 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866899+0000", 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0592e-05 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866908+0000", 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.439e-06 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869905+0000", 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029973650000000001 2024-04-26T12:15:10.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.870038+0000", 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013352899999999999 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.870208+0000", 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016922500000000001 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.871831+0000", 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001623088 2024-04-26T12:15:10.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878810+0000", 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069794159999999996 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878860+0000", 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0078999999999999e-05 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878906+0000", 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5495999999999999e-05 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21823 5.9 5:9307f085:::benchmark_data_smithi069_31227_object21822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.869295+0000", 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.337979851, 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096838310000000004, 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21823 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869295+0000", 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869295+0000", 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869295+0000", 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869359+0000", 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4214000000000006e-05 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869369+0000", 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0159999999999999e-05 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869376+0000", 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8299999999999998e-06 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.870299+0000", 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00092332000000000004 2024-04-26T12:15:10.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.870425+0000", 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012632799999999999 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878852+0000", 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084265950000000003 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878894+0000", 2024-04-26T12:15:10.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2070999999999998e-05 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878979+0000", 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5067000000000004e-05 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:22265 5.e 5:7296eb3e:::benchmark_data_smithi069_31227_object22264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.969753+0000", 2024-04-26T12:15:10.296 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.23752183900000001, 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0097449839999999999, 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 22265 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969753+0000", 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969753+0000", 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969753+0000", 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969821+0000", 2024-04-26T12:15:10.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8267000000000002e-05 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969830+0000", 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5589999999999994e-06 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969837+0000", 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2899999999999999e-06 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969907+0000", 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0338000000000003e-05 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.970023+0000", 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116298 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.970151+0000", 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012728199999999999 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.975587+0000", 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054363099999999998 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.979450+0000", 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038627050000000001 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.979474+0000", 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4905e-05 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.979498+0000", 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3842e-05 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:22266 5.e 5:70c20ceb:::benchmark_data_smithi069_31227_object22265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.969856+0000", 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.23741868199999999, 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00968456, 2024-04-26T12:15:10.302 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 22266 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969856+0000", 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969856+0000", 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969856+0000", 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969908+0000", 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1894999999999997e-05 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969916+0000", 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.371e-06 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.969923+0000", 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5830000000000003e-06 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.972758+0000", 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028355440000000002 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.972878+0000", 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120186 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.972960+0000", 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1316999999999994e-05 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.975654+0000", 2024-04-26T12:15:10.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026942160000000001 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.979503+0000", 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003849103 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.979525+0000", 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1641000000000002e-05 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.979541+0000", 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6354e-05 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:23242 5.0 5:060d83ab:::benchmark_data_smithi069_31227_object23241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:10.187767+0000", 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.019508312, 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010798209, 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.308 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 23242 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.187767+0000", 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.187767+0000", 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.187766+0000", 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.187803+0000", 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.68e-05 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.187810+0000", 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9589999999999998e-06 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.187816+0000", 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3300000000000004e-06 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.193552+0000", 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057354570000000002 2024-04-26T12:15:10.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.193631+0000", 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8961999999999994e-05 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.193745+0000", 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114067 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.196644+0000", 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002899015 2024-04-26T12:15:10.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.198458+0000", 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018143160000000001 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.198512+0000", 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3581000000000001e-05 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.198565+0000", 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3239000000000003e-05 2024-04-26T12:15:10.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:23247 5.0 5:0aea0422:::benchmark_data_smithi069_31227_object23246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:10.189145+0000", 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.018129956999999999, 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095097480000000002, 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.314 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 23247 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.189145+0000", 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.189145+0000", 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.189145+0000", 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.189212+0000", 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7232999999999998e-05 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.189221+0000", 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5359999999999998e-06 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.189226+0000", 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.194719+0000", 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054931609999999999 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.194837+0000", 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117793 2024-04-26T12:15:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.194970+0000", 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132702 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.197459+0000", 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024895270000000001 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.198574+0000", 2024-04-26T12:15:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011151119999999999 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.198616+0000", 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1714000000000001e-05 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:10.198655+0000", 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8943999999999998e-05 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:10.320 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:10.322 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:10.320+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:10.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:10.323 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-26T12:15:10.423 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:10.421+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:10.423 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:24504 5.5 5:a0d84893:::benchmark_data_smithi069_31227_object24503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.488118+0000", 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0028176490000000002, 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00284637, 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24504 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488118+0000", 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488118+0000", 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488117+0000", 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488144+0000", 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6849999999999999e-05 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488152+0000", 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488157+0000", 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4299999999999997e-06 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489098+0000", 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000940725 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489220+0000", 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012190500000000001 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:24506 5.5 5:a4352e69:::benchmark_data_smithi069_31227_object24505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.488715+0000", 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022205049999999998, 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022961750000000001, 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24506 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488715+0000", 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488715+0000", 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488714+0000", 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488745+0000", 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0923000000000002e-05 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488756+0000", 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1035e-05 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.488765+0000", 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6510000000000007e-06 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490334+0000", 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015690840000000001 2024-04-26T12:15:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490484+0000", 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015033599999999999 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:24508 5.7 5:edb07396:::benchmark_data_smithi069_31227_object24507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.489465+0000", 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001470954, 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015946619999999999, 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24508 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489465+0000", 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489465+0000", 2024-04-26T12:15:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489464+0000", 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489587+0000", 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012328400000000001 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489600+0000", 2024-04-26T12:15:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3022e-05 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489608+0000", 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3629999999999996e-06 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489659+0000", 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1600000000000001e-05 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489800+0000", 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014077800000000001 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:24507 5.b e21/16 5:dd7c4616:::benchmark_data_smithi069_31227_object24506:head v 21'1573, mlcod=21'1571)", 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.489588+0000", 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0013478489999999999, 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015246190000000001, 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489588+0000", 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489588+0000", 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489587+0000", 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489651+0000", 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3763999999999995e-05 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489660+0000", 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6400000000000003e-06 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489665+0000", 2024-04-26T12:15:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489702+0000", 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6724000000000003e-05 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489720+0000", 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7380999999999998e-05 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:24509 5.3 5:c26a82d5:::benchmark_data_smithi069_31227_object24508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.489625+0000", 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0013107279999999999, 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015568019999999999, 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24509 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489625+0000", 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489625+0000", 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489624+0000", 2024-04-26T12:15:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489670+0000", 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5552e-05 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489691+0000", 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1654e-05 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489698+0000", 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6499999999999999e-06 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489736+0000", 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8052000000000001e-05 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.489840+0000", 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103699 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:24510 5.0 e21/16 5:07181fe6:::benchmark_data_smithi069_31227_object24509:head v 21'1516, mlcod=21'1514)", 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.490231+0000", 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00070453599999999996, 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001021379, 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490231+0000", 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490231+0000", 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490230+0000", 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490292+0000", 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1171000000000001e-05 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490302+0000", 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0611999999999999e-05 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490309+0000", 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4080000000000003e-06 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490367+0000", 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8539000000000003e-05 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490405+0000", 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.803e-05 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:24512 5.4 e21/16 5:2bbcf2ca:::benchmark_data_smithi069_31227_object24511:head v 21'1553, mlcod=21'1551)", 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.490384+0000", 2024-04-26T12:15:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00055169099999999999, 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092524299999999996, 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490384+0000", 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490384+0000", 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490383+0000", 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490452+0000", 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8118000000000001e-05 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490460+0000", 2024-04-26T12:15:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1200000000000002e-06 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490465+0000", 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490612+0000", 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014694299999999999 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490631+0000", 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:24514 5.a 5:5695c4dd:::benchmark_data_smithi069_31227_object24513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.490286+0000", 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00064991699999999996, 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010879970000000001, 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24514 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490286+0000", 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490286+0000", 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490285+0000", 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490451+0000", 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000166751 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490463+0000", 2024-04-26T12:15:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1544e-05 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490469+0000", 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5380000000000002e-06 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490511+0000", 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2302000000000003e-05 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490639+0000", 2024-04-26T12:15:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012851099999999999 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.490755+0000", 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011597199999999999 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 8 2024-04-26T12:15:10.524 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:10.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:10.526 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:10.524+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:10.626 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:10.624+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:10.688 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:15:10.721 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:10.722 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:10.722 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:10.726 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:10.725+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:10.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:10.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 6 16 25600 25584 266.482 271.812 0.002 0.00374948 2024-04-26T12:15:10.827 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:10.826+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:10.858 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:10.858 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:10.858 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:10.878 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:10.878 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:10.882 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:10.883 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:10.897 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:10.898 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:10.912 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:10.956 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:10.955+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:11.029 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:11.028+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:11.061 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:11.061 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:11.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:11.130 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:11.128+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:11.231 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:11.229+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:11.262 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:11.262 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:11.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:11.359 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:11.358+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:11.433 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:11.431+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:11.465 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:11.465 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:11.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:11.533 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:11.532+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:11.634 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:11.633+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:11.640 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:11.640 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:11.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:11.682 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:15:11.735 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:11.734+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:11.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 7 16 29690 29674 264.928 255.625 0.00312238 0.00377104 2024-04-26T12:15:11.813 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:11.813 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:11.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:11.871 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:11.870+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:11.936 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:11.935+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:11.983 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:11.983 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:11.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:12.037 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:12.036+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:12.138 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:12.136+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:12.149 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:12.149 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:12.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:12.239 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:12.238+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:12.340 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:12.339+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:12.354 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:12.354 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:12.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:12.441 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:12.440+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:12.520 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:12.520 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:12.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:12.578 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:12.577+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:12.643 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:12.642+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:12.692 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:12.693 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:12.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:12.744 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:12.743+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:12.751 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 8 16 33595 33579 262.318 244.062 0.0032854 0.00380911 2024-04-26T12:15:12.845 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:12.844+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:12.884 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:12.903 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:12.903 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:12.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:12.946 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:12.945+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:13.012 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:13.012 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:13.012 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:13.032 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:13.032 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:13.035 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:13.035 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:13.047 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:13.046+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:13.112 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.24879658, 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012842965, 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860604+0000", 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860616+0000", 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-05 2024-04-26T12:15:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860628+0000", 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860640+0000", 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1948e-05 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861144+0000", 2024-04-26T12:15:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050421799999999996 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861294+0000", 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149741 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861573+0000", 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027888300000000001 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865700+0000", 2024-04-26T12:15:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041267869999999998 2024-04-26T12:15:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873353+0000", 2024-04-26T12:15:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076533549999999997 2024-04-26T12:15:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873408+0000", 2024-04-26T12:15:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4724e-05 2024-04-26T12:15:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873449+0000", 2024-04-26T12:15:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1130000000000001e-05 2024-04-26T12:15:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.248657987000001, 2024-04-26T12:15:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012872916, 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860751+0000", 2024-04-26T12:15:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4989999999999997e-06 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860766+0000", 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5277999999999998e-05 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860777+0000", 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-04-26T12:15:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862196+0000", 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014194749999999999 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862357+0000", 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016099300000000001 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862626+0000", 2024-04-26T12:15:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026869399999999999 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865793+0000", 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003167076 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873525+0000", 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077318420000000001 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873574+0000", 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9444999999999998e-05 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873617+0000", 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3034000000000002e-05 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.248619097999999, 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011713941, 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860787+0000", 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000002e-06 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860798+0000", 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0766e-05 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860807+0000", 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.081e-06 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862318+0000", 2024-04-26T12:15:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015111739999999999 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862596+0000", 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027813799999999999 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862721+0000", 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425700000000001 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865738+0000", 2024-04-26T12:15:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003017619 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872418+0000", 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066796609999999999 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872471+0000", 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3251000000000002e-05 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872497+0000", 2024-04-26T12:15:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6071000000000002e-05 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.248445482000001, 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011656498, 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860956+0000", 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860964+0000", 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9489999999999996e-06 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860977+0000", 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3159999999999999e-05 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860988+0000", 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-04-26T12:15:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863879+0000", 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028914019999999999 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863983+0000", 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103947 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864216+0000", 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023310400000000001 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866761+0000", 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025451940000000002 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872568+0000", 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058070329999999996 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872595+0000", 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6821999999999998e-05 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872613+0000", 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8343999999999999e-05 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.248408173000001, 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012981602, 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860998+0000", 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1760000000000003e-06 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861005+0000", 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861013+0000", 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-06 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864442+0000", 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034288909999999999 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864579+0000", 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013655000000000001 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864726+0000", 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146821 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867844+0000", 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031183880000000001 2024-04-26T12:15:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873900+0000", 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060559790000000004 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873940+0000", 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9626999999999999e-05 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873976+0000", 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6327e-05 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.248382663000001, 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012198451000000001, 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861019+0000", 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861023+0000", 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861030+0000", 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861036+0000", 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5430000000000001e-06 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861491+0000", 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000455606 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861725+0000", 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023400100000000001 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861842+0000", 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116717 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866171+0000", 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043294830000000003 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873128+0000", 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069568080000000001 2024-04-26T12:15:13.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873180+0000", 2024-04-26T12:15:13.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1792999999999997e-05 2024-04-26T12:15:13.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873218+0000", 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.247949497, 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012135589, 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861452+0000", 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861458+0000", 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3740000000000003e-06 2024-04-26T12:15:13.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861469+0000", 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0251999999999999e-05 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861477+0000", 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862181+0000", 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070414999999999996 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862298+0000", 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011689899999999999 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873589+0000", 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011290432 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.247916559, 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012630707999999999, 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861485+0000", 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861488+0000", 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:15:13.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861495+0000", 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861501+0000", 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865278+0000", 2024-04-26T12:15:13.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037777829999999998 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865405+0000", 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012616999999999999 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874117+0000", 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087119399999999996 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5342 5.a 5:55424964:::benchmark_data_smithi069_31227_object5341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4501244230000001, 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013003953, 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5342 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659277+0000", 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659408+0000", 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130579 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659416+0000", 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659421+0000", 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5450000000000003e-06 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659713+0000", 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029148299999999999 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659919+0000", 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020655700000000001 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660098+0000", 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179039 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662447+0000", 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023482540000000001 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672214+0000", 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097676150000000003 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672248+0000", 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4103000000000002e-05 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672282+0000", 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3584999999999998e-05 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5346 5.a 5:563f63a2:::benchmark_data_smithi069_31227_object5345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4496790910000001, 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012632412000000001, 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5346 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:13.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659722+0000", 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659782+0000", 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9444999999999998e-05 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659791+0000", 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659799+0000", 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.515e-06 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660621+0000", 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082202999999999996 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660743+0000", 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122562 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660872+0000", 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012882 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663166+0000", 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022937859999999999 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672308+0000", 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009142397 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672336+0000", 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7509e-05 2024-04-26T12:15:13.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672356+0000", 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0114000000000001e-05 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5349 5.a 5:50d05031:::benchmark_data_smithi069_31227_object5348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4488791870000002, 2024-04-26T12:15:13.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011904534, 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5349 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660522+0000", 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660647+0000", 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124566 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660657+0000", 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660672+0000", 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5221e-05 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661256+0000", 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058376299999999995 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661382+0000", 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012674799999999999 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661496+0000", 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113675 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668095+0000", 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065989789999999996 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672382+0000", 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004287005 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672405+0000", 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2569e-05 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672428+0000", 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3169000000000001e-05 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:5353 5.b e18/16 5:d3c8c78e:::benchmark_data_smithi069_31227_object5352:head v 18'334, mlcod=18'330)", 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.447990603, 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089410759999999992, 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661412+0000", 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661411+0000", 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661493+0000", 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1619000000000006e-05 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661502+0000", 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4739999999999994e-06 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661508+0000", 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5729999999999998e-06 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661610+0000", 2024-04-26T12:15:13.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101613 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661629+0000", 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9352e-05 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670312+0000", 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086831660000000008 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670353+0000", 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0815000000000001e-05 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5357 5.a 5:5fa00d19:::benchmark_data_smithi069_31227_object5356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4474402570000002, 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010883591999999999, 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5357 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661962+0000", 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662062+0000", 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100047 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662072+0000", 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.045e-05 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662079+0000", 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4590000000000003e-06 2024-04-26T12:15:13.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663188+0000", 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011097609999999999 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667518+0000", 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043295060000000003 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.667663+0000", 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014561500000000001 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.669650+0000", 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001986617 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672776+0000", 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031263179999999999 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672817+0000", 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0522999999999998e-05 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672846+0000", 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8895e-05 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:5355 5.b e18/16 5:d8bc4a2c:::benchmark_data_smithi069_31227_object5354:head v 18'335, mlcod=18'331)", 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4468050110000004, 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011117659, 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662597+0000", 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662626+0000", 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8875000000000001e-05 2024-04-26T12:15:13.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662632+0000", 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662637+0000", 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6800000000000001e-06 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670544+0000", 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079072650000000001 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.670564+0000", 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9766e-05 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673688+0000", 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031234449999999999 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.673715+0000", 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7474000000000002e-05 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:17281 5.a 5:5874f52a:::benchmark_data_smithi069_31227_object17280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:08.884080+0000", 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2253225619999997, 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084542820000000005, 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17281 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884080+0000", 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884080+0000", 2024-04-26T12:15:13.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884079+0000", 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884153+0000", 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4266999999999999e-05 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884164+0000", 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0183000000000001e-05 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.884171+0000", 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0870000000000001e-06 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.886010+0000", 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018394290000000001 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.886138+0000", 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012748800000000001 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.886270+0000", 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013223600000000001 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.887341+0000", 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010709230000000001 2024-04-26T12:15:13.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.892458+0000", 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051176340000000002 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.892502+0000", 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3350000000000003e-05 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:08.892534+0000", 2024-04-26T12:15:13.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2339000000000003e-05 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:19727 5.a 5:59b75644:::benchmark_data_smithi069_31227_object19726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.414071+0000", 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6953314640000001, 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089428000000000007, 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 19727 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414071+0000", 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414071+0000", 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414070+0000", 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414196+0000", 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126095 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414204+0000", 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0220000000000004e-06 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.414223+0000", 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8502e-05 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.415059+0000", 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083655399999999999 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.415189+0000", 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012978499999999999 2024-04-26T12:15:13.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.415340+0000", 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015076600000000001 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.418524+0000", 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003184395 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.422930+0000", 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044058530000000004 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.422979+0000", 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8483999999999999e-05 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.423014+0000", 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5154999999999998e-05 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:21824 5.a 5:56957892:::benchmark_data_smithi069_31227_object21823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.869387+0000", 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.240015348, 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097532379999999991, 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21824 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869387+0000", 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869387+0000", 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869386+0000", 2024-04-26T12:15:13.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869472+0000", 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5928999999999997e-05 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869484+0000", 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.152e-05 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869492+0000", 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9060000000000002e-06 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869532+0000", 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0414000000000003e-05 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869657+0000", 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000125303 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.869804+0000", 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146608 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.870965+0000", 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011608440000000001 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.879058+0000", 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080935509999999992 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.879106+0000", 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7253999999999999e-05 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.879140+0000", 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4560000000000001e-05 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:22262 5.a 5:5b25744f:::benchmark_data_smithi069_31227_object22261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:09.969163+0000", 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.1402392790000002, 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092476120000000005, 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 22262 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969163+0000", 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969163+0000", 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969163+0000", 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969263+0000", 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010055 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969271+0000", 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7749999999999993e-06 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969276+0000", 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969303+0000", 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7871000000000001e-05 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969381+0000", 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8072999999999996e-05 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.969454+0000", 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2713000000000007e-05 2024-04-26T12:15:13.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.970469+0000", 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010148609999999999 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.978361+0000", 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078924049999999999 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.978391+0000", 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9288000000000001e-05 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:09.978411+0000", 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9996999999999998e-05 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:22664 5.a 5:584a20ec:::benchmark_data_smithi069_31227_object22663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.057318+0000", 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0520843069999999, 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092336799999999993, 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 22664 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.057318+0000", 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.057318+0000", 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.057313+0000", 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999948 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.057446+0000", 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133387 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.057455+0000", 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7399999999999993e-06 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.057461+0000", 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6540000000000004e-06 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.058535+0000", 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010738709999999999 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.058646+0000", 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110875 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.058747+0000", 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010168 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.060095+0000", 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00134764 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.066475+0000", 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063804150000000004 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.066519+0000", 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3782000000000002e-05 2024-04-26T12:15:13.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.066552+0000", 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2746000000000001e-05 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:23885 5.a 5:5b633323:::benchmark_data_smithi069_31227_object23884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:10.335576+0000", 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.7738259960000002, 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090525529999999996, 2024-04-26T12:15:13.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 23885 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.335576+0000", 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.335576+0000", 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.335576+0000", 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.335744+0000", 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000167792 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.335752+0000", 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7250000000000003e-06 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.335758+0000", 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.336827+0000", 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010689919999999999 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.336940+0000", 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011268 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.337050+0000", 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110215 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.338266+0000", 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001215966 2024-04-26T12:15:13.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.344397+0000", 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061310260000000004 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.344594+0000", 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019729400000000001 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:10.344629+0000", 2024-04-26T12:15:13.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4612e-05 2024-04-26T12:15:13.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:13.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:13.227 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:13.228 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:13.227+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:13.229 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:13.329 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:13.328+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:13.379 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:13.379 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:13.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.379 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35815 5.9 5:90a4d5b4:::benchmark_data_smithi069_31227_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.373789+0000", 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037999309999999999, 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038255210000000001, 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35815 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.373789+0000", 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.373789+0000", 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.373788+0000", 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.373821+0000", 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2654999999999998e-05 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.373829+0000", 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4789999999999996e-06 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.373835+0000", 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375254+0000", 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001418905 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375475+0000", 2024-04-26T12:15:13.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00022123499999999999 2024-04-26T12:15:13.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.384 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35817 5.8 5:171bb811:::benchmark_data_smithi069_31227_object35816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.374002+0000", 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035865609999999998, 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037107199999999998, 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35817 2024-04-26T12:15:13.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374002+0000", 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374002+0000", 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374001+0000", 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374044+0000", 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2664999999999999e-05 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374053+0000", 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:15:13.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374058+0000", 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4700000000000001e-06 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374099+0000", 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1332999999999999e-05 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374211+0000", 2024-04-26T12:15:13.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011209099999999999 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374331+0000", 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011951999999999999 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35820 5.8 5:1552b474:::benchmark_data_smithi069_31227_object35819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.374167+0000", 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034217330000000002, 2024-04-26T12:15:13.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036299660000000001, 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35820 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374167+0000", 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374167+0000", 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374166+0000", 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374253+0000", 2024-04-26T12:15:13.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7261000000000004e-05 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374263+0000", 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6639999999999993e-06 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.374270+0000", 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.861e-06 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375625+0000", 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001355031 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375752+0000", 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012749300000000001 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375886+0000", 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013399700000000001 2024-04-26T12:15:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35822 5.9 5:92eb36e8:::benchmark_data_smithi069_31227_object35821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.375366+0000", 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022220090000000001, 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025054959999999999, 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.394 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35822 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375366+0000", 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375366+0000", 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375366+0000", 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375470+0000", 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010432100000000001 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375479+0000", 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3780000000000007e-06 2024-04-26T12:15:13.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375485+0000", 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2190000000000001e-06 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376804+0000", 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013181899999999999 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376914+0000", 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011034700000000001 2024-04-26T12:15:13.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35823 5.e 5:7166510a:::benchmark_data_smithi069_31227_object35822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.375666+0000", 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019223770000000001, 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022759730000000001, 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35823 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375666+0000", 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375666+0000", 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375665+0000", 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375699+0000", 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3200000000000001e-05 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375708+0000", 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9229999999999997e-06 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375716+0000", 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.469e-06 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375768+0000", 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1768999999999999e-05 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375851+0000", 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3675000000000001e-05 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376026+0000", 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017504700000000001 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35826 5.b 5:dc2b608e:::benchmark_data_smithi069_31227_object35825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.375731+0000", 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018577890000000001, 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022904760000000001, 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35826 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375731+0000", 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375731+0000", 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375730+0000", 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375797+0000", 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6445999999999994e-05 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375806+0000", 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6239999999999997e-06 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375812+0000", 2024-04-26T12:15:13.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.964e-06 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375846+0000", 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3725e-05 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375957+0000", 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111483 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376103+0000", 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014512999999999999 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35828 5.0 5:0aad4e3e:::benchmark_data_smithi069_31227_object35827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.375886+0000", 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001702722, 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022040670000000001, 2024-04-26T12:15:13.407 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35828 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375886+0000", 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375886+0000", 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.375885+0000", 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376019+0000", 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000133757 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376039+0000", 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9814e-05 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376044+0000", 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1900000000000003e-06 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376121+0000", 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7047999999999998e-05 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376274+0000", 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015312299999999999 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376405+0000", 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013102 2024-04-26T12:15:13.411 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35830 5.b 5:d1c5bc6a:::benchmark_data_smithi069_31227_object35829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.376380+0000", 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001208209, 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017503180000000001, 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.412 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35830 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376380+0000", 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376380+0000", 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376379+0000", 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376517+0000", 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013726100000000001 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376527+0000", 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9329999999999996e-06 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376541+0000", 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4100000000000001e-05 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377440+0000", 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00089904600000000002 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377533+0000", 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3114000000000003e-05 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377616+0000", 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3218000000000002e-05 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:35829 5.a e22/16 5:56bef9e9:::benchmark_data_smithi069_31227_object35828:head v 22'2192, mlcod=22'2190)", 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.376592+0000", 2024-04-26T12:15:13.417 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00099647899999999998, 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015761779999999999, 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376592+0000", 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376592+0000", 2024-04-26T12:15:13.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376591+0000", 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376620+0000", 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8810999999999999e-05 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376628+0000", 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0730000000000005e-06 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376634+0000", 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3489999999999999e-06 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376671+0000", 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7287999999999999e-05 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.376689+0000", 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8243000000000001e-05 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35833 5.d 5:bde755f8:::benchmark_data_smithi069_31227_object35832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.377151+0000", 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000437778, 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001072181, 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35833 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377151+0000", 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377151+0000", 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377150+0000", 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377179+0000", 2024-04-26T12:15:13.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377189+0000", 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3039999999999994e-06 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377196+0000", 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377235+0000", 2024-04-26T12:15:13.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8297999999999998e-05 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.377352+0000", 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117229 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-26T12:15:13.425 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:13.427 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:13.470 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:13.469+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:13.531 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:13.530+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:13.570 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:13.570 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:13.570 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:13.570 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:13.570 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:13.583 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:13.632 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:13.630+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:13.695 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:15:13.732 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:13.731+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:13.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 9 16 37158 37142 257.912 222.688 0.00309275 0.00387452 2024-04-26T12:15:13.776 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:13.776 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:13.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:13.777 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:13.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.777 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.777 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:13.777 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.912582005000001, 2024-04-26T12:15:13.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014073476999999999, 2024-04-26T12:15:13.778 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.778 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.778 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:13.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859665+0000", 2024-04-26T12:15:13.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859663+0000", 2024-04-26T12:15:13.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999981 2024-04-26T12:15:13.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859674+0000", 2024-04-26T12:15:13.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0736e-05 2024-04-26T12:15:13.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859689+0000", 2024-04-26T12:15:13.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5318000000000001e-05 2024-04-26T12:15:13.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.859702+0000", 2024-04-26T12:15:13.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2091e-05 2024-04-26T12:15:13.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862268+0000", 2024-04-26T12:15:13.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025663650000000001 2024-04-26T12:15:13.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862403+0000", 2024-04-26T12:15:13.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134812 2024-04-26T12:15:13.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862516+0000", 2024-04-26T12:15:13.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011333299999999999 2024-04-26T12:15:13.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866182+0000", 2024-04-26T12:15:13.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003666019 2024-04-26T12:15:13.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873647+0000", 2024-04-26T12:15:13.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074652499999999997 2024-04-26T12:15:13.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873699+0000", 2024-04-26T12:15:13.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1894999999999997e-05 2024-04-26T12:15:13.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873739+0000", 2024-04-26T12:15:13.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9360999999999998e-05 2024-04-26T12:15:13.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.789 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.789 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.790 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.790 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:13.790 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.912077695000001, 2024-04-26T12:15:13.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013691603, 2024-04-26T12:15:13.791 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.791 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.791 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:13.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:13.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860169+0000", 2024-04-26T12:15:13.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860176+0000", 2024-04-26T12:15:13.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7719999999999994e-06 2024-04-26T12:15:13.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860187+0000", 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0922e-05 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860238+0000", 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1189000000000001e-05 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862855+0000", 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026161460000000002 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862933+0000", 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8714999999999994e-05 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863088+0000", 2024-04-26T12:15:13.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154902 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866289+0000", 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032008169999999999 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873783+0000", 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074935100000000001 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873829+0000", 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6181999999999999e-05 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873861+0000", 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2320000000000002e-05 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.799 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.911362445000002, 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013456986000000001, 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860885+0000", 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860884+0000", 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860891+0000", 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9120000000000001e-06 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860900+0000", 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1980000000000007e-06 2024-04-26T12:15:13.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.860953+0000", 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3451e-05 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863286+0000", 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023325360000000001 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863386+0000", 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100498 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863481+0000", 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4388000000000005e-05 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866407+0000", 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029256899999999999 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874251+0000", 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078446680000000008 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874299+0000", 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8154e-05 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874342+0000", 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2330999999999998e-05 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.910774426, 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013022891999999999, 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:13.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861473+0000", 2024-04-26T12:15:13.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861472+0000", 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861481+0000", 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7339999999999997e-06 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861494+0000", 2024-04-26T12:15:13.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2826999999999999e-05 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861502+0000", 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4509999999999992e-06 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863795+0000", 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002292845 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863844+0000", 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9531999999999999e-05 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863938+0000", 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3962999999999995e-05 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869387+0000", 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054482080000000004 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874431+0000", 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050444599999999997 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874472+0000", 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0717000000000003e-05 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874496+0000", 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3836999999999999e-05 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.811 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.910738316, 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012184309000000001, 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861509+0000", 2024-04-26T12:15:13.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861508+0000", 2024-04-26T12:15:13.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861512+0000", 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9299999999999996e-06 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861552+0000", 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9684999999999997e-05 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861559+0000", 2024-04-26T12:15:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8499999999999996e-06 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861620+0000", 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1048000000000002e-05 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861781+0000", 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000161075 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861951+0000", 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170447 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864200+0000", 2024-04-26T12:15:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002248758 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873592+0000", 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093917219999999999 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873643+0000", 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1413999999999999e-05 2024-04-26T12:15:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873693+0000", 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0099000000000003e-05 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.910666935999998, 2024-04-26T12:15:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01226267, 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861580+0000", 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861579+0000", 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861585+0000", 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4160000000000003e-06 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861591+0000", 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5980000000000002e-06 2024-04-26T12:15:13.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861598+0000", 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5080000000000002e-06 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862487+0000", 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088919800000000001 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862578+0000", 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0879999999999997e-05 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862715+0000", 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013701699999999999 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.866365+0000", 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036497589999999998 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873759+0000", 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073938679999999996 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873810+0000", 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0958999999999998e-05 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873843+0000", 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3232000000000003e-05 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.910628191000001, 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012846606999999999, 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.825 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861619+0000", 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861618+0000", 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861626+0000", 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7829999999999999e-06 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861634+0000", 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7170000000000008e-06 2024-04-26T12:15:13.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861639+0000", 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864257+0000", 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002617308 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864354+0000", 2024-04-26T12:15:13.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7211000000000002e-05 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.864457+0000", 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010295599999999999 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.869597+0000", 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051396849999999997 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874383+0000", 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004786106 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874435+0000", 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2473999999999999e-05 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.874466+0000", 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0485e-05 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.830 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.910597697, 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012237605, 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861649+0000", 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861652+0000", 2024-04-26T12:15:13.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0709999999999999e-06 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861670+0000", 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7694999999999999e-05 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.861677+0000", 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9109999999999993e-06 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.862368+0000", 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00069049699999999999 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.863241+0000", 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00087347900000000003 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:14:42.873887+0000", 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010645635000000001 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.834 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:5355 5.b 5:d8bc4a2c:::benchmark_data_smithi069_31227_object5354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.1109977059999991, 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012663186999999999, 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.835 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 5355 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661249+0000", 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661339+0000", 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0095999999999999e-05 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661347+0000", 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0600000000000008e-06 2024-04-26T12:15:13.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661352+0000", 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2800000000000003e-06 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661882+0000", 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00053007300000000005 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.661996+0000", 2024-04-26T12:15:13.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113459 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.662126+0000", 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013037899999999999 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.664852+0000", 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027257689999999998 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673852+0000", 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090002499999999996 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673893+0000", 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0401000000000002e-05 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:05.673913+0000", 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0013e-05 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.840 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:17004 5.b 5:dbcb6123:::benchmark_data_smithi069_31227_object17003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.9466085209999999, 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012910595, 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 17004 2024-04-26T12:15:13.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825639+0000", 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825638+0000", 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825720+0000", 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1680000000000004e-05 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825729+0000", 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3689999999999996e-06 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.825736+0000", 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5629999999999997e-06 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826284+0000", 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00054786500000000003 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826399+0000", 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011549599999999999 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.826501+0000", 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010169400000000001 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.830165+0000", 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003664662 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838471+0000", 2024-04-26T12:15:13.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083052679999999993 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838515+0000", 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4165999999999997e-05 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:08.838549+0000", 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4403000000000002e-05 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:21812 5.0 5:06769dd0:::benchmark_data_smithi069_31227_object21811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:09.866806+0000", 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.905441379, 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012099967, 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 21812 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866806+0000", 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866806+0000", 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866805+0000", 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866889+0000", 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866899+0000", 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0592e-05 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.866908+0000", 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.439e-06 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.869905+0000", 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029973650000000001 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.870038+0000", 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013352899999999999 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.870208+0000", 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016922500000000001 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.871831+0000", 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001623088 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878810+0000", 2024-04-26T12:15:13.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069794159999999996 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878860+0000", 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0078999999999999e-05 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:09.878906+0000", 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5495999999999999e-05 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:34743 5.4 5:216d5d25:::benchmark_data_smithi069_31227_object34742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.070680+0000", 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.70156763600000005, 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012461119999999999, 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 34743 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.070680+0000", 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.070680+0000", 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.070679+0000", 2024-04-26T12:15:13.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.070755+0000", 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6687000000000006e-05 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.070765+0000", 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.961e-06 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.070771+0000", 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1589999999999998e-06 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.073893+0000", 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031219469999999999 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.073987+0000", 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3801000000000005e-05 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.074062+0000", 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4784999999999996e-05 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.076802+0000", 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027404399999999998 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.083092+0000", 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062900789999999996 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.083121+0000", 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8958999999999998e-05 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.083141+0000", 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9188999999999999e-05 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:34786 5.8 5:151a1b0d:::benchmark_data_smithi069_31227_object34785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.087572+0000", 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.68467492600000002, 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012465074, 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 34786 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087572+0000", 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087572+0000", 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087572+0000", 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087636+0000", 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4300000000000004e-05 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087641+0000", 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3090000000000003e-06 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087645+0000", 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0430000000000001e-06 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087674+0000", 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8772000000000002e-05 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087755+0000", 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0526999999999997e-05 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.087829+0000", 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4457999999999998e-05 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.090938+0000", 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031085190000000001 2024-04-26T12:15:13.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.099951+0000", 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.009013007 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.099995+0000", 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4532e-05 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.100037+0000", 2024-04-26T12:15:13.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1993000000000003e-05 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35693 5.0 5:05d7c468:::benchmark_data_smithi069_31227_object35692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.338577+0000", 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.43367056900000001, 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012257328, 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.866 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35693 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.338577+0000", 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.338577+0000", 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.338575+0000", 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.338609+0000", 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3380000000000002e-05 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.338649+0000", 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0540000000000001e-05 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.338660+0000", 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0210999999999999e-05 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.342898+0000", 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042382280000000001 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.342981+0000", 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3539000000000001e-05 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.343063+0000", 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1977999999999993e-05 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.345930+0000", 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002867119 2024-04-26T12:15:13.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.350749+0000", 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048181400000000003 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.350784+0000", 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5219999999999998e-05 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.350834+0000", 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0123000000000001e-05 2024-04-26T12:15:13.871 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:35698 5.0 5:0f39a5a7:::benchmark_data_smithi069_31227_object35697:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.340513+0000", 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.43173384399999998, 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013000438, 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.872 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 35698 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.340513+0000", 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.340513+0000", 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.340513+0000", 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.340599+0000", 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6098000000000001e-05 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.340605+0000", 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7810000000000002e-06 2024-04-26T12:15:13.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.340608+0000", 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3009999999999998e-06 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.344192+0000", 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035839539999999999 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.344283+0000", 2024-04-26T12:15:13.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0812999999999999e-05 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.344388+0000", 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010469800000000001 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.346280+0000", 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001892775 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.353445+0000", 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071650450000000001 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.353483+0000", 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8046999999999997e-05 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.353514+0000", 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0294000000000002e-05 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.877 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:36589 5.d 5:b7652cdc:::benchmark_data_smithi069_31227_object36588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.587020+0000", 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.185227582, 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012394261, 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36589 2024-04-26T12:15:13.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.587020+0000", 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.587020+0000", 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.587019+0000", 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.587132+0000", 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011273999999999999 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.587142+0000", 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0322999999999999e-05 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.587148+0000", 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0390000000000001e-06 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.590681+0000", 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035330829999999998 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.590763+0000", 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2348000000000005e-05 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.599293+0000", 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085291510000000004 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.599342+0000", 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9172999999999998e-05 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.599414+0000", 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2118000000000003e-05 2024-04-26T12:15:13.882 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:36611 5.0 5:0c322918:::benchmark_data_smithi069_31227_object36610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.593042+0000", 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.17920560399999999, 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.013503918, 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.883 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36611 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.593042+0000", 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.593042+0000", 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.593041+0000", 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.593117+0000", 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6433000000000005e-05 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.593128+0000", 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0869e-05 2024-04-26T12:15:13.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.593135+0000", 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4590000000000003e-06 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.599453+0000", 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063184640000000002 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.599582+0000", 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128947 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.599725+0000", 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014257000000000001 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.603262+0000", 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035370139999999998 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.606450+0000", 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031886789999999998 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.606499+0000", 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8381999999999999e-05 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.606545+0000", 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6876999999999999e-05 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.888 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:36788 5.9 5:9a031051:::benchmark_data_smithi069_31227_object36787:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.644936+0000", 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.127311385, 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012734675000000001, 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36788 2024-04-26T12:15:13.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.644936+0000", 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.644936+0000", 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.644935+0000", 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.644974+0000", 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8651e-05 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.644982+0000", 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2840000000000006e-06 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.644988+0000", 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.646750+0000", 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001761779 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.646902+0000", 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000152163 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.657546+0000", 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010643819000000001 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.657589+0000", 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3001999999999999e-05 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.657670+0000", 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1939000000000003e-05 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:36799 5.4 5:26c51b0a:::benchmark_data_smithi069_31227_object36798:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.648335+0000", 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.123911988, 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014138839, 2024-04-26T12:15:13.894 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36799 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.648335+0000", 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.648335+0000", 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.648334+0000", 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.648399+0000", 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5234000000000006e-05 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.648415+0000", 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5105e-05 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.648421+0000", 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.654974+0000", 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0065529159999999998 2024-04-26T12:15:13.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.655095+0000", 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120903 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.655236+0000", 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014096099999999999 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.657752+0000", 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025166379999999999 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.662392+0000", 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046395009999999999 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.662436+0000", 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.662474+0000", 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7721e-05 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:36802 5.4 5:2d304e1f:::benchmark_data_smithi069_31227_object36801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:13.649907+0000", 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.12233970600000001, 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012643866, 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:13.900 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 36802 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.649907+0000", 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:13.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.649907+0000", 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.649907+0000", 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.649963+0000", 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6505000000000002e-05 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.649979+0000", 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5308999999999999e-05 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.649984+0000", 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0050000000000004e-06 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.656364+0000", 2024-04-26T12:15:13.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063803619999999997 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.656460+0000", 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5989999999999994e-05 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.656534+0000", 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3983e-05 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.657978+0000", 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001444482 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.662481+0000", 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045026019999999996 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.662521+0000", 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0113e-05 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:13.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:13.662551+0000", 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0202e-05 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:13.906 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:13.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:13.908 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:13.906+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:14.008 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:14.007+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:14.066 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:38269 5.8 e22/16 5:13250526:::benchmark_data_smithi069_31227_object38268:head v 22'2421, mlcod=22'2419)", 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063974+0000", 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00077339399999999995, 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079465099999999995, 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063974+0000", 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063974+0000", 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063973+0000", 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064090+0000", 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116313 2024-04-26T12:15:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064098+0000", 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3669999999999997e-06 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064103+0000", 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2650000000000004e-06 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064144+0000", 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1196000000000003e-05 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064161+0000", 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6546999999999999e-05 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38278 5.6 5.eed309c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.064053+0000", 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00069398699999999997, 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077441299999999995, 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38278 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064053+0000", 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064053+0000", 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064052+0000", 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064099+0000", 2024-04-26T12:15:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6346e-05 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064108+0000", 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3749999999999992e-06 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064115+0000", 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38280 5.7 5.9ef07da7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.064121+0000", 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00062581500000000005, 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076122600000000005, 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38280 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064121+0000", 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064121+0000", 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064121+0000", 2024-04-26T12:15:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064158+0000", 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7743000000000001e-05 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064168+0000", 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2269999999999999e-06 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064173+0000", 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38266 5.5 5:af0fcb74:::benchmark_data_smithi069_31227_object38265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063320+0000", 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001427521, 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001631216, 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38266 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063320+0000", 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063320+0000", 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063319+0000", 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063431+0000", 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112392 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063442+0000", 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0275000000000001e-05 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063447+0000", 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0309999999999998e-06 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063473+0000", 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6608999999999999e-05 2024-04-26T12:15:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063545+0000", 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2244999999999997e-05 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38271 5.3 5:c64a7afb:::benchmark_data_smithi069_31227_object38270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063455+0000", 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001292334, 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015684239999999999, 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38271 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063455+0000", 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063455+0000", 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063454+0000", 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063535+0000", 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1388000000000001e-05 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063541+0000", 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6729999999999997e-06 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063545+0000", 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.394e-06 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063581+0000", 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6321e-05 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063687+0000", 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010586600000000001 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38272 5.2 5:46583bdc:::benchmark_data_smithi069_31227_object38271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063550+0000", 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001197018, 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001542259, 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38272 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063550+0000", 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063550+0000", 2024-04-26T12:15:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063550+0000", 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063640+0000", 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0706999999999997e-05 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063646+0000", 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1159999999999998e-06 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063649+0000", 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1489999999999998e-06 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063681+0000", 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2212000000000003e-05 2024-04-26T12:15:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063792+0000", 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110604 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:38267 5.e e22/16 5:703f9447:::benchmark_data_smithi069_31227_object38266:head v 22'2414, mlcod=22'2412)", 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063686+0000", 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001060671, 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001469859, 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063686+0000", 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063686+0000", 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063686+0000", 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063773+0000", 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7115999999999997e-05 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063782+0000", 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8240000000000006e-06 2024-04-26T12:15:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063788+0000", 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063822+0000", 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4294000000000001e-05 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063840+0000", 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8391999999999999e-05 2024-04-26T12:15:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38273 5.5 5:a478b989:::benchmark_data_smithi069_31227_object38272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063656+0000", 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001091292, 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015645730000000001, 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38273 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063656+0000", 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063656+0000", 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063655+0000", 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063812+0000", 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015690300000000001 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063822+0000", 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3319999999999998e-06 2024-04-26T12:15:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063828+0000", 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8090000000000004e-06 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064753+0000", 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092464999999999995 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064866+0000", 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011258499999999999 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38274 5.7 5:e0e97cf3:::benchmark_data_smithi069_31227_object38273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063837+0000", 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00091021500000000003, 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014505480000000001, 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38274 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063837+0000", 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063837+0000", 2024-04-26T12:15:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063836+0000", 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063889+0000", 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2707000000000002e-05 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063899+0000", 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0171e-05 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063905+0000", 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.857e-06 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063935+0000", 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9998999999999999e-05 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064039+0000", 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103631 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:38277 5.6 5:61c9f191:::benchmark_data_smithi069_31227_object38276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.063916+0000", 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00083128800000000001, 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014121579999999999, 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38277 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063916+0000", 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063916+0000", 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.063915+0000", 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064006+0000", 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0618999999999994e-05 2024-04-26T12:15:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064018+0000", 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.24e-05 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064026+0000", 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064078+0000", 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1795000000000001e-05 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.064188+0000", 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109967 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 10 2024-04-26T12:15:14.106 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:14.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:14.109 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:14.108+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:14.210 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:14.209+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:14.260 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:14.260 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:14.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:14.311 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:14.310+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:14.412 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:14.411+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561868751999999, 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012842965, 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860604+0000", 2024-04-26T12:15:14.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860616+0000", 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-05 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860628+0000", 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860640+0000", 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1948e-05 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861144+0000", 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050421799999999996 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861294+0000", 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149741 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861573+0000", 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027888300000000001 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865700+0000", 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041267869999999998 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873353+0000", 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076533549999999997 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873408+0000", 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4724e-05 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873449+0000", 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1130000000000001e-05 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561730159, 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012872916, 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860751+0000", 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4989999999999997e-06 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860766+0000", 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5277999999999998e-05 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860777+0000", 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862196+0000", 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014194749999999999 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862357+0000", 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016099300000000001 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862626+0000", 2024-04-26T12:15:14.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026869399999999999 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865793+0000", 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003167076 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873525+0000", 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077318420000000001 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873574+0000", 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9444999999999998e-05 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873617+0000", 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3034000000000002e-05 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:14.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561691270000001, 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011713941, 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860783+0000", 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860787+0000", 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000002e-06 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860798+0000", 2024-04-26T12:15:14.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0766e-05 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860807+0000", 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.081e-06 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862318+0000", 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015111739999999999 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862596+0000", 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027813799999999999 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862721+0000", 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425700000000001 2024-04-26T12:15:14.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865738+0000", 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003017619 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872418+0000", 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066796609999999999 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872471+0000", 2024-04-26T12:15:14.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3251000000000002e-05 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872497+0000", 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6071000000000002e-05 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:14.442 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561517653999999, 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011656498, 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860957+0000", 2024-04-26T12:15:14.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860956+0000", 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860964+0000", 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9489999999999996e-06 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860977+0000", 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3159999999999999e-05 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860988+0000", 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863879+0000", 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028914019999999999 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.863983+0000", 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103947 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864216+0000", 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023310400000000001 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866761+0000", 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025451940000000002 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872568+0000", 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058070329999999996 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872595+0000", 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6821999999999998e-05 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.872613+0000", 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8343999999999999e-05 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.447 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561480345, 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012981602, 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:14.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860998+0000", 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1760000000000003e-06 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861005+0000", 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861013+0000", 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-06 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864442+0000", 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034288909999999999 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864579+0000", 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013655000000000001 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864726+0000", 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146821 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867844+0000", 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031183880000000001 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873900+0000", 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060559790000000004 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873940+0000", 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9626999999999999e-05 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873976+0000", 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6327e-05 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561454834999999, 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012198451000000001, 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861020+0000", 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861019+0000", 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861023+0000", 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861030+0000", 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861036+0000", 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5430000000000001e-06 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861491+0000", 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000455606 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861725+0000", 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023400100000000001 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861842+0000", 2024-04-26T12:15:14.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116717 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.866171+0000", 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043294830000000003 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873128+0000", 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069568080000000001 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873180+0000", 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1792999999999997e-05 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873218+0000", 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:14.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561021668999999, 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012135589, 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861453+0000", 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861452+0000", 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861458+0000", 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3740000000000003e-06 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861469+0000", 2024-04-26T12:15:14.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0251999999999999e-05 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861477+0000", 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862181+0000", 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070414999999999996 2024-04-26T12:15:14.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862298+0000", 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011689899999999999 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873589+0000", 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011290432 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.560988730999998, 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012630707999999999, 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861485+0000", 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861488+0000", 2024-04-26T12:15:14.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861495+0000", 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861501+0000", 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-04-26T12:15:14.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865278+0000", 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037777829999999998 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865405+0000", 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012616999999999999 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874117+0000", 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087119399999999996 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5342 5.a 5:55424964:::benchmark_data_smithi069_31227_object5341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7631965950000001, 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013003953, 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5342 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659277+0000", 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659408+0000", 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130579 2024-04-26T12:15:14.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659416+0000", 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659421+0000", 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5450000000000003e-06 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659713+0000", 2024-04-26T12:15:14.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029148299999999999 2024-04-26T12:15:14.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659919+0000", 2024-04-26T12:15:14.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020655700000000001 2024-04-26T12:15:14.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660098+0000", 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179039 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662447+0000", 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023482540000000001 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672214+0000", 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097676150000000003 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672248+0000", 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4103000000000002e-05 2024-04-26T12:15:14.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672282+0000", 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3584999999999998e-05 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5346 5.a 5:563f63a2:::benchmark_data_smithi069_31227_object5345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:14.476 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7627512630000002, 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012632412000000001, 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5346 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:14.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659722+0000", 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659782+0000", 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9444999999999998e-05 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659791+0000", 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659799+0000", 2024-04-26T12:15:14.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.515e-06 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660621+0000", 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082202999999999996 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660743+0000", 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122562 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660872+0000", 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012882 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663166+0000", 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022937859999999999 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672308+0000", 2024-04-26T12:15:14.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009142397 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672336+0000", 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7509e-05 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672356+0000", 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0114000000000001e-05 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5349 5.a 5:50d05031:::benchmark_data_smithi069_31227_object5348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7619513589999993, 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011904534, 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5349 2024-04-26T12:15:14.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660523+0000", 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660522+0000", 2024-04-26T12:15:14.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660647+0000", 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124566 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660657+0000", 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660672+0000", 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5221e-05 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661256+0000", 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058376299999999995 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661382+0000", 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012674799999999999 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.661496+0000", 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113675 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.668095+0000", 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065989789999999996 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672382+0000", 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004287005 2024-04-26T12:15:14.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672405+0000", 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2569e-05 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672428+0000", 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3169000000000001e-05 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34590 5.a 5:5deeaffe:::benchmark_data_smithi069_31227_object34589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.028930+0000", 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.3935441829999999, 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011478164000000001, 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34590 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.028930+0000", 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.028930+0000", 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.028930+0000", 2024-04-26T12:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.028972+0000", 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2645999999999998e-05 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.028980+0000", 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1579999999999999e-06 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.028985+0000", 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5620000000000003e-06 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.032841+0000", 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003855359 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.032982+0000", 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014098800000000001 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.033141+0000", 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159087 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.036123+0000", 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029822350000000002 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.040330+0000", 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042073919999999999 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.040375+0000", 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5116e-05 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.040409+0000", 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3179999999999997e-05 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34780 5.a 5:5fd46cae:::benchmark_data_smithi069_31227_object34779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.494 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.336829152, 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014439019000000001, 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34780 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:14.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085704+0000", 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9330000000000003e-05 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085712+0000", 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8509999999999999e-06 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085717+0000", 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.088826+0000", 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031083840000000001 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089117+0000", 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029134000000000001 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089234+0000", 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117131 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.095253+0000", 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060187369999999997 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100035+0000", 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047816810000000003 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100064+0000", 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9476e-05 2024-04-26T12:15:14.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100084+0000", 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0222999999999999e-05 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34792 5.a 5:55483def:::benchmark_data_smithi069_31227_object34791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.089231+0000", 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.33324321, 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012403907, 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34792 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089231+0000", 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089231+0000", 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089231+0000", 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089262+0000", 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0719000000000002e-05 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089269+0000", 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2989999999999999e-06 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089274+0000", 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8659999999999997e-06 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.094010+0000", 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047365769999999996 2024-04-26T12:15:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.094084+0000", 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3628999999999996e-05 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.094198+0000", 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114366 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.096130+0000", 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001931634 2024-04-26T12:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.101496+0000", 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053662479999999997 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.101569+0000", 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3082000000000003e-05 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.101635+0000", 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6026999999999997e-05 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34845 5.7 5:e06edba3:::benchmark_data_smithi069_31227_object34844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.108514+0000", 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.3139603609999999, 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011717589, 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34845 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108514+0000", 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108514+0000", 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108513+0000", 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108575+0000", 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1334999999999995e-05 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108584+0000", 2024-04-26T12:15:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4180000000000003e-06 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108590+0000", 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.823e-06 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.112710+0000", 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041202599999999997 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.112792+0000", 2024-04-26T12:15:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.120120+0000", 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073278170000000004 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.120162+0000", 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1637999999999997e-05 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.120232+0000", 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9944000000000007e-05 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34847 5.7 5:e6128b19:::benchmark_data_smithi069_31227_object34846:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.108913+0000", 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.3135613720000001, 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011441985999999999, 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34847 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108913+0000", 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108913+0000", 2024-04-26T12:15:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108913+0000", 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108953+0000", 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0043999999999998e-05 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108960+0000", 2024-04-26T12:15:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1749999999999999e-06 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.108965+0000", 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6219999999999997e-06 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.113658+0000", 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046924130000000003 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.113775+0000", 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117172 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.120240+0000", 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064651040000000002 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.120281+0000", 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1326999999999999e-05 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.120355+0000", 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3728999999999998e-05 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34856 5.7 5:ee5cce2a:::benchmark_data_smithi069_31227_object34855:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.111630+0000", 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.3108449170000001, 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011599384000000001, 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34856 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.111630+0000", 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.111630+0000", 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.111629+0000", 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.111692+0000", 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2965000000000004e-05 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.111700+0000", 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9740000000000002e-06 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.111706+0000", 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2149999999999998e-06 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.118577+0000", 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068712820000000003 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.118680+0000", 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010279 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.123129+0000", 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044482510000000003 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.123193+0000", 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4330000000000002e-05 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.123229+0000", 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6220999999999998e-05 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39217 5.a 5:5e92fef2:::benchmark_data_smithi069_31227_object39216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.060595714000000002, 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014277837999999999, 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39217 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361878+0000", 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361966+0000", 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7657000000000005e-05 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361975+0000", 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1730000000000001e-06 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361982+0000", 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4569999999999999e-06 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362014+0000", 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2051000000000002e-05 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362134+0000", 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927899999999999 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362252+0000", 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011875 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.364168+0000", 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019152699999999999 2024-04-26T12:15:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376076+0000", 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011908409 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376118+0000", 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2169999999999998e-05 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376157+0000", 2024-04-26T12:15:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8432000000000001e-05 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39226 5.a 5:5c62ab6f:::benchmark_data_smithi069_31227_object39225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.056340455999999997, 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014282428, 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39226 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366133+0000", 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366195+0000", 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1110000000000003e-05 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366203+0000", 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4069999999999993e-06 2024-04-26T12:15:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366208+0000", 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0159999999999999e-06 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366236+0000", 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8359000000000001e-05 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366310+0000", 2024-04-26T12:15:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3813999999999995e-05 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366390+0000", 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9457999999999997e-05 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.368587+0000", 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021969369999999999 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380339+0000", 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011752685000000001 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380385+0000", 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5705999999999999e-05 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380417+0000", 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1625999999999998e-05 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39228 5.a 5:5213e8ff:::benchmark_data_smithi069_31227_object39227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.056100932999999999, 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014169212, 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39228 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366373+0000", 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366442+0000", 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8733999999999996e-05 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366450+0000", 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366456+0000", 2024-04-26T12:15:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0900000000000001e-06 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367457+0000", 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001001479 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367537+0000", 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0018000000000005e-05 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367614+0000", 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.368716+0000", 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011021539999999999 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380472+0000", 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011755969 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380519+0000", 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999999e-05 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380543+0000", 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4068000000000001e-05 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:14.538 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:14.540 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:14.538+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:14.540 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:14.640 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:14.639+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:15:14.685 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40168 5.4 5:20260df2:::benchmark_data_smithi069_31227_object40167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.674549+0000", 2024-04-26T12:15:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0091237000000000002, 2024-04-26T12:15:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091488090000000008, 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40168 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.674549+0000", 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.674549+0000", 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.674548+0000", 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.674867+0000", 2024-04-26T12:15:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00031917700000000002 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.674877+0000", 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0083e-05 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.674883+0000", 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2380000000000002e-06 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.675293+0000", 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00040989999999999999 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.675420+0000", 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012710900000000001 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.675555+0000", 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013464 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.678107+0000", 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025519700000000002 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40184 5.b 5:d045a1d2:::benchmark_data_smithi069_31227_object40183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.680797+0000", 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028752249999999999, 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029832560000000001, 2024-04-26T12:15:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40184 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.680797+0000", 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.680797+0000", 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.680796+0000", 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.680826+0000", 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9119999999999999e-05 2024-04-26T12:15:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.680832+0000", 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8229999999999997e-06 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.680838+0000", 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0390000000000001e-06 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.680905+0000", 2024-04-26T12:15:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6932000000000002e-05 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681022+0000", 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116983 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681137+0000", 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011466799999999999 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40186 5.b 5:d90f36a8:::benchmark_data_smithi069_31227_object40185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.681017+0000", 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026556269999999998, 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002834025, 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40186 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681017+0000", 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681017+0000", 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681016+0000", 2024-04-26T12:15:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681133+0000", 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117472 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681142+0000", 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9039999999999998e-06 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681149+0000", 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4409999999999998e-06 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682454+0000", 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013056949999999999 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682574+0000", 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011971799999999999 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682697+0000", 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012275599999999999 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40189 5.f 5:f8bd3b4b:::benchmark_data_smithi069_31227_object40188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.681380+0000", 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022924429999999999, 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002538401, 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40189 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681380+0000", 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681380+0000", 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681379+0000", 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681452+0000", 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3314999999999999e-05 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681464+0000", 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1214e-05 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681470+0000", 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.037e-06 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681494+0000", 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4527000000000001e-05 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681589+0000", 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4881000000000002e-05 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40190 5.f 5:f161f274:::benchmark_data_smithi069_31227_object40189:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.681478+0000", 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002194082, 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025152389999999998, 2024-04-26T12:15:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40190 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681478+0000", 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681478+0000", 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681478+0000", 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681514+0000", 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6349e-05 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681523+0000", 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5299999999999996e-06 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681528+0000", 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0209999999999999e-06 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682842+0000", 2024-04-26T12:15:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013143339999999999 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682949+0000", 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107327 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40191 5.b 5:d05d33d2:::benchmark_data_smithi069_31227_object40190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.681990+0000", 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00168191, 2024-04-26T12:15:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002071565, 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40191 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681990+0000", 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681990+0000", 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.681990+0000", 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682064+0000", 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3924999999999994e-05 2024-04-26T12:15:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682072+0000", 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.524e-06 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682078+0000", 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.684012+0000", 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00193425 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40192 5.e 5:70f9fbc5:::benchmark_data_smithi069_31227_object40191:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.682344+0000", 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0013279120000000001, 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017799339999999999, 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40192 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682344+0000", 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682344+0000", 2024-04-26T12:15:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682343+0000", 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682391+0000", 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7110999999999997e-05 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682400+0000", 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4010000000000003e-06 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682407+0000", 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8129999999999998e-06 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682450+0000", 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3194e-05 2024-04-26T12:15:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682567+0000", 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117489 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.682692+0000", 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012413800000000001 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40194 5.8 5:1d72a58b:::benchmark_data_smithi069_31227_object40193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.683076+0000", 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00059608899999999995, 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001126068, 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40194 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683076+0000", 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683076+0000", 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683075+0000", 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683154+0000", 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9034000000000003e-05 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683167+0000", 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2162e-05 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683173+0000", 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1059999999999996e-06 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683217+0000", 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4125999999999997e-05 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683333+0000", 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011633099999999999 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683457+0000", 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012438799999999999 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:40193 5.a e23/16 5:518a0eef:::benchmark_data_smithi069_31227_object40192:head v 23'2463, mlcod=22'2459)", 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.683141+0000", 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00053077599999999995, 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001130523, 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683141+0000", 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683141+0000", 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683141+0000", 2024-04-26T12:15:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683647+0000", 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00050642199999999997 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683660+0000", 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2546e-05 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683666+0000", 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8030000000000002e-06 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683708+0000", 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2957000000000002e-05 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.683730+0000", 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1551000000000001e-05 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-26T12:15:14.724 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:14.725 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:14.742 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:14.740+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:14.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 10 16 40418 40402 252.494 203.75 0.00235122 0.00395759 2024-04-26T12:15:14.843 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:14.842+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:14.904 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:14.904 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:14.904 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:14.904 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:14.904 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:14.916 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:14.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-26T12:15:14.957 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:14.956+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:15.036 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:15.044 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:15.043+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:15.103 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39028 5.4 5:28ff5c50:::benchmark_data_smithi069_31227_object39027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.80315358199999998, 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018476389999999999, 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39028 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297529+0000", 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297560+0000", 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0514e-05 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297569+0000", 2024-04-26T12:15:15.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297575+0000", 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302181+0000", 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046059589999999997 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302282+0000", 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010151 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302358+0000", 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5735000000000006e-05 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.305000+0000", 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026415259999999999 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315922+0000", 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010921985 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315973+0000", 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1897999999999997e-05 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.316006+0000", 2024-04-26T12:15:15.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2715000000000001e-05 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39737 5.8 5:11fc7366:::benchmark_data_smithi069_31227_object39736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.522554+0000", 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.57812947100000001, 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015618866, 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39737 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522554+0000", 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522554+0000", 2024-04-26T12:15:15.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522553+0000", 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522591+0000", 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7888e-05 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522600+0000", 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2e-06 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522606+0000", 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.93e-06 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522703+0000", 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6900999999999999e-05 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522804+0000", 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100534 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522912+0000", 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108241 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529237+0000", 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063249780000000002 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.538095+0000", 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088583770000000006 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.538138+0000", 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2641000000000001e-05 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.538173+0000", 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4677e-05 2024-04-26T12:15:15.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39738 5.8 5:151d9cad:::benchmark_data_smithi069_31227_object39737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.522623+0000", 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.57806036900000002, 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015622864, 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.116 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39738 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522623+0000", 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522623+0000", 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522622+0000", 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522654+0000", 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1850000000000002e-05 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522663+0000", 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0799999999999995e-06 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.522669+0000", 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1309999999999997e-06 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.525780+0000", 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031117440000000001 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.525875+0000", 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4320000000000005e-05 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.525975+0000", 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100426 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529280+0000", 2024-04-26T12:15:15.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00330548 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.538184+0000", 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089031830000000003 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.538218+0000", 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4743000000000003e-05 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.538246+0000", 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7458999999999999e-05 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.57689828700000001, 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.122 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:15.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:15.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.57680944300000003, 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:15.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:15.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40092 5.8 5:142d160c:::benchmark_data_smithi069_31227_object40091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.639962+0000", 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.46072094899999999, 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015213274000000001, 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40092 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.639962+0000", 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.639962+0000", 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.639962+0000", 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.640060+0000", 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8511000000000006e-05 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.640068+0000", 2024-04-26T12:15:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.640073+0000", 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.640107+0000", 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4082000000000003e-05 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.640227+0000", 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120512 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.640356+0000", 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128443 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.643740+0000", 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033843789999999999 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655082+0000", 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011341534 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655117+0000", 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5655999999999999e-05 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655176+0000", 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8492000000000002e-05 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40098 5.0 5:02ecad7e:::benchmark_data_smithi069_31227_object40097:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.642554+0000", 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.45812980199999997, 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015608238, 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40098 2024-04-26T12:15:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642554+0000", 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642554+0000", 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642553+0000", 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642602+0000", 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9184000000000002e-05 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642611+0000", 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6340000000000007e-06 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642615+0000", 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2230000000000001e-06 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.643725+0000", 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011105329999999999 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.643846+0000", 2024-04-26T12:15:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012110800000000001 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.643986+0000", 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013995899999999999 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649312+0000", 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005325326 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658088+0000", 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087766200000000006 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658130+0000", 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1279000000000002e-05 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658162+0000", 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2242000000000001e-05 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40099 5.0 5:0b62973d:::benchmark_data_smithi069_31227_object40098:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.457792953, 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018142968999999998, 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40099 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642970+0000", 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0208000000000002e-05 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642979+0000", 2024-04-26T12:15:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6459999999999999e-06 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642982+0000", 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.501e-06 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646416+0000", 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034334499999999998 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646523+0000", 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107423 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646614+0000", 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0826000000000001e-05 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649441+0000", 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002827272 2024-04-26T12:15:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660958+0000", 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011516587999999999 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660999+0000", 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1501999999999997e-05 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661033+0000", 2024-04-26T12:15:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4026000000000003e-05 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40106 5.0 5:05c3a642:::benchmark_data_smithi069_31227_object40105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.645978+0000", 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.45470539700000001, 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015150105000000001, 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40106 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.645978+0000", 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.645978+0000", 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.645977+0000", 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646022+0000", 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4279000000000001e-05 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646031+0000", 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3279999999999995e-06 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646037+0000", 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649489+0000", 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034518299999999999 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649609+0000", 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120091 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649682+0000", 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3508000000000002e-05 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655075+0000", 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053921150000000003 2024-04-26T12:15:15.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661040+0000", 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059655760000000002 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661094+0000", 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4177e-05 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661128+0000", 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3738999999999997e-05 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40108 5.0 5:06ce292f:::benchmark_data_smithi069_31227_object40107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.45452379799999998, 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017776212999999999, 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.158 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40108 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646159+0000", 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646231+0000", 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1707999999999999e-05 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646238+0000", 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646248+0000", 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9510000000000001e-06 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652204+0000", 2024-04-26T12:15:15.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005956584 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652325+0000", 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120782 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652441+0000", 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011657799999999999 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655103+0000", 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026617530000000002 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663851+0000", 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087480049999999997 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663899+0000", 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7444999999999997e-05 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663936+0000", 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7092999999999999e-05 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40116 5.0 5:0a29f80b:::benchmark_data_smithi069_31227_object40115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.45162733100000002, 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017640323999999999, 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.164 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40116 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649115+0000", 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9722999999999997e-05 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649121+0000", 2024-04-26T12:15:15.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.553e-06 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649125+0000", 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2089999999999999e-06 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655141+0000", 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060157730000000003 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655260+0000", 2024-04-26T12:15:15.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011951999999999999 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655358+0000", 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7365e-05 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658199+0000", 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028416219999999998 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666616+0000", 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008416438 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666661+0000", 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.549e-05 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666696+0000", 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5054e-05 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.45121558299999998, 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:15.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:15.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.175 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.448769474, 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:15.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:15.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.448189436, 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:15.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:15.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:15.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40127 5.8 5:13ae5772:::benchmark_data_smithi069_31227_object40126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.44698834500000001, 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018042539, 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.187 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40127 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653694+0000", 2024-04-26T12:15:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653756+0000", 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2235000000000003e-05 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653768+0000", 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1838000000000001e-05 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653775+0000", 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.438e-06 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664004+0000", 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010229264 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664077+0000", 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2962999999999999e-05 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664146+0000", 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9523999999999994e-05 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666735+0000", 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025888489999999998 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671666+0000", 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049309250000000001 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671704+0000", 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7499000000000001e-05 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671738+0000", 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3849000000000001e-05 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40128 5.0 5:0cced25e:::benchmark_data_smithi069_31227_object40127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.654745+0000", 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.44593830600000001, 2024-04-26T12:15:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017163079000000001, 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40128 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654745+0000", 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654745+0000", 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654744+0000", 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654814+0000", 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9437000000000006e-05 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654822+0000", 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3180000000000007e-06 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654827+0000", 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.544e-06 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666801+0000", 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011974742999999999 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666916+0000", 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114786 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.667067+0000", 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015123099999999999 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671813+0000", 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047452179999999998 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671844+0000", 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1180000000000003e-05 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671880+0000", 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.625e-05 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671908+0000", 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8070999999999999e-05 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41043 5.4 5:2a464019:::benchmark_data_smithi069_31227_object41042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.15340717400000001, 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018032086999999999, 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41043 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947275+0000", 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947327+0000", 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1827999999999999e-05 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947339+0000", 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1891e-05 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947347+0000", 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:15:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951356+0000", 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040087179999999997 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951497+0000", 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014133900000000001 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951631+0000", 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013373700000000001 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.959577+0000", 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079464610000000001 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965250+0000", 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056726789999999999 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965285+0000", 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4768999999999999e-05 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965308+0000", 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3739000000000001e-05 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41048 5.4 5:23e09e07:::benchmark_data_smithi069_31227_object41047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.948894+0000", 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.151789653, 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016466464, 2024-04-26T12:15:15.203 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41048 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948894+0000", 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948894+0000", 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948893+0000", 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948944+0000", 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.113e-05 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948952+0000", 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7649999999999993e-06 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948958+0000", 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7729999999999996e-06 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.953838+0000", 2024-04-26T12:15:15.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048804620000000003 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.953929+0000", 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0297999999999995e-05 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.954011+0000", 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2099000000000001e-05 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.959712+0000", 2024-04-26T12:15:15.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057014489999999999 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965314+0000", 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056013809999999999 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965343+0000", 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9649999999999999e-05 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965360+0000", 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6979000000000001e-05 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41057 5.4 5:288dd866:::benchmark_data_smithi069_31227_object41056:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.14935505900000001, 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016670041999999999, 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41057 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:15.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951431+0000", 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010343700000000001 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951444+0000", 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2728000000000001e-05 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951449+0000", 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8420000000000004e-06 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.956690+0000", 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052409279999999997 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.956801+0000", 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111172 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.956896+0000", 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5224999999999997e-05 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.959758+0000", 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002861752 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.967910+0000", 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081517710000000004 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.967955+0000", 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5666e-05 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.967998+0000", 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3149999999999999e-05 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41374 5.0 5:05bb5c9e:::benchmark_data_smithi069_31227_object41373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:15.055145+0000", 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.045538846000000001, 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015272271, 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41374 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:15.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.055145+0000", 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.055145+0000", 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.055144+0000", 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:15.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.055281+0000", 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013698700000000001 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.055312+0000", 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0793000000000001e-05 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.055318+0000", 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.207e-06 2024-04-26T12:15:15.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.062786+0000", 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007468382 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.062897+0000", 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011095900000000001 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.063026+0000", 2024-04-26T12:15:15.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012895199999999999 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.067629+0000", 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046028559999999998 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.070337+0000", 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027082080000000001 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.070382+0000", 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5123000000000001e-05 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:15.070417+0000", 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4496999999999999e-05 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:15.220 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:15.222 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:15.222 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:15.220+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:15.222 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:15.223 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:15.223 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:15.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:15.224 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:15.224 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:15.225 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:15.323 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:15.322+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:15.385 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:15.386 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:15.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:15.424 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:15.422+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:15.524 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:15.523+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:15.526 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:15:15.526 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:15:15.526 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T12:15:15.526 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:15:15.526 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:15:15.526 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T12:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:15.552 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:15.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:15.625 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:15.624+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:15.667 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:15.668 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:15:15.668 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:15.726 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:15.725+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:15.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 11 16 43475 43459 246.908 191.062 0.00520689 0.00404731 2024-04-26T12:15:15.757 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:15.757 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:15.772 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:15.827 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:15.826+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:15.924 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:15.924 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:15.928 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:15.927+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:15.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:16.029 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:16.027+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:16.123 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:16.123 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:16.130 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:16.129+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:16.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:16.231 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:16.230+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:16.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:16.332 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:16.331+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:16.433 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:16.432+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:16.439 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:16.439 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:16.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:16.534 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:16.533+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:16.635 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:16.634+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:16.648 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:16.648 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:16.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:16.726 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:15:16.735 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:16.734+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:16.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 12 16 46525 46509 242.217 190.625 0.00772407 0.00412522 2024-04-26T12:15:16.810 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:16.810 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:16.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:16.866 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:16.865+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:16.937 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:16.935+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:16.964 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:16.964 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:16.980 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:17.064 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:17.063+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:17.139 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:17.137+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:17.162 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:17.162 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:17.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:17.225 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:17.240 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:17.238+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:17.341 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:17.339+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:17.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:17.352 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:17.352 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:17.358 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:17.358 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:17.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:17.371 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:17.371 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:17.373 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:17.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:17.442 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:17.441+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48796 5.5 5.4dbd4445 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.524922+0000", 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6342999999999996e-05, 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011655900000000001, 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48796 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524922+0000", 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524922+0000", 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524921+0000", 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524952+0000", 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0710000000000002e-05 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524963+0000", 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1114999999999999e-05 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524969+0000", 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4529999999999999e-06 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.525014+0000", 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4335999999999997e-05 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:48794 5.4 e23/16 5:2396fe02:::benchmark_data_smithi069_31227_object48793:head v 23'3052, mlcod=23'3049)", 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.524901+0000", 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00011736299999999999, 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020601800000000001, 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524901+0000", 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524901+0000", 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524890+0000", 2024-04-26T12:15:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999895 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524960+0000", 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9976999999999998e-05 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524971+0000", 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1381e-05 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524978+0000", 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.525023+0000", 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5605999999999997e-05 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.525045+0000", 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1183e-05 2024-04-26T12:15:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:48785 5.4 e23/16 5:204e4247:::benchmark_data_smithi069_31227_object48784:head v 23'3051, mlcod=23'3048)", 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.522518+0000", 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002499598, 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026474200000000002, 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522518+0000", 2024-04-26T12:15:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522518+0000", 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522518+0000", 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522570+0000", 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2465e-05 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522577+0000", 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6050000000000003e-06 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522581+0000", 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522623+0000", 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2178000000000002e-05 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522644+0000", 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1146999999999999e-05 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48786 5.7 5:e2e1074d:::benchmark_data_smithi069_31227_object48785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.522771+0000", 2024-04-26T12:15:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022474230000000001, 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024563039999999999, 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48786 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522771+0000", 2024-04-26T12:15:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522771+0000", 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522770+0000", 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522818+0000", 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000001e-05 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522829+0000", 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0791000000000001e-05 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522836+0000", 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:15:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522871+0000", 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5162e-05 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.522983+0000", 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112507 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48787 5.3 5:cc308a82:::benchmark_data_smithi069_31227_object48786:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.523047+0000", 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019706889999999999, 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022455359999999998, 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48787 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523047+0000", 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523047+0000", 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523047+0000", 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523104+0000", 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7392999999999998e-05 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523118+0000", 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3908e-05 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523125+0000", 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7320000000000001e-06 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523172+0000", 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7618999999999999e-05 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523311+0000", 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013879300000000001 2024-04-26T12:15:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48789 5.c 5:3f858f81:::benchmark_data_smithi069_31227_object48788:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.523367+0000", 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0016506089999999999, 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019882699999999999, 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48789 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523367+0000", 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523367+0000", 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523367+0000", 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523486+0000", 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119715 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523495+0000", 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6649999999999992e-06 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523504+0000", 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0119999999999994e-06 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523544+0000", 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9492000000000001e-05 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523685+0000", 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014154799999999999 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48790 5.1 5:8a534a55:::benchmark_data_smithi069_31227_object48789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.523832+0000", 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011861440000000001, 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015831860000000001, 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48790 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523832+0000", 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523832+0000", 2024-04-26T12:15:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523831+0000", 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523899+0000", 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8171999999999997e-05 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523910+0000", 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1107000000000001e-05 2024-04-26T12:15:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523916+0000", 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.523970+0000", 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3684000000000003e-05 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524094+0000", 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012395599999999999 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48791 5.6 5:6831711f:::benchmark_data_smithi069_31227_object48790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.524624+0000", 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00039416599999999999, 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000852069, 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48791 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524624+0000", 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524624+0000", 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524623+0000", 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524653+0000", 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0284e-05 2024-04-26T12:15:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524663+0000", 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.363e-06 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524669+0000", 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3879999999999997e-06 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524709+0000", 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9526000000000001e-05 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524833+0000", 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012453099999999999 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48792 5.a 5:5bf82e01:::benchmark_data_smithi069_31227_object48791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.524678+0000", 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000340198, 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085636600000000001, 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48792 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524678+0000", 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524678+0000", 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524677+0000", 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524704+0000", 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6797000000000001e-05 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524711+0000", 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6510000000000004e-06 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524717+0000", 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524808+0000", 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0962000000000001e-05 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524917+0000", 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109857 2024-04-26T12:15:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.525076+0000", 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015831299999999999 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48793 5.7 5:e452b7e4:::benchmark_data_smithi069_31227_object48792:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.524729+0000", 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000289015, 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000869084, 2024-04-26T12:15:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48793 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524729+0000", 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524729+0000", 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524728+0000", 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524754+0000", 2024-04-26T12:15:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6015000000000001e-05 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524762+0000", 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524768+0000", 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3550000000000001e-06 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524813+0000", 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5142000000000002e-05 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.524931+0000", 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117953 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 10 2024-04-26T12:15:17.568 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:17.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:17.571 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:17.568+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:17.670 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:17.669+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:17.682 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:15:17.725 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:17.725 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:17.726 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:17.726 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:17.726 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:17.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:17.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 13 16 49432 49416 237.56 181.688 0.00372207 0.00420655 2024-04-26T12:15:17.781 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:17.780+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:17.872 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:17.871+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:17.940 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:17.940 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.076194438999998, 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012842965, 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860606+0000", 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860604+0000", 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860616+0000", 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-05 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860628+0000", 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860640+0000", 2024-04-26T12:15:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1948e-05 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861144+0000", 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050421799999999996 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861294+0000", 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149741 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:17.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861573+0000", 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027888300000000001 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865700+0000", 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041267869999999998 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873353+0000", 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076533549999999997 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873408+0000", 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4724e-05 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873449+0000", 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1130000000000001e-05 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.076055846000003, 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012872916, 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860744+0000", 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860751+0000", 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4989999999999997e-06 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860766+0000", 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5277999999999998e-05 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860777+0000", 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862196+0000", 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014194749999999999 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862357+0000", 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016099300000000001 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.862626+0000", 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026869399999999999 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865793+0000", 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003167076 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873525+0000", 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077318420000000001 2024-04-26T12:15:17.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873574+0000", 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9444999999999998e-05 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873617+0000", 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3034000000000002e-05 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.075806032000003, 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012981602, 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860994+0000", 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.860998+0000", 2024-04-26T12:15:17.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1760000000000003e-06 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861005+0000", 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861013+0000", 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-06 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864442+0000", 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034288909999999999 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864579+0000", 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013655000000000001 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.864726+0000", 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146821 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.867844+0000", 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031183880000000001 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873900+0000", 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060559790000000004 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873940+0000", 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9626999999999999e-05 2024-04-26T12:15:17.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.873976+0000", 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6327e-05 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.075314417999998, 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012630707999999999, 2024-04-26T12:15:17.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861486+0000", 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861485+0000", 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861488+0000", 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861495+0000", 2024-04-26T12:15:17.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.861501+0000", 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865278+0000", 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037777829999999998 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.865405+0000", 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012616999999999999 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:14:42.874117+0000", 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087119399999999996 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5342 5.a 5:55424964:::benchmark_data_smithi069_31227_object5341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:17.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.277522282, 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013003953, 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5342 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:17.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659278+0000", 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659277+0000", 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659408+0000", 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130579 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659416+0000", 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659421+0000", 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5450000000000003e-06 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659713+0000", 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029148299999999999 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659919+0000", 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020655700000000001 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660098+0000", 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179039 2024-04-26T12:15:17.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.662447+0000", 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023482540000000001 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672214+0000", 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097676150000000003 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672248+0000", 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4103000000000002e-05 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672282+0000", 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3584999999999998e-05 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:5346 5.a 5:563f63a2:::benchmark_data_smithi069_31227_object5345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:17.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.27707695, 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012632412000000001, 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5346 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:17.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659723+0000", 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659722+0000", 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659782+0000", 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9444999999999998e-05 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659791+0000", 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.659799+0000", 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.515e-06 2024-04-26T12:15:17.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660621+0000", 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082202999999999996 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660743+0000", 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122562 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:17.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.660872+0000", 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012882 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.663166+0000", 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022937859999999999 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672308+0000", 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009142397 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672336+0000", 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7509e-05 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:05.672356+0000", 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0114000000000001e-05 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34780 5.a 5:5fd46cae:::benchmark_data_smithi069_31227_object34779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8511548390000003, 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014439019000000001, 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34780 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:17.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085704+0000", 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9330000000000003e-05 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085712+0000", 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8509999999999999e-06 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085717+0000", 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.088826+0000", 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031083840000000001 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089117+0000", 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029134000000000001 2024-04-26T12:15:17.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089234+0000", 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117131 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.095253+0000", 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060187369999999997 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100035+0000", 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047816810000000003 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100064+0000", 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9476e-05 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100084+0000", 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0222999999999999e-05 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.981 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39217 5.a 5:5e92fef2:::benchmark_data_smithi069_31227_object39216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5749214010000001, 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014277837999999999, 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39217 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361878+0000", 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361966+0000", 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7657000000000005e-05 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361975+0000", 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1730000000000001e-06 2024-04-26T12:15:17.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361982+0000", 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4569999999999999e-06 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362014+0000", 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2051000000000002e-05 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362134+0000", 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927899999999999 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362252+0000", 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011875 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.364168+0000", 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019152699999999999 2024-04-26T12:15:17.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376076+0000", 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011908409 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376118+0000", 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2169999999999998e-05 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376157+0000", 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8432000000000001e-05 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39226 5.a 5:5c62ab6f:::benchmark_data_smithi069_31227_object39225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.570666143, 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014282428, 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39226 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:17.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366133+0000", 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366195+0000", 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1110000000000003e-05 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366203+0000", 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4069999999999993e-06 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366208+0000", 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0159999999999999e-06 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366236+0000", 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8359000000000001e-05 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366310+0000", 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3813999999999995e-05 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366390+0000", 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9457999999999997e-05 2024-04-26T12:15:17.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.368587+0000", 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021969369999999999 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380339+0000", 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011752685000000001 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:17.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380385+0000", 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5705999999999999e-05 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380417+0000", 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1625999999999998e-05 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39228 5.a 5:5213e8ff:::benchmark_data_smithi069_31227_object39227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:17.994 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5704266200000001, 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014169212, 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39228 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:17.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366373+0000", 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366442+0000", 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8733999999999996e-05 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366450+0000", 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366456+0000", 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0900000000000001e-06 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367457+0000", 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001001479 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367537+0000", 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0018000000000005e-05 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:17.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367614+0000", 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.368716+0000", 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011021539999999999 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380472+0000", 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011755969 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:17.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380519+0000", 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999999e-05 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380543+0000", 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4068000000000001e-05 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:41062 5.a 5:5eab269f:::benchmark_data_smithi069_31227_object41061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.955094+0000", 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.981705963, 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012835889, 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 41062 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.001 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955094+0000", 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955094+0000", 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955094+0000", 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955196+0000", 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010244800000000001 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955206+0000", 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9539999999999999e-06 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955215+0000", 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8100000000000004e-06 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955605+0000", 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039056699999999998 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955692+0000", 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6575000000000004e-05 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.955790+0000", 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.956847+0000", 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010572979999999999 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.967879+0000", 2024-04-26T12:15:18.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011032269000000001 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.967911+0000", 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1389000000000001e-05 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.967930+0000", 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9530000000000001e-05 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.006 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:41656 5.a 5:5b21bf54:::benchmark_data_smithi069_31227_object41655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.7956255429999999, 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015471509, 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 41656 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141174+0000", 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141228+0000", 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4228000000000003e-05 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141237+0000", 2024-04-26T12:15:18.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141243+0000", 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1330000000000004e-06 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142532+0000", 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001288871 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142672+0000", 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014038899999999999 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142828+0000", 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155673 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.145023+0000", 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021952600000000001 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156596+0000", 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011573162999999999 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156625+0000", 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8408999999999999e-05 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156646+0000", 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1421999999999999e-05 2024-04-26T12:15:18.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:41658 5.a 5:5c63d080:::benchmark_data_smithi069_31227_object41657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:15.142784+0000", 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.794016659, 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013966386000000001, 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 41658 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142784+0000", 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142784+0000", 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142783+0000", 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142841+0000", 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142851+0000", 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8679999999999994e-06 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142858+0000", 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.754e-06 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.143977+0000", 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011193430000000001 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.144113+0000", 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135134 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.144243+0000", 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013065599999999999 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.145295+0000", 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010518680000000001 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156679+0000", 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011384049 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156720+0000", 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0722000000000001e-05 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156750+0000", 2024-04-26T12:15:18.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0116000000000001e-05 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48435 5.a 5:504e4eab:::benchmark_data_smithi069_31227_object48434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.397468+0000", 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53933188600000004, 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012702508, 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48435 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397468+0000", 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397468+0000", 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397468+0000", 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397511+0000", 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3275000000000002e-05 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397518+0000", 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9110000000000004e-06 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397524+0000", 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.400634+0000", 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031107729999999998 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.400744+0000", 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109474 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.400867+0000", 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012361800000000001 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.404392+0000", 2024-04-26T12:15:18.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035248089999999998 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410058+0000", 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056659620000000001 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410118+0000", 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9982999999999998e-05 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410171+0000", 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2759000000000001e-05 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48437 5.a 5:5484a053:::benchmark_data_smithi069_31227_object48436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.397730+0000", 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53907033100000001, 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012563803, 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48437 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397730+0000", 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397730+0000", 2024-04-26T12:15:18.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397729+0000", 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397826+0000", 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6908000000000001e-05 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397836+0000", 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8530000000000004e-06 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.397842+0000", 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2049999999999999e-06 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.402850+0000", 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050078179999999998 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.402979+0000", 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012851799999999999 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.403057+0000", 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8678999999999997e-05 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.409974+0000", 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069169549999999998 2024-04-26T12:15:18.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410222+0000", 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024775300000000002 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410259+0000", 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7079000000000002e-05 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410294+0000", 2024-04-26T12:15:18.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4777999999999998e-05 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48468 5.a 5:51b14a88:::benchmark_data_smithi069_31227_object48467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.410371+0000", 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52642920299999996, 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012602957, 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48468 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410371+0000", 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410371+0000", 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410370+0000", 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410399+0000", 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8756e-05 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410407+0000", 2024-04-26T12:15:18.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9559999999999997e-06 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.410414+0000", 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0249999999999997e-06 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.415274+0000", 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048594930000000003 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.415394+0000", 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120878 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.415611+0000", 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021681099999999999 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.421162+0000", 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055502470000000003 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.422892+0000", 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001730746 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.422935+0000", 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2920000000000002e-05 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.422974+0000", 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8862999999999997e-05 2024-04-26T12:15:18.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48491 5.a 5:5429b147:::benchmark_data_smithi069_31227_object48490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.51817979700000005, 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01423643, 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48491 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418663+0000", 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3235999999999997e-05 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418676+0000", 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2773e-05 2024-04-26T12:15:18.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418683+0000", 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.423197+0000", 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045135150000000001 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.423324+0000", 2024-04-26T12:15:18.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012728699999999999 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.423451+0000", 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012666199999999999 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.427627+0000", 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041761519999999998 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.432807+0000", 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051797470000000002 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.432835+0000", 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8028999999999999e-05 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.432857+0000", 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079e-05 2024-04-26T12:15:18.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48616 5.a 5:5350087b:::benchmark_data_smithi069_31227_object48615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.463210+0000", 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.47359056599999999, 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012581995, 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48616 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.463210+0000", 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.463210+0000", 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.463209+0000", 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.463256+0000", 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7064000000000002e-05 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.463264+0000", 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6809999999999998e-06 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.463269+0000", 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7350000000000004e-06 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.466736+0000", 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003467777 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.466857+0000", 2024-04-26T12:15:18.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120856 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.467003+0000", 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014607800000000001 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.472639+0000", 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056354480000000004 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.475649+0000", 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003009664 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.475732+0000", 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3036999999999998e-05 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.475792+0000", 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0134999999999999e-05 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.048 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:49622 5.c 5:31a953d8:::benchmark_data_smithi069_31227_object49621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.814354+0000", 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.122446631, 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013861336, 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 49622 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814354+0000", 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814354+0000", 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814353+0000", 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814454+0000", 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100673 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814463+0000", 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0280000000000006e-06 2024-04-26T12:15:18.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814469+0000", 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1199999999999999e-06 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.817597+0000", 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031284339999999998 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.817722+0000", 2024-04-26T12:15:18.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000125084 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828099+0000", 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010377213 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828148+0000", 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8161000000000002e-05 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828215+0000", 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7327000000000001e-05 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:49624 5.c 5:37d9a220:::benchmark_data_smithi069_31227_object49623:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.815039+0000", 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.121761704, 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013288865, 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 49624 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.815039+0000", 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.815039+0000", 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.815038+0000", 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.815093+0000", 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5584999999999997e-05 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.815102+0000", 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1140000000000006e-06 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.815107+0000", 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6899999999999997e-06 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.819549+0000", 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044413179999999997 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.819665+0000", 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011684900000000001 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828225+0000", 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008559522 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828266+0000", 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0596000000000002e-05 2024-04-26T12:15:18.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828327+0000", 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1886999999999999e-05 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.059 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:18.061 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:18.061 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:18.059+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:18.161 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:18.160+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:18.204 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:18.204 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:18.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.204 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50735 5.4 5:224c86e5:::benchmark_data_smithi069_31227_object50734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.194411+0000", 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0076456780000000004, 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007671359, 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50735 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194411+0000", 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194411+0000", 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194411+0000", 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194473+0000", 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2427000000000004e-05 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194481+0000", 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194488+0000", 2024-04-26T12:15:18.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1750000000000002e-06 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.196403+0000", 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001915473 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.196532+0000", 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012889499999999999 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.196668+0000", 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013624399999999999 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201328+0000", 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046603690000000001 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50736 5.4 5:2ea737bf:::benchmark_data_smithi069_31227_object50735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.209 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.194495+0000", 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.007561847, 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076846859999999996, 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50736 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194495+0000", 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194495+0000", 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194495+0000", 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194522+0000", 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7807999999999999e-05 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194529+0000", 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8700000000000003e-06 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.194535+0000", 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3299999999999998e-06 2024-04-26T12:15:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199660+0000", 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005125508 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199760+0000", 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9518000000000005e-05 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199883+0000", 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000122836 2024-04-26T12:15:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202198+0000", 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023159919999999998 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50739 5.e 5:75818bad:::benchmark_data_smithi069_31227_object50738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.195539+0000", 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0065182340000000004, 2024-04-26T12:15:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0068027690000000002, 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50739 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195539+0000", 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195539+0000", 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195538+0000", 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195593+0000", 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4882000000000001e-05 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195604+0000", 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1404e-05 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195612+0000", 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1999999999999994e-06 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195660+0000", 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195784+0000", 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000123886 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195911+0000", 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127312 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201346+0000", 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054350370000000002 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50740 5.f 5:f4b9e031:::benchmark_data_smithi069_31227_object50739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.195633+0000", 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0064239020000000004, 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067848279999999997, 2024-04-26T12:15:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50740 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195633+0000", 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195633+0000", 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195632+0000", 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195712+0000", 2024-04-26T12:15:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9080999999999997e-05 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195722+0000", 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9469999999999998e-06 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195729+0000", 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.841e-06 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195781+0000", 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1338000000000002e-05 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.195894+0000", 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011348700000000001 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50742 5.9 5:951c9bc4:::benchmark_data_smithi069_31227_object50741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.223 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.197432+0000", 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046249500000000001, 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050489510000000003, 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50742 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197432+0000", 2024-04-26T12:15:18.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197432+0000", 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197431+0000", 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197492+0000", 2024-04-26T12:15:18.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0964000000000001e-05 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197502+0000", 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0234000000000001e-05 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197508+0000", 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1009999999999997e-06 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197564+0000", 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5497000000000001e-05 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197713+0000", 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000149025 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50743 5.b 5:dfb6726e:::benchmark_data_smithi069_31227_object50742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.197519+0000", 2024-04-26T12:15:18.227 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045377339999999999, 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050259149999999997, 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50743 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197519+0000", 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197519+0000", 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197519+0000", 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197555+0000", 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6599e-05 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197563+0000", 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6909999999999997e-06 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197568+0000", 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197602+0000", 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4269e-05 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197709+0000", 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106735 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197783+0000", 2024-04-26T12:15:18.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4208999999999994e-05 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.200041+0000", 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022574689999999998 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50744 5.e 5:7fdfe7cb:::benchmark_data_smithi069_31227_object50743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.197603+0000", 2024-04-26T12:15:18.232 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0044535909999999998, 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050165210000000003, 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50744 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197603+0000", 2024-04-26T12:15:18.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197603+0000", 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197603+0000", 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197673+0000", 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9840999999999998e-05 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197680+0000", 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4549999999999998e-06 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.197686+0000", 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199446+0000", 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017608879999999999 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199540+0000", 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3973000000000003e-05 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199684+0000", 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014343099999999999 2024-04-26T12:15:18.236 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50746 5.e 5:7e05feb0:::benchmark_data_smithi069_31227_object50745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.199034+0000", 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0030229319999999999, 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036531599999999999, 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50746 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199034+0000", 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199034+0000", 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199033+0000", 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199097+0000", 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3445e-05 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199106+0000", 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3889999999999994e-06 2024-04-26T12:15:18.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199111+0000", 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0470000000000001e-06 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201461+0000", 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023499770000000001 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201591+0000", 2024-04-26T12:15:18.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130273 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201723+0000", 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013150600000000001 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50747 5.9 5:94d29da1:::benchmark_data_smithi069_31227_object50746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.199653+0000", 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024040860000000002, 2024-04-26T12:15:18.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031046139999999999, 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50747 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199653+0000", 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199653+0000", 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199652+0000", 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199708+0000", 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5651e-05 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199718+0000", 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0627e-05 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199724+0000", 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7729999999999996e-06 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199759+0000", 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4999999999999997e-05 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199878+0000", 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119203 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.245 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50748 5.f 5:fa41cb6e:::benchmark_data_smithi069_31227_object50747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.199734+0000", 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0023230249999999998, 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030908480000000002, 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50748 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199734+0000", 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199734+0000", 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199733+0000", 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199777+0000", 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3080000000000001e-05 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199786+0000", 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1500000000000005e-06 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199792+0000", 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.93e-06 2024-04-26T12:15:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199865+0000", 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3553000000000005e-05 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199987+0000", 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121908 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50750 5.f 5:f45776f1:::benchmark_data_smithi069_31227_object50749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.199827+0000", 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022302149999999998, 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030700079999999999, 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50750 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.250 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199827+0000", 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199827+0000", 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199826+0000", 2024-04-26T12:15:18.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199943+0000", 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116715 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199953+0000", 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0182e-05 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.199960+0000", 2024-04-26T12:15:18.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5010000000000001e-06 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201742+0000", 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017823509999999999 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201879+0000", 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013730700000000001 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.253 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50752 5.f 5.81cacb7f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.201299+0000", 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00075784599999999995, 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016602629999999999, 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50752 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.254 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201299+0000", 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201299+0000", 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201298+0000", 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201367+0000", 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8322000000000001e-05 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201378+0000", 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1041e-05 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201386+0000", 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7810000000000005e-06 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50753 5.e 5.22b46a4e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.201398+0000", 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00065868700000000003, 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001617215, 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.257 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50753 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201398+0000", 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201398+0000", 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201398+0000", 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201468+0000", 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0110999999999993e-05 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201474+0000", 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2859999999999996e-06 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201478+0000", 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:50744 5.e e24/16)", 2024-04-26T12:15:18.260 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.201586+0000", 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00047098600000000001, 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001482962, 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201586+0000", 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201586+0000", 2024-04-26T12:15:18.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201585+0000", 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201590+0000", 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4259999999999996e-06 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201599+0000", 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2350000000000005e-06 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201606+0000", 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6640000000000001e-06 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.263 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:50754 5.a e24/16 5:5d4eda88:::benchmark_data_smithi069_31227_object50753:head v 24'3155, mlcod=24'3153)", 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.201948+0000", 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000108553, 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011710379999999999, 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201948+0000", 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201948+0000", 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.201948+0000", 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202015+0000", 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6812999999999999e-05 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202024+0000", 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8740000000000001e-06 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202028+0000", 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7570000000000004e-06 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202070+0000", 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1709999999999999e-05 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202090+0000", 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0302999999999999e-05 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50755 5.d 5:b6fe877c:::benchmark_data_smithi069_31227_object50754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.202180+0000", 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.999877, 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010021330000000001, 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:18.267 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50755 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202180+0000", 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202180+0000", 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202180+0000", 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202262+0000", 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2751999999999996e-05 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202271+0000", 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0669999999999998e-06 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202276+0000", 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0300000000000001e-06 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202323+0000", 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6190000000000003e-05 2024-04-26T12:15:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.202415+0000", 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2603999999999996e-05 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 16 2024-04-26T12:15:18.271 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:18.273 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:18.273 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:18.271+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:18.373 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:18.372+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:18.421 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:18.421 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:18.421 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:18.421 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:18.421 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:18.433 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:18.475 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:18.473+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:18.575 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:18.574+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:18.622 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39028 5.4 5:28ff5c50:::benchmark_data_smithi069_31227_object39027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.321510451, 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018476389999999999, 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39028 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297529+0000", 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297560+0000", 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0514e-05 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297569+0000", 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297575+0000", 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302181+0000", 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046059589999999997 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302282+0000", 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010151 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302358+0000", 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5735000000000006e-05 2024-04-26T12:15:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.305000+0000", 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026415259999999999 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315922+0000", 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010921985 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315973+0000", 2024-04-26T12:15:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1897999999999997e-05 2024-04-26T12:15:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.316006+0000", 2024-04-26T12:15:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2715000000000001e-05 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.0952551560000003, 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.0951663119999999, 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:18.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40099 5.0 5:0b62973d:::benchmark_data_smithi069_31227_object40098:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.976149822, 2024-04-26T12:15:18.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018142968999999998, 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40099 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642970+0000", 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0208000000000002e-05 2024-04-26T12:15:18.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642979+0000", 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6459999999999999e-06 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642982+0000", 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.501e-06 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646416+0000", 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034334499999999998 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646523+0000", 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107423 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646614+0000", 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0826000000000001e-05 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649441+0000", 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002827272 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660958+0000", 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011516587999999999 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660999+0000", 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1501999999999997e-05 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661033+0000", 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4026000000000003e-05 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40108 5.0 5:06ce292f:::benchmark_data_smithi069_31227_object40107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9728806670000001, 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017776212999999999, 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40108 2024-04-26T12:15:18.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646159+0000", 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646231+0000", 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1707999999999999e-05 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646238+0000", 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646248+0000", 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9510000000000001e-06 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652204+0000", 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005956584 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652325+0000", 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120782 2024-04-26T12:15:18.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652441+0000", 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011657799999999999 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655103+0000", 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026617530000000002 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663851+0000", 2024-04-26T12:15:18.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087480049999999997 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663899+0000", 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7444999999999997e-05 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663936+0000", 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7092999999999999e-05 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.654 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40116 5.0 5:0a29f80b:::benchmark_data_smithi069_31227_object40115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9699841999999999, 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017640323999999999, 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.655 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40116 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649115+0000", 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9722999999999997e-05 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649121+0000", 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.553e-06 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649125+0000", 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2089999999999999e-06 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655141+0000", 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060157730000000003 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655260+0000", 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011951999999999999 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655358+0000", 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7365e-05 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658199+0000", 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028416219999999998 2024-04-26T12:15:18.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666616+0000", 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008416438 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666661+0000", 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.549e-05 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666696+0000", 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5054e-05 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.969572452, 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.661 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:18.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:18.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:18.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9671263429999999, 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.668 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:18.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9665463050000001, 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.674 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:18.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:18.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:18.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40127 5.8 5:13ae5772:::benchmark_data_smithi069_31227_object40126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:18.680 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9653452140000001, 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018042539, 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40127 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653694+0000", 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653756+0000", 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2235000000000003e-05 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653768+0000", 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1838000000000001e-05 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653775+0000", 2024-04-26T12:15:18.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.438e-06 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664004+0000", 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010229264 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664077+0000", 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2962999999999999e-05 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664146+0000", 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9523999999999994e-05 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666735+0000", 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025888489999999998 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671666+0000", 2024-04-26T12:15:18.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049309250000000001 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671704+0000", 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7499000000000001e-05 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671738+0000", 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3849000000000001e-05 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.686 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40128 5.0 5:0cced25e:::benchmark_data_smithi069_31227_object40127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.654745+0000", 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9642951750000002, 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017163079000000001, 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.687 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40128 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654745+0000", 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654745+0000", 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654744+0000", 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654814+0000", 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9437000000000006e-05 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654822+0000", 2024-04-26T12:15:18.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3180000000000007e-06 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.654827+0000", 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.544e-06 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666801+0000", 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011974742999999999 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666916+0000", 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114786 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.667067+0000", 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015123099999999999 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671813+0000", 2024-04-26T12:15:18.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047452179999999998 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671844+0000", 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1180000000000003e-05 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671880+0000", 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.625e-05 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671908+0000", 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8070999999999999e-05 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41043 5.4 5:2a464019:::benchmark_data_smithi069_31227_object41042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.671764043, 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018032086999999999, 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41043 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947275+0000", 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947327+0000", 2024-04-26T12:15:18.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1827999999999999e-05 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947339+0000", 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1891e-05 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947347+0000", 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951356+0000", 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040087179999999997 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951497+0000", 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014133900000000001 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951631+0000", 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013373700000000001 2024-04-26T12:15:18.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.959577+0000", 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079464610000000001 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965250+0000", 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056726789999999999 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965285+0000", 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4768999999999999e-05 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965308+0000", 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3739000000000001e-05 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41048 5.4 5:23e09e07:::benchmark_data_smithi069_31227_object41047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.948894+0000", 2024-04-26T12:15:18.699 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.670146522, 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016466464, 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41048 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948894+0000", 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948894+0000", 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948893+0000", 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948944+0000", 2024-04-26T12:15:18.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.113e-05 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948952+0000", 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7649999999999993e-06 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.948958+0000", 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7729999999999996e-06 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.953838+0000", 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048804620000000003 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.953929+0000", 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0297999999999995e-05 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.954011+0000", 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2099000000000001e-05 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.959712+0000", 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057014489999999999 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965314+0000", 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056013809999999999 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965343+0000", 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9649999999999999e-05 2024-04-26T12:15:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965360+0000", 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6979000000000001e-05 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41057 5.4 5:288dd866:::benchmark_data_smithi069_31227_object41056:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6677119280000001, 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016670041999999999, 2024-04-26T12:15:18.705 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41057 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951328+0000", 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951431+0000", 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010343700000000001 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951444+0000", 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2728000000000001e-05 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951449+0000", 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8420000000000004e-06 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.956690+0000", 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052409279999999997 2024-04-26T12:15:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.956801+0000", 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111172 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.956896+0000", 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5224999999999997e-05 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.959758+0000", 2024-04-26T12:15:18.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002861752 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.967910+0000", 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081517710000000004 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.967955+0000", 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5666e-05 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.967998+0000", 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3149999999999999e-05 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50476 5.4 5:2c6eadac:::benchmark_data_smithi069_31227_object50475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.51885964900000003, 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018700795999999999, 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.711 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50476 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100180+0000", 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100214+0000", 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3896000000000002e-05 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100221+0000", 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100227+0000", 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6459999999999998e-06 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106611+0000", 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063837039999999996 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106726+0000", 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115661 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106855+0000", 2024-04-26T12:15:18.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128186 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.109133+0000", 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022781670000000002 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118804+0000", 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096710839999999999 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118844+0000", 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0405999999999999e-05 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118881+0000", 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7150999999999997e-05 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50633 5.8 5:18dd6172:::benchmark_data_smithi069_31227_object50632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.717 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.153134+0000", 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.46590601999999998, 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.016256581999999999, 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50633 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.153134+0000", 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.153134+0000", 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.153134+0000", 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.153264+0000", 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130467 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.153272+0000", 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.153277+0000", 2024-04-26T12:15:18.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6420000000000004e-06 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157270+0000", 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039923049999999998 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157391+0000", 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012108300000000001 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157477+0000", 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6155000000000004e-05 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.162798+0000", 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053207009999999997 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.169294+0000", 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006496333 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.169329+0000", 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5014000000000001e-05 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.169391+0000", 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1940000000000007e-05 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50646 5.8 5:16236705:::benchmark_data_smithi069_31227_object50645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.157176+0000", 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.461864361, 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017911354000000001, 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50646 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157176+0000", 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157176+0000", 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157175+0000", 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157233+0000", 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157244+0000", 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0652999999999999e-05 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157250+0000", 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5100000000000004e-06 2024-04-26T12:15:18.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.162867+0000", 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056170040000000001 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.162961+0000", 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4036000000000006e-05 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.163060+0000", 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8454000000000003e-05 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.166425+0000", 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033650490000000002 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.175026+0000", 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086011869999999997 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.175057+0000", 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0540999999999998e-05 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.175087+0000", 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0722000000000002e-05 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.729 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51736 5.8 5:17ffc05c:::benchmark_data_smithi069_31227_object51735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.085888361999999996, 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019106003, 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51736 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533151+0000", 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533182+0000", 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0991999999999997e-05 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533191+0000", 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533197+0000", 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4479999999999999e-06 2024-04-26T12:15:18.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534047+0000", 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085020199999999999 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534122+0000", 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4904e-05 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534247+0000", 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125241 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537303+0000", 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030558360000000001 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552160+0000", 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014856362999999999 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552217+0000", 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7754000000000003e-05 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552258+0000", 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0614000000000001e-05 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51738 5.8 5:10901916:::benchmark_data_smithi069_31227_object51737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.735 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.085656073999999999, 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019114662000000001, 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51738 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533505+0000", 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012143500000000001 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533516+0000", 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1031e-05 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533523+0000", 2024-04-26T12:15:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537326+0000", 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038034509999999998 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537402+0000", 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5873999999999999e-05 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5947999999999999e-05 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540283+0000", 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028045320000000002 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552413+0000", 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012130395 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552464+0000", 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0574000000000001e-05 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552499+0000", 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5264e-05 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51740 5.0 5:03a2d37d:::benchmark_data_smithi069_31227_object51739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.084780320000000006, 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018101987, 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51740 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:18.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534259+0000", 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534321+0000", 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2378000000000005e-05 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534341+0000", 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534350+0000", 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537321+0000", 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029708909999999998 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537401+0000", 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0768999999999999e-05 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6599000000000003e-05 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540265+0000", 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027868049999999998 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552278+0000", 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012013239 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552327+0000", 2024-04-26T12:15:18.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9438999999999999e-05 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552362+0000", 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4544e-05 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:18.747 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:18.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:18.749 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:18.747+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:18.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 14 16 52360 52344 233.661 183 0.00870179 0.0042774 2024-04-26T12:15:18.849 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:18.848+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:18.899 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:18.899 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:18.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52736 5.c 5:334c7961:::benchmark_data_smithi069_31227_object52735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.897288+0000", 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001332324, 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013593349999999999, 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52736 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897288+0000", 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897288+0000", 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897287+0000", 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897353+0000", 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5388999999999993e-05 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897367+0000", 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4752999999999999e-05 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897374+0000", 2024-04-26T12:15:18.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897441+0000", 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6946000000000006e-05 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897564+0000", 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012347200000000001 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52737 5.1 5:8a66f65e:::benchmark_data_smithi069_31227_object52736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.897390+0000", 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012298459999999999, 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001334074, 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52737 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897390+0000", 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897390+0000", 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897390+0000", 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897417+0000", 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7353999999999999e-05 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897425+0000", 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2309999999999996e-06 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897431+0000", 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8139999999999997e-06 2024-04-26T12:15:18.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897516+0000", 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4660999999999995e-05 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897637+0000", 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012125699999999999 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.907 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:52731 5.8 e24/16 5:1b6c0866:::benchmark_data_smithi069_31227_object52730:head v 24'3299, mlcod=24'3295)", 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.897406+0000", 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001214073, 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013851499999999999, 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897406+0000", 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897406+0000", 2024-04-26T12:15:18.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897405+0000", 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897508+0000", 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010249199999999999 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897518+0000", 2024-04-26T12:15:18.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7860000000000008e-06 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897524+0000", 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3049999999999998e-06 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897846+0000", 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032225599999999999 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897862+0000", 2024-04-26T12:15:18.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5794000000000002e-05 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52738 5.6 5.71fa58c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.897441+0000", 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001179123, 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00138349, 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52738 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897441+0000", 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897441+0000", 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897441+0000", 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897811+0000", 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037042599999999998 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897821+0000", 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0210000000000001e-05 2024-04-26T12:15:18.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897829+0000", 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1920000000000005e-06 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52728 5.7 5:e7ad3487:::benchmark_data_smithi069_31227_object52727:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.894211+0000", 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0044094750000000004, 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046483610000000002, 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52728 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.894211+0000", 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.894211+0000", 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.894210+0000", 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.894253+0000", 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2629000000000001e-05 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.894262+0000", 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.894267+0000", 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2780000000000001e-06 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.896363+0000", 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020961030000000002 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.896443+0000", 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9590000000000002e-05 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52732 5.2 5:460c4c32:::benchmark_data_smithi069_31227_object52731:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.897002+0000", 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001618595, 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018920160000000001, 2024-04-26T12:15:18.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52732 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897002+0000", 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897002+0000", 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897000+0000", 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897101+0000", 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100723 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897113+0000", 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2095e-05 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897124+0000", 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0560999999999999e-05 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897176+0000", 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1931999999999997e-05 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897309+0000", 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013312600000000001 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52735 5.6 5:666e3694:::benchmark_data_smithi069_31227_object52734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.897141+0000", 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001479504, 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001793537, 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:18.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52735 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897141+0000", 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897141+0000", 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:18.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897140+0000", 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897252+0000", 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112527 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897264+0000", 2024-04-26T12:15:18.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1647999999999999e-05 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897277+0000", 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3369e-05 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897322+0000", 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4478999999999999e-05 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:18.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.897473+0000", 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015130800000000001 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 7 2024-04-26T12:15:18.926 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:18.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:18.950 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:18.949+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:19.051 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:19.050+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:19.075 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:19.075 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:19.075 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:19.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:19.174 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:19.171+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:19.253 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:19.252+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34780 5.a 5:5fd46cae:::benchmark_data_smithi069_31227_object34779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1971327699999996, 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014439019000000001, 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34780 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085704+0000", 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9330000000000003e-05 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085712+0000", 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8509999999999999e-06 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085717+0000", 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.088826+0000", 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031083840000000001 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089117+0000", 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029134000000000001 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089234+0000", 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117131 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.095253+0000", 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060187369999999997 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100035+0000", 2024-04-26T12:15:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047816810000000003 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100064+0000", 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9476e-05 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100084+0000", 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0222999999999999e-05 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39217 5.a 5:5e92fef2:::benchmark_data_smithi069_31227_object39216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9208993320000003, 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014277837999999999, 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39217 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361879+0000", 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361878+0000", 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361966+0000", 2024-04-26T12:15:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7657000000000005e-05 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361975+0000", 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1730000000000001e-06 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.361982+0000", 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4569999999999999e-06 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362014+0000", 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2051000000000002e-05 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362134+0000", 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927899999999999 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.362252+0000", 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011875 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.364168+0000", 2024-04-26T12:15:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019152699999999999 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376076+0000", 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011908409 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376118+0000", 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2169999999999998e-05 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.376157+0000", 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8432000000000001e-05 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39226 5.a 5:5c62ab6f:::benchmark_data_smithi069_31227_object39225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9166440739999997, 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014282428, 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39226 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366134+0000", 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366133+0000", 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366195+0000", 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1110000000000003e-05 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366203+0000", 2024-04-26T12:15:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4069999999999993e-06 2024-04-26T12:15:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366208+0000", 2024-04-26T12:15:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0159999999999999e-06 2024-04-26T12:15:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366236+0000", 2024-04-26T12:15:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8359000000000001e-05 2024-04-26T12:15:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366310+0000", 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3813999999999995e-05 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366390+0000", 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9457999999999997e-05 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.368587+0000", 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021969369999999999 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380339+0000", 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011752685000000001 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380385+0000", 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5705999999999999e-05 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380417+0000", 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1625999999999998e-05 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:39228 5.a 5:5213e8ff:::benchmark_data_smithi069_31227_object39227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9164045510000003, 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014169212, 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39228 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366374+0000", 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366373+0000", 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366442+0000", 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8733999999999996e-05 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366450+0000", 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.366456+0000", 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0900000000000001e-06 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367457+0000", 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001001479 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367537+0000", 2024-04-26T12:15:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0018000000000005e-05 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.367614+0000", 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.368716+0000", 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011021539999999999 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380472+0000", 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011755969 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380519+0000", 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999999e-05 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:14.380543+0000", 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4068000000000001e-05 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:41656 5.a 5:5b21bf54:::benchmark_data_smithi069_31227_object41655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1416034740000001, 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015471509, 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 41656 2024-04-26T12:15:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141174+0000", 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141228+0000", 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4228000000000003e-05 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141237+0000", 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141243+0000", 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1330000000000004e-06 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142532+0000", 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001288871 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142672+0000", 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014038899999999999 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142828+0000", 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155673 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.145023+0000", 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021952600000000001 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156596+0000", 2024-04-26T12:15:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011573162999999999 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156625+0000", 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8408999999999999e-05 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156646+0000", 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1421999999999999e-05 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:41658 5.a 5:5c63d080:::benchmark_data_smithi069_31227_object41657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:15.142784+0000", 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1399945899999997, 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013966386000000001, 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 41658 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142784+0000", 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142784+0000", 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142783+0000", 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142841+0000", 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8783000000000003e-05 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142851+0000", 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8679999999999994e-06 2024-04-26T12:15:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142858+0000", 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.754e-06 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.143977+0000", 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011193430000000001 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.144113+0000", 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135134 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.144243+0000", 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013065599999999999 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.145295+0000", 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010518680000000001 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156679+0000", 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011384049 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156720+0000", 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0722000000000001e-05 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156750+0000", 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0116000000000001e-05 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:48491 5.a 5:5429b147:::benchmark_data_smithi069_31227_object48490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.8641577279999999, 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01423643, 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 48491 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418620+0000", 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418663+0000", 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3235999999999997e-05 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418676+0000", 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2773e-05 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.418683+0000", 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.423197+0000", 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045135150000000001 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.423324+0000", 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012728699999999999 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.423451+0000", 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012666199999999999 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.427627+0000", 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041761519999999998 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.432807+0000", 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051797470000000002 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.432835+0000", 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8028999999999999e-05 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.432857+0000", 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079e-05 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:49622 5.c 5:31a953d8:::benchmark_data_smithi069_31227_object49621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:17.814354+0000", 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.468424562, 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013861336, 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 49622 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814354+0000", 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814354+0000", 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814353+0000", 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814454+0000", 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100673 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814463+0000", 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0280000000000006e-06 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.814469+0000", 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1199999999999999e-06 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.817597+0000", 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031284339999999998 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.817722+0000", 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000125084 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828099+0000", 2024-04-26T12:15:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010377213 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828148+0000", 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8161000000000002e-05 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:17.828215+0000", 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7327000000000001e-05 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52050 5.a 5:5cbb57c0:::benchmark_data_smithi069_31227_object52049:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.645022+0000", 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.63775642399999999, 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014525903, 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52050 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645022+0000", 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645022+0000", 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645007+0000", 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999852 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645060+0000", 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2643999999999999e-05 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645067+0000", 2024-04-26T12:15:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4789999999999999e-06 2024-04-26T12:15:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645075+0000", 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7049999999999999e-06 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.650323+0000", 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052477629999999999 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.650447+0000", 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124292 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.650575+0000", 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128405 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.654869+0000", 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042931540000000004 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.659447+0000", 2024-04-26T12:15:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045782679999999999 2024-04-26T12:15:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.659511+0000", 2024-04-26T12:15:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4639000000000002e-05 2024-04-26T12:15:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.659548+0000", 2024-04-26T12:15:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6195000000000002e-05 2024-04-26T12:15:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52112 5.a 5:52fa693e:::benchmark_data_smithi069_31227_object52111:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.665525+0000", 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.617252841, 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013580996, 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52112 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.665525+0000", 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.665525+0000", 2024-04-26T12:15:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.665525+0000", 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.665588+0000", 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3058000000000005e-05 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.665597+0000", 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5289999999999997e-06 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.665604+0000", 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.668524+0000", 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002920246 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.668664+0000", 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014008 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.668826+0000", 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016150299999999999 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676009+0000", 2024-04-26T12:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071827690000000003 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.679011+0000", 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030024100000000001 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.679069+0000", 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7754000000000003e-05 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.679106+0000", 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7543000000000003e-05 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52115 5.a 5:5d601bf1:::benchmark_data_smithi069_31227_object52114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.61641839200000004, 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015623575000000001, 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52115 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666359+0000", 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666472+0000", 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113158 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666483+0000", 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0592e-05 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666491+0000", 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670239+0000", 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037479000000000002 2024-04-26T12:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670314+0000", 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5463000000000006e-05 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670385+0000", 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676032+0000", 2024-04-26T12:15:19.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056472600000000003 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681896+0000", 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058638229999999998 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681948+0000", 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2061000000000002e-05 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681983+0000", 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5432000000000002e-05 2024-04-26T12:15:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52126 5.a 5:580be8f9:::benchmark_data_smithi069_31227_object52125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.670279+0000", 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.61249922899999998, 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014521444, 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52126 2024-04-26T12:15:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670279+0000", 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670279+0000", 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670278+0000", 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670425+0000", 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014720400000000001 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670438+0000", 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2261e-05 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670444+0000", 2024-04-26T12:15:19.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8279999999999997e-06 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.673230+0000", 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027851849999999999 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.673355+0000", 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012502499999999999 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.673490+0000", 2024-04-26T12:15:19.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135329 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676247+0000", 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027573160000000001 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684719+0000", 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084716830000000007 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684764+0000", 2024-04-26T12:15:19.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:15:19.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684800+0000", 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6783999999999999e-05 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52128 5.a 5:561158a6:::benchmark_data_smithi069_31227_object52127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:19.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.61232592399999997, 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014477024999999999, 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52128 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670521+0000", 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9177999999999994e-05 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670529+0000", 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0020000000000006e-06 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670534+0000", 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.674778+0000", 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042433840000000002 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.674864+0000", 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6642000000000002e-05 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.674966+0000", 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101605 2024-04-26T12:15:19.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676515+0000", 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001549475 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684859+0000", 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083439789999999996 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684902+0000", 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2976999999999999e-05 2024-04-26T12:15:19.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684929+0000", 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7025999999999998e-05 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.365 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:53576 5.b e24/16 5:d4d91383:::benchmark_data_smithi069_31227_object53575:head v 24'3359, mlcod=24'3356)", 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.205340+0000", 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.077438623999999998, 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014227465, 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205340+0000", 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205340+0000", 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205339+0000", 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205471+0000", 2024-04-26T12:15:19.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000131829 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205480+0000", 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2790000000000004e-06 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205486+0000", 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8209999999999998e-06 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205588+0000", 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102346 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.205605+0000", 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7164e-05 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.219536+0000", 2024-04-26T12:15:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013930784 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.219567+0000", 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0865999999999999e-05 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.076349339000000002, 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.073524355999999999, 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:53588 5.b e24/16 5:d5b8aa04:::benchmark_data_smithi069_31227_object53587:head v 24'3360, mlcod=24'3356)", 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209436+0000", 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.073342488999999997, 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013858657, 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209436+0000", 2024-04-26T12:15:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209436+0000", 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209435+0000", 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209483+0000", 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7593000000000003e-05 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209493+0000", 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9429999999999995e-06 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209499+0000", 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210154+0000", 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065516800000000003 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210174+0000", 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9820999999999999e-05 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.223266+0000", 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013091808999999999 2024-04-26T12:15:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.223294+0000", 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8710000000000001e-05 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53593 5.3 5:c1e11dd9:::benchmark_data_smithi069_31227_object53592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.072236658999999995, 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015984143999999999, 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53593 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210541+0000", 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210562+0000", 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1222000000000001e-05 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210567+0000", 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5199999999999999e-06 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210570+0000", 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1640000000000001e-06 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217784+0000", 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007214359 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217889+0000", 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105086 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226187+0000", 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082971880000000005 2024-04-26T12:15:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226261+0000", 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4091999999999995e-05 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226526+0000", 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026496499999999998 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53598 5.3 5:c8c7ea41:::benchmark_data_smithi069_31227_object53597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.212577+0000", 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.070201337000000003, 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014102395, 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53598 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212577+0000", 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212577+0000", 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212576+0000", 2024-04-26T12:15:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212649+0000", 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2871000000000001e-05 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212659+0000", 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212665+0000", 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.219562+0000", 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068971229999999998 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.219681+0000", 2024-04-26T12:15:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011838800000000001 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226534+0000", 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068532330000000002 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226606+0000", 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1951000000000003e-05 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226679+0000", 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3274000000000004e-05 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53687 5.c 5:3c8d0e06:::benchmark_data_smithi069_31227_object53686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.245901+0000", 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.036877457000000002, 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014091555, 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53687 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.245901+0000", 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.245901+0000", 2024-04-26T12:15:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.245900+0000", 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.246038+0000", 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000137799 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.246045+0000", 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3429999999999998e-06 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.246051+0000", 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.249079+0000", 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030278570000000001 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.249197+0000", 2024-04-26T12:15:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011791 2024-04-26T12:15:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.259838+0000", 2024-04-26T12:15:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010641177 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.259901+0000", 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2959999999999994e-05 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.259992+0000", 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1594000000000004e-05 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:19.402 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:19.402 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:19.404 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:19.402+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:19.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:19.504 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:19.503+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:19.526 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:19.526 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:19.527 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:19.546 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:19.550 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:19.550 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:19.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:19.605 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:19.604+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:19.696 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:15:19.705 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:19.704+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:19.741 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:19.741 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:19.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 15 16 55119 55103 229.579 172.438 0.00638738 0.00435279 2024-04-26T12:15:19.753 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:19.837 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:19.836+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:19.907 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:19.906+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:19.936 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:19.936 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:19.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:20.008 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:20.007+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:20.106 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:20.107 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:20.111 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:20.109+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:20.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:20.211 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:20.210+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:20.311 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:20.310+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:20.318 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:20.318 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:20.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:20.413 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:20.411+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:20.513 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:20.512+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:20.527 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:20.527 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:20.542 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:20.615 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:20.613+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:20.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:15:20.681 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-26T12:15:20.681 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:15:20.681 INFO:teuthology.orchestra.console.smithi113:Power on 2024-04-26T12:15:20.681 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T12:15:20.691 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:15:20.691 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:20.691 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:20.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:20.704 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2024-04-26T12:15:20.704 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:15:20.724 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-26T12:15:20.743 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:20.742+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:20.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-26T12:15:20.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 16 16 57841 57825 225.862 170.125 0.00208338 0.00442445 2024-04-26T12:15:20.817 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:20.815+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:20.846 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:20.846 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:20.860 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:20.917 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:20.916+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:21.018 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:21.017+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:21.040 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:21.040 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:21.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:21.119 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:21.118+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:21.211 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:21.211 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:21.220 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:21.219+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:21.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:21.321 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:21.319+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:21.421 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:21.421 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:21.422 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:21.421+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:21.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:21.523 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:21.522+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:21.551 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:21.624 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:21.623+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:21.631 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:21.631 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:21.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:21.674 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:21.674 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:21.695 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:21.696 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:21.699 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:21.699 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:21.725 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:21.724+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:21.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 17 16 60497 60481 222.339 166 0.00283971 0.00449426 2024-04-26T12:15:21.795 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:21.795 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:21.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.795 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60590 5.d 5:b86a7ff4:::benchmark_data_smithi069_31227_object60589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.795 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.785995+0000", 2024-04-26T12:15:21.795 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0066313040000000002, 2024-04-26T12:15:21.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066560539999999998, 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60590 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.785995+0000", 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.785995+0000", 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.785994+0000", 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.786062+0000", 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7848999999999994e-05 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.786070+0000", 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5969999999999992e-06 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.786075+0000", 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6879999999999998e-06 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787734+0000", 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016591119999999999 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787859+0000", 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012479099999999999 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.799 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60597 5.d 5:b87bb602:::benchmark_data_smithi069_31227_object60596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.787741+0000", 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048853000000000004, 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049914790000000001, 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60597 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787741+0000", 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787741+0000", 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787740+0000", 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:21.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787769+0000", 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8632999999999998e-05 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787777+0000", 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4300000000000006e-06 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.787789+0000", 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1761e-05 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.789275+0000", 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001486263 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.789381+0000", 2024-04-26T12:15:21.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105875 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60598 5.d 5:b66f07c3:::benchmark_data_smithi069_31227_object60597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.788136+0000", 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0044898960000000002, 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046665999999999999, 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60598 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788136+0000", 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788136+0000", 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788135+0000", 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788196+0000", 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0201999999999997e-05 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788210+0000", 2024-04-26T12:15:21.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3971999999999999e-05 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788215+0000", 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0010000000000001e-06 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791125+0000", 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029103390000000001 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791225+0000", 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010050799999999999 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60601 5.d 5.5492033d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.788559+0000", 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004067457, 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043050409999999999, 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.808 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60601 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788559+0000", 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788559+0000", 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788558+0000", 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788610+0000", 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1669000000000003e-05 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788616+0000", 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4579999999999998e-06 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.788620+0000", 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3420000000000001e-06 2024-04-26T12:15:21.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60605 5.8 5:15e8bc71:::benchmark_data_smithi069_31227_object60604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.790109+0000", 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025172010000000002, 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028118359999999998, 2024-04-26T12:15:21.812 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60605 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790109+0000", 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790109+0000", 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790108+0000", 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790176+0000", 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7821e-05 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790183+0000", 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5140000000000004e-06 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790187+0000", 2024-04-26T12:15:21.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9700000000000001e-06 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790225+0000", 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7577999999999998e-05 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790329+0000", 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010435 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.790492+0000", 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016225899999999999 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.817 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60609 5.8 5:17aa32ef:::benchmark_data_smithi069_31227_object60608:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.791208+0000", 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014175699999999999, 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001795823, 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60609 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791208+0000", 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791208+0000", 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791208+0000", 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791279+0000", 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1198000000000005e-05 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791288+0000", 2024-04-26T12:15:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8650000000000007e-06 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791293+0000", 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1070000000000004e-06 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792356+0000", 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010631849999999999 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792472+0000", 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116159 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792604+0000", 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132082 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60610 5.0 5:0945945a:::benchmark_data_smithi069_31227_object60609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.791435+0000", 2024-04-26T12:15:21.822 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0011910029999999999, 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016456839999999999, 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60610 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791435+0000", 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791435+0000", 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791435+0000", 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791507+0000", 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2779000000000002e-05 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791516+0000", 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5350000000000004e-06 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791520+0000", 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0609999999999997e-06 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792345+0000", 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00082544300000000003 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792453+0000", 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010772099999999999 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792566+0000", 2024-04-26T12:15:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112724 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60611 5.f 5:fa9948c7:::benchmark_data_smithi069_31227_object60610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.791943+0000", 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00068338700000000004, 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012137210000000001, 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.827 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60611 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791943+0000", 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791943+0000", 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.791942+0000", 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792021+0000", 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8553000000000005e-05 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792028+0000", 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2690000000000002e-06 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792033+0000", 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792065+0000", 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2428999999999997e-05 2024-04-26T12:15:21.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792194+0000", 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129002 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60612 5.9 5:94a95fc7:::benchmark_data_smithi069_31227_object60611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.792107+0000", 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00051884200000000004, 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001117977, 2024-04-26T12:15:21.831 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60612 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792107+0000", 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792107+0000", 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792107+0000", 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792180+0000", 2024-04-26T12:15:21.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3150000000000003e-05 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792185+0000", 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7249999999999997e-06 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792188+0000", 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1700000000000001e-06 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792227+0000", 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9193999999999998e-05 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792359+0000", 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132213 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60613 5.8 5.e3605418 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.835 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.792698+0000", 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9999285, 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00058406300000000001, 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60613 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792698+0000", 2024-04-26T12:15:21.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792698+0000", 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792697+0000", 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:21.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792734+0000", 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6953999999999999e-05 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792743+0000", 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792750+0000", 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6159999999999998e-06 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60614 5.b 5:d8f27159:::benchmark_data_smithi069_31227_object60613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.792757+0000", 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9998693, 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00057574600000000003, 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:21.839 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60614 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792757+0000", 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792757+0000", 2024-04-26T12:15:21.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792756+0000", 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792788+0000", 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2160999999999999e-05 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792795+0000", 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9059999999999996e-06 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792801+0000", 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4110000000000004e-06 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792846+0000", 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4872e-05 2024-04-26T12:15:21.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.792972+0000", 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012680300000000001 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.793122+0000", 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014986399999999999 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:21.843 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:21.844 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-26T12:15:21.844 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:21.845 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:21.845 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:21.843+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:21.946 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:21.945+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:22.028 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:22.029 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:22.029 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:22.029 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:22.029 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:22.041 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:22.082 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:22.081+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:22.148 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:22.147+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:22.226 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39028 5.4 5:28ff5c50:::benchmark_data_smithi069_31227_object39027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.9256749710000003, 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018476389999999999, 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39028 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297529+0000", 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297560+0000", 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0514e-05 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297569+0000", 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:15:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297575+0000", 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302181+0000", 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046059589999999997 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302282+0000", 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010151 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302358+0000", 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5735000000000006e-05 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.305000+0000", 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026415259999999999 2024-04-26T12:15:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315922+0000", 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010921985 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315973+0000", 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1897999999999997e-05 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.316006+0000", 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2715000000000001e-05 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6994196759999998, 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6993308320000002, 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40099 5.0 5:0b62973d:::benchmark_data_smithi069_31227_object40098:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5803143420000003, 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018142968999999998, 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40099 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642970+0000", 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0208000000000002e-05 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642979+0000", 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6459999999999999e-06 2024-04-26T12:15:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642982+0000", 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.501e-06 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646416+0000", 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034334499999999998 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646523+0000", 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107423 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646614+0000", 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0826000000000001e-05 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649441+0000", 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002827272 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660958+0000", 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011516587999999999 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660999+0000", 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1501999999999997e-05 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661033+0000", 2024-04-26T12:15:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4026000000000003e-05 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40108 5.0 5:06ce292f:::benchmark_data_smithi069_31227_object40107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5770451869999995, 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017776212999999999, 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40108 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646160+0000", 2024-04-26T12:15:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646159+0000", 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646231+0000", 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1707999999999999e-05 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646238+0000", 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646248+0000", 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9510000000000001e-06 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652204+0000", 2024-04-26T12:15:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005956584 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652325+0000", 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120782 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652441+0000", 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011657799999999999 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655103+0000", 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026617530000000002 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663851+0000", 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087480049999999997 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663899+0000", 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7444999999999997e-05 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663936+0000", 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7092999999999999e-05 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40116 5.0 5:0a29f80b:::benchmark_data_smithi069_31227_object40115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5741487200000002, 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017640323999999999, 2024-04-26T12:15:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40116 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649056+0000", 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649115+0000", 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9722999999999997e-05 2024-04-26T12:15:22.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649121+0000", 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.553e-06 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649125+0000", 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2089999999999999e-06 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655141+0000", 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060157730000000003 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655260+0000", 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011951999999999999 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.655358+0000", 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7365e-05 2024-04-26T12:15:22.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658199+0000", 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028416219999999998 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666616+0000", 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008416438 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666661+0000", 2024-04-26T12:15:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.549e-05 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666696+0000", 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5054e-05 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5737369719999998, 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:22.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5712908629999998, 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.271 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:22.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:22.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:22.276 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5707108249999999, 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.277 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:22.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:22.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40127 5.8 5:13ae5772:::benchmark_data_smithi069_31227_object40126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.5695097340000004, 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018042539, 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40127 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653694+0000", 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653756+0000", 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2235000000000003e-05 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653768+0000", 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1838000000000001e-05 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653775+0000", 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.438e-06 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664004+0000", 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010229264 2024-04-26T12:15:22.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664077+0000", 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2962999999999999e-05 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664146+0000", 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9523999999999994e-05 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666735+0000", 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025888489999999998 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671666+0000", 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049309250000000001 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671704+0000", 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7499000000000001e-05 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671738+0000", 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3849000000000001e-05 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:41043 5.4 5:2a464019:::benchmark_data_smithi069_31227_object41042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.2759285629999999, 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018032086999999999, 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 41043 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947276+0000", 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947275+0000", 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947327+0000", 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1827999999999999e-05 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947339+0000", 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1891e-05 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.947347+0000", 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951356+0000", 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040087179999999997 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951497+0000", 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014133900000000001 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.951631+0000", 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013373700000000001 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.959577+0000", 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079464610000000001 2024-04-26T12:15:22.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965250+0000", 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056726789999999999 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965285+0000", 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4768999999999999e-05 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.965308+0000", 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3739000000000001e-05 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50476 5.4 5:2c6eadac:::benchmark_data_smithi069_31227_object50475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.1230241689999998, 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018700795999999999, 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50476 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100180+0000", 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100214+0000", 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3896000000000002e-05 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100221+0000", 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100227+0000", 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6459999999999998e-06 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106611+0000", 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063837039999999996 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106726+0000", 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115661 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106855+0000", 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128186 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.109133+0000", 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022781670000000002 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118804+0000", 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096710839999999999 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118844+0000", 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0405999999999999e-05 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118881+0000", 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7150999999999997e-05 2024-04-26T12:15:22.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50646 5.8 5:16236705:::benchmark_data_smithi069_31227_object50645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.157176+0000", 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.0660288810000003, 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017911354000000001, 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50646 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157176+0000", 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157176+0000", 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157175+0000", 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157233+0000", 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157244+0000", 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0652999999999999e-05 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.157250+0000", 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5100000000000004e-06 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.162867+0000", 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056170040000000001 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.162961+0000", 2024-04-26T12:15:22.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4036000000000006e-05 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.163060+0000", 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8454000000000003e-05 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.166425+0000", 2024-04-26T12:15:22.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033650490000000002 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.175026+0000", 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086011869999999997 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.175057+0000", 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0540999999999998e-05 2024-04-26T12:15:22.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.175087+0000", 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0722000000000002e-05 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51736 5.8 5:17ffc05c:::benchmark_data_smithi069_31227_object51735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6900528819999998, 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019106003, 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51736 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533151+0000", 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533182+0000", 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0991999999999997e-05 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533191+0000", 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533197+0000", 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4479999999999999e-06 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534047+0000", 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085020199999999999 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534122+0000", 2024-04-26T12:15:22.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4904e-05 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534247+0000", 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125241 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537303+0000", 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030558360000000001 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552160+0000", 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014856362999999999 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552217+0000", 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7754000000000003e-05 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552258+0000", 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0614000000000001e-05 2024-04-26T12:15:22.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51738 5.8 5:10901916:::benchmark_data_smithi069_31227_object51737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.689820594, 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019114662000000001, 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51738 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:22.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533505+0000", 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012143500000000001 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533516+0000", 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1031e-05 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533523+0000", 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537326+0000", 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038034509999999998 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537402+0000", 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5873999999999999e-05 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5947999999999999e-05 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540283+0000", 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028045320000000002 2024-04-26T12:15:22.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552413+0000", 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012130395 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552464+0000", 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0574000000000001e-05 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552499+0000", 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5264e-05 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51740 5.0 5:03a2d37d:::benchmark_data_smithi069_31227_object51739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.68894484, 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018101987, 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51740 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534259+0000", 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534321+0000", 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2378000000000005e-05 2024-04-26T12:15:22.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534341+0000", 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534350+0000", 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537321+0000", 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029708909999999998 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537401+0000", 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0768999999999999e-05 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6599000000000003e-05 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540265+0000", 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027868049999999998 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552278+0000", 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012013239 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552327+0000", 2024-04-26T12:15:22.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9438999999999999e-05 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552362+0000", 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4544e-05 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60807 5.d 5:b0b9614b:::benchmark_data_smithi069_31227_object60806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.865122+0000", 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.35808246199999999, 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017857714, 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60807 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865122+0000", 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865122+0000", 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865122+0000", 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865161+0000", 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9604999999999998e-05 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865170+0000", 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3180000000000007e-06 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865176+0000", 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.455e-06 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.867036+0000", 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00185995 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.867161+0000", 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125141 2024-04-26T12:15:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.882856+0000", 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0156945 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.882900+0000", 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4347000000000001e-05 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.882980+0000", 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0071e-05 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60809 5.d 5:bf31e9d1:::benchmark_data_smithi069_31227_object60808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.865198+0000", 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.35800670499999998, 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017894324, 2024-04-26T12:15:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60809 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865198+0000", 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865198+0000", 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865197+0000", 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865281+0000", 2024-04-26T12:15:22.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3246999999999998e-05 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865287+0000", 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4450000000000001e-06 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865291+0000", 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2100000000000003e-06 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.870429+0000", 2024-04-26T12:15:22.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051379889999999999 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.870561+0000", 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000131206 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.882988+0000", 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012427885 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.883029+0000", 2024-04-26T12:15:22.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0398000000000002e-05 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.883092+0000", 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3534000000000005e-05 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:60810 5.d 5:bcc6bb55:::benchmark_data_smithi069_31227_object60809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:21.865296+0000", 2024-04-26T12:15:22.337 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.357909227, 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017917677999999999, 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 60810 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865296+0000", 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865296+0000", 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865295+0000", 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865331+0000", 2024-04-26T12:15:22.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5553000000000003e-05 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865335+0000", 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5560000000000001e-06 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.865339+0000", 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.439e-06 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.872405+0000", 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070659950000000003 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.872540+0000", 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000135375 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.883103+0000", 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010562737000000001 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.883142+0000", 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8797999999999997e-05 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:21.883213+0000", 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1567000000000001e-05 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.342 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:61225 5.8 5:1f272efc:::benchmark_data_smithi069_31227_object61224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:22.014755+0000", 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.208449998, 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.017781183999999998, 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 61225 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.014755+0000", 2024-04-26T12:15:22.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.014755+0000", 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.014754+0000", 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.014848+0000", 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4105999999999997e-05 2024-04-26T12:15:22.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.014857+0000", 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0820000000000005e-06 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.014864+0000", 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1010000000000003e-06 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.015051+0000", 2024-04-26T12:15:22.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000186975 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.015191+0000", 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013917399999999999 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.015325+0000", 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134091 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.022657+0000", 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0073328880000000001 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.032462+0000", 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098049230000000001 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.032504+0000", 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1443999999999998e-05 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:22.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.032536+0000", 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2101000000000003e-05 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:22.348 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:22.350 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:22.348+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:22.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:22.451 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:22.449+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:22.505 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:62499 5.a e25/16 ondisk, result = 0)", 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.500271+0000", 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038496720000000002, 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038627739999999998, 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500271+0000", 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500271+0000", 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500270+0000", 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500272+0000", 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.057e-06 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500278+0000", 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2730000000000002e-06 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500283+0000", 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8380000000000001e-06 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502435+0000", 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021528860000000001 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502444+0000", 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6349999999999995e-06 2024-04-26T12:15:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62519 5.5 5:a93ecb67:::benchmark_data_smithi069_31227_object62518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.502298+0000", 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0018218150000000001, 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018762939999999999, 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62519 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502298+0000", 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502298+0000", 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502298+0000", 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502396+0000", 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8738000000000002e-05 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502405+0000", 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:15:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502411+0000", 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2870000000000001e-06 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502448+0000", 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6681000000000003e-05 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502542+0000", 2024-04-26T12:15:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:62520 5.e e25/16 5:7b22d199:::benchmark_data_smithi069_31227_object62519:head v 25'3929, mlcod=25'3926)", 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.502905+0000", 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012155740000000001, 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00130671, 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502905+0000", 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502905+0000", 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502904+0000", 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502984+0000", 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9882999999999994e-05 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502991+0000", 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0740000000000004e-06 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502996+0000", 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5530000000000003e-06 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503050+0000", 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4178000000000002e-05 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503070+0000", 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0268e-05 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62524 5.7 5:ecdee2d4:::benchmark_data_smithi069_31227_object62523:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.503122+0000", 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00099848100000000006, 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011213289999999999, 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62524 2024-04-26T12:15:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503122+0000", 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503122+0000", 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503121+0000", 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503178+0000", 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6808999999999998e-05 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503185+0000", 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2679999999999997e-06 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503189+0000", 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2919999999999997e-06 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503222+0000", 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2517000000000001e-05 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.503325+0000", 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102649 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62502 5.a 5:5d918813:::benchmark_data_smithi069_31227_object62501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.492430+0000", 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011690168000000001, 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011849821999999999, 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62502 2024-04-26T12:15:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492430+0000", 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492430+0000", 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492430+0000", 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492461+0000", 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0945999999999998e-05 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492468+0000", 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.109e-06 2024-04-26T12:15:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492473+0000", 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6110000000000001e-06 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.496267+0000", 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037940640000000002 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.496386+0000", 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118651 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.496521+0000", 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013516600000000001 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62504 5.a 5:55d54b5c:::benchmark_data_smithi069_31227_object62503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.492595+0000", 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011525797000000001, 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011723449, 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62504 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492595+0000", 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492595+0000", 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492594+0000", 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492677+0000", 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3418999999999995e-05 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492685+0000", 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8790000000000003e-06 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492691+0000", 2024-04-26T12:15:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1369999999999999e-06 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.498424+0000", 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057326520000000004 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.498565+0000", 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000140703 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.498702+0000", 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013731799999999999 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62505 5.a 5:5e7fed64:::benchmark_data_smithi069_31227_object62504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.492911+0000", 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011208922, 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011443626, 2024-04-26T12:15:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62505 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492911+0000", 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492911+0000", 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.492911+0000", 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.493034+0000", 2024-04-26T12:15:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012340699999999999 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.493042+0000", 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2160000000000006e-06 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.493048+0000", 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7429999999999999e-06 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500484+0000", 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074358749999999998 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500605+0000", 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121317 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.500749+0000", 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014401600000000001 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62508 5.a 5:5ae92930:::benchmark_data_smithi069_31227_object62507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0088753410000000001, 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009149061, 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62508 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495244+0000", 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495330+0000", 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6191000000000002e-05 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495342+0000", 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495349+0000", 2024-04-26T12:15:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9619999999999996e-06 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502562+0000", 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072129940000000003 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502674+0000", 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112186 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502815+0000", 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014114999999999999 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 8 2024-04-26T12:15:22.540 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:22.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:22.585 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:22.584+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:22.654 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:22.653+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:22.696 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:22.696 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:22.704 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:15:22.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:22.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 18 16 63163 63147 219.243 166.625 0.00648532 0.00455807 2024-04-26T12:15:22.796 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:22.794+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:22.856 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:22.854+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:34780 5.a 5:5fd46cae:::benchmark_data_smithi069_31227_object34779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8186254319999993, 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014439019000000001, 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34780 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085645+0000", 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085704+0000", 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9330000000000003e-05 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085712+0000", 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8509999999999999e-06 2024-04-26T12:15:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.085717+0000", 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.088826+0000", 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031083840000000001 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089117+0000", 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029134000000000001 2024-04-26T12:15:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.089234+0000", 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117131 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.095253+0000", 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060187369999999997 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100035+0000", 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047816810000000003 2024-04-26T12:15:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100064+0000", 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9476e-05 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:13.100084+0000", 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0222999999999999e-05 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:41656 5.a 5:5b21bf54:::benchmark_data_smithi069_31227_object41655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.7630961359999997, 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015471509, 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 41656 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141175+0000", 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141174+0000", 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141228+0000", 2024-04-26T12:15:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4228000000000003e-05 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141237+0000", 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.141243+0000", 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1330000000000004e-06 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142532+0000", 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001288871 2024-04-26T12:15:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142672+0000", 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014038899999999999 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.142828+0000", 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155673 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.145023+0000", 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021952600000000001 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156596+0000", 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011573162999999999 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156625+0000", 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8408999999999999e-05 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:15.156646+0000", 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1421999999999999e-05 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52050 5.a 5:5cbb57c0:::benchmark_data_smithi069_31227_object52049:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.645022+0000", 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2592490859999996, 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014525903, 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52050 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645022+0000", 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645022+0000", 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645007+0000", 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999852 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645060+0000", 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2643999999999999e-05 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645067+0000", 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4789999999999999e-06 2024-04-26T12:15:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.645075+0000", 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7049999999999999e-06 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.650323+0000", 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052477629999999999 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.650447+0000", 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124292 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.650575+0000", 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128405 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.654869+0000", 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042931540000000004 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.659447+0000", 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045782679999999999 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.659511+0000", 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4639000000000002e-05 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.659548+0000", 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6195000000000002e-05 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52115 5.a 5:5d601bf1:::benchmark_data_smithi069_31227_object52114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2379110539999996, 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015623575000000001, 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52115 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666359+0000", 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666472+0000", 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113158 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666483+0000", 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0592e-05 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666491+0000", 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670239+0000", 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037479000000000002 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670314+0000", 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5463000000000006e-05 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670385+0000", 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676032+0000", 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056472600000000003 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681896+0000", 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058638229999999998 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681948+0000", 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2061000000000002e-05 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681983+0000", 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5432000000000002e-05 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52126 5.a 5:580be8f9:::benchmark_data_smithi069_31227_object52125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.670279+0000", 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2339918909999996, 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014521444, 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52126 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670279+0000", 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670279+0000", 2024-04-26T12:15:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670278+0000", 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670425+0000", 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014720400000000001 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670438+0000", 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2261e-05 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670444+0000", 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8279999999999997e-06 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.673230+0000", 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027851849999999999 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.673355+0000", 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012502499999999999 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.673490+0000", 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135329 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676247+0000", 2024-04-26T12:15:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027573160000000001 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684719+0000", 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084716830000000007 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684764+0000", 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684800+0000", 2024-04-26T12:15:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6783999999999999e-05 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52128 5.a 5:561158a6:::benchmark_data_smithi069_31227_object52127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2338185859999999, 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014477024999999999, 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52128 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670452+0000", 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670521+0000", 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9177999999999994e-05 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670529+0000", 2024-04-26T12:15:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0020000000000006e-06 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670534+0000", 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.674778+0000", 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042433840000000002 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.674864+0000", 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6642000000000002e-05 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.674966+0000", 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101605 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676515+0000", 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001549475 2024-04-26T12:15:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684859+0000", 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083439789999999996 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684902+0000", 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2976999999999999e-05 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.684929+0000", 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7025999999999998e-05 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6978420010000002, 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6950170180000002, 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53593 5.3 5:c1e11dd9:::benchmark_data_smithi069_31227_object53592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6937293210000002, 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015984143999999999, 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53593 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210541+0000", 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210562+0000", 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1222000000000001e-05 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210567+0000", 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5199999999999999e-06 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210570+0000", 2024-04-26T12:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1640000000000001e-06 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217784+0000", 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007214359 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217889+0000", 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105086 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226187+0000", 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082971880000000005 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226261+0000", 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4091999999999995e-05 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226526+0000", 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026496499999999998 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:61018 5.c 5:3a05d157:::benchmark_data_smithi069_31227_object61017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:21.941643+0000", 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.96262773599999996, 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014411208999999999, 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 61018 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.941643+0000", 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.941643+0000", 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.941642+0000", 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.941704+0000", 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2086000000000002e-05 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.941714+0000", 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:15:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.941721+0000", 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9879999999999998e-06 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.943662+0000", 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019406250000000001 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.943825+0000", 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016362399999999999 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.955931+0000", 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012105596 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.955987+0000", 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.596e-05 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:21.956054+0000", 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7557000000000004e-05 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62508 5.a 5:5ae92930:::benchmark_data_smithi069_31227_object62507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40902590700000002, 2024-04-26T12:15:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016616539, 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62508 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495244+0000", 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495330+0000", 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6191000000000002e-05 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495342+0000", 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495349+0000", 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9619999999999996e-06 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502562+0000", 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072129940000000003 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502674+0000", 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112186 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502815+0000", 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014114999999999999 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.504979+0000", 2024-04-26T12:15:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002163828 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511812+0000", 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068327220000000003 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511841+0000", 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9793000000000001e-05 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511862+0000", 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0054000000000001e-05 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62774 5.a 5:54f6c8b5:::benchmark_data_smithi069_31227_object62773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.306662663, 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015716633000000001, 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62774 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597687+0000", 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.894e-05 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597697+0000", 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0834e-05 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597707+0000", 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8349999999999999e-06 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.602517+0000", 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048097460000000002 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.602587+0000", 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0557999999999998e-05 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.602696+0000", 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108509 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.607174+0000", 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044781430000000004 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613249+0000", 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060746849999999998 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613290+0000", 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1477999999999998e-05 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613325+0000", 2024-04-26T12:15:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4538e-05 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62775 5.a 5:50b9397d:::benchmark_data_smithi069_31227_object62774:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.597913+0000", 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.30635796900000001, 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015483640999999999, 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62775 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597913+0000", 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597913+0000", 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597912+0000", 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597995+0000", 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2526000000000002e-05 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.598004+0000", 2024-04-26T12:15:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2830000000000007e-06 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.598010+0000", 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7350000000000001e-06 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.604353+0000", 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063433819999999998 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.604482+0000", 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012896699999999999 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.604608+0000", 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126344 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.607202+0000", 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025936449999999999 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613333+0000", 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061308480000000004 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613367+0000", 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4422999999999999e-05 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613397+0000", 2024-04-26T12:15:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9339000000000001e-05 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63047 5.a 5:58692a15:::benchmark_data_smithi069_31227_object63046:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.708724+0000", 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.19554705999999999, 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015027143999999999, 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63047 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708724+0000", 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708724+0000", 2024-04-26T12:15:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708723+0000", 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708784+0000", 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1019e-05 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708792+0000", 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7870000000000002e-06 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708797+0000", 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.712536+0000", 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037392559999999998 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.712677+0000", 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014078300000000001 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.712807+0000", 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012963199999999999 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.719331+0000", 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065245440000000002 2024-04-26T12:15:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.723636+0000", 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043051920000000002 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.723715+0000", 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8625e-05 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.723751+0000", 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6084999999999998e-05 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63050 5.a 5:58bc69e6:::benchmark_data_smithi069_31227_object63049:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.708905+0000", 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.19536604499999999, 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014985075, 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63050 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708905+0000", 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708905+0000", 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708904+0000", 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708988+0000", 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3397000000000001e-05 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.708995+0000", 2024-04-26T12:15:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2069999999999998e-06 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.709000+0000", 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8189999999999999e-06 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.714564+0000", 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055646419999999999 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.714683+0000", 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011820300000000001 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.714807+0000", 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124072 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.721485+0000", 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066780420000000004 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.723814+0000", 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023289159999999999 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.723858+0000", 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4768000000000002e-05 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.723890+0000", 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63241 5.2 5:46cc3d96:::benchmark_data_smithi069_31227_object63240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.119054807, 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016524549999999999, 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63241 2024-04-26T12:15:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785290+0000", 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4809999999999997e-05 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785301+0000", 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0735e-05 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785307+0000", 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788592+0000", 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032850589999999999 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788711+0000", 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011880200000000001 2024-04-26T12:15:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801600+0000", 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012888599000000001 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801671+0000", 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1507000000000005e-05 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801741+0000", 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9256000000000002e-05 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63242 5.2 5:4911c375:::benchmark_data_smithi069_31227_object63241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.118906263, 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016514994000000002, 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63242 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785364+0000", 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785421+0000", 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785427+0000", 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7470000000000002e-06 2024-04-26T12:15:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785430+0000", 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790741+0000", 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053110060000000001 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790864+0000", 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122192 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801750+0000", 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010886132999999999 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801811+0000", 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1736000000000007e-05 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801880+0000", 2024-04-26T12:15:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8195999999999996e-05 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63246 5.2 5:47433149:::benchmark_data_smithi069_31227_object63245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.786495+0000", 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.117775982, 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503283, 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63246 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786495+0000", 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786495+0000", 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786494+0000", 2024-04-26T12:15:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786582+0000", 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8065000000000005e-05 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786592+0000", 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8970000000000003e-06 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786597+0000", 2024-04-26T12:15:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5390000000000001e-06 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.792955+0000", 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006358196 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.793121+0000", 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000166222 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801889+0000", 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087673990000000004 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801931+0000", 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2509000000000002e-05 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801998+0000", 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.711e-05 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63285 5.c 5:3ca85271:::benchmark_data_smithi069_31227_object63284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.803118+0000", 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.101153364, 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014849492000000001, 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63285 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.803118+0000", 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.803118+0000", 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.803117+0000", 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.803147+0000", 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.006e-05 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.803159+0000", 2024-04-26T12:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2097e-05 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.803166+0000", 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.806447+0000", 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032812879999999998 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.806566+0000", 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118886 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.817858+0000", 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011292221999999999 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.817900+0000", 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1813000000000001e-05 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.817967+0000", 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6686999999999994e-05 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63292 5.c 5:31696589:::benchmark_data_smithi069_31227_object63291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.804063+0000", 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.100208356, 2024-04-26T12:15:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015282802, 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63292 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.804063+0000", 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.804063+0000", 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.804062+0000", 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.804161+0000", 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9122000000000004e-05 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.804169+0000", 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0160000000000008e-06 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.804174+0000", 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.463e-06 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.808467+0000", 2024-04-26T12:15:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042926070000000004 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.808545+0000", 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7775000000000007e-05 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.819232+0000", 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010687518999999999 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.819276+0000", 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3383999999999997e-05 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.819345+0000", 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9633000000000002e-05 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:23.018 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:23.020 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:23.017+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:23.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:23.121 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:23.120+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64242 5.e 5:7bddb233:::benchmark_data_smithi069_31227_object64241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.160189+0000", 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0064210530000000004, 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064460849999999998, 2024-04-26T12:15:23.168 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64242 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160189+0000", 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160189+0000", 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160186+0000", 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999967 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160244+0000", 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7759e-05 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160272+0000", 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8527999999999999e-05 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160280+0000", 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9789999999999993e-06 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160331+0000", 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0896999999999997e-05 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160514+0000", 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018312800000000001 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.160676+0000", 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016173500000000001 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.165500+0000", 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004823885 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64248 5.4 5:2a7dd181:::benchmark_data_smithi069_31227_object64247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.162241+0000", 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0043691590000000001, 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004474174, 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.173 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64248 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162241+0000", 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162241+0000", 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162240+0000", 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162295+0000", 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4911000000000003e-05 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162303+0000", 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1839999999999999e-06 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162309+0000", 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1109999999999999e-06 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162352+0000", 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162478+0000", 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012644500000000001 2024-04-26T12:15:23.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162585+0000", 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106807 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64249 5.4 5:2a72c838:::benchmark_data_smithi069_31227_object64248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.162324+0000", 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042866650000000003, 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044584409999999996, 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.177 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64249 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162324+0000", 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162324+0000", 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162323+0000", 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162361+0000", 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7697000000000002e-05 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162368+0000", 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7009999999999996e-06 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.162374+0000", 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8490000000000002e-06 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164143+0000", 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001769018 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164266+0000", 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012228799999999999 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164413+0000", 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014728899999999999 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64251 5.e 5:7f58c038:::benchmark_data_smithi069_31227_object64250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.163074+0000", 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035366320000000001, 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037745529999999999, 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64251 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163074+0000", 2024-04-26T12:15:23.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163074+0000", 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163073+0000", 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163140+0000", 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6727e-05 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163148+0000", 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163154+0000", 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163187+0000", 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3445999999999998e-05 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163271+0000", 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4194000000000001e-05 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.163372+0000", 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100574 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.165671+0000", 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002298516 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64255 5.4 5:2d955e55:::benchmark_data_smithi069_31227_object64254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.164331+0000", 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022793840000000002, 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002588496, 2024-04-26T12:15:23.186 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64255 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164331+0000", 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164331+0000", 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164330+0000", 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164381+0000", 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0773999999999999e-05 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164391+0000", 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7920000000000004e-06 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.164396+0000", 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0690000000000001e-06 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.165970+0000", 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015747879999999999 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166073+0000", 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102215 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166194+0000", 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012113899999999999 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64259 5.f 5:f935851e:::benchmark_data_smithi069_31227_object64258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.166217+0000", 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00039373199999999999, 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00077788300000000005, 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64259 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166217+0000", 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166217+0000", 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166216+0000", 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166279+0000", 2024-04-26T12:15:23.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2770999999999999e-05 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166288+0000", 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1959999999999997e-06 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166293+0000", 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2100000000000001e-06 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166336+0000", 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3056000000000002e-05 2024-04-26T12:15:23.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166460+0000", 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012435199999999999 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:64258 5.a e25/16 5:529b449f:::benchmark_data_smithi069_31227_object64257:head v 25'4008, mlcod=25'4005)", 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.166436+0000", 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00017433300000000001, 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00063020000000000003, 2024-04-26T12:15:23.194 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166436+0000", 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166436+0000", 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166435+0000", 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166486+0000", 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0299000000000001e-05 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166494+0000", 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7600000000000002e-06 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166498+0000", 2024-04-26T12:15:23.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5519999999999998e-06 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166533+0000", 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5197999999999997e-05 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166553+0000", 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9896999999999999e-05 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64260 5.4 5.f2ad6ab4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.166802+0000", 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9998078, 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00031630800000000001, 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64260 2024-04-26T12:15:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166802+0000", 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166802+0000", 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166802+0000", 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166867+0000", 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5303999999999997e-05 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166877+0000", 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0037999999999999e-05 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.166882+0000", 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:64242 5.e e25/16 ondisk, result = 0)", 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.167067+0000", 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995432, 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8797999999999998e-05, 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167067+0000", 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167067+0000", 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167067+0000", 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167070+0000", 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9660000000000001e-06 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167076+0000", 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0800000000000002e-06 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167079+0000", 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4479999999999999e-06 2024-04-26T12:15:23.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167110+0000", 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0555000000000001e-05 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.167115+0000", 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64233 5.4 5:2551a025:::benchmark_data_smithi069_31227_object64232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.157159+0000", 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0094509269999999996, 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010068716, 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64233 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.157159+0000", 2024-04-26T12:15:23.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.157159+0000", 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.157159+0000", 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.157253+0000", 2024-04-26T12:15:23.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4221000000000005e-05 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.157262+0000", 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7600000000000008e-06 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.157267+0000", 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.159389+0000", 2024-04-26T12:15:23.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021215499999999998 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.159516+0000", 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012646099999999999 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.159661+0000", 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014513199999999999 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.209 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.209 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:23.209 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-26T12:15:23.209 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:23.210 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:23.222 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:23.221+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:23.323 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:23.321+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:23.355 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:23.356 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:23.356 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:23.356 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:23.356 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:23.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:23.454 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:23.452+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:23.524 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:23.522+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:23.555 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:23.555 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:23.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39028 5.4 5:28ff5c50:::benchmark_data_smithi069_31227_object39027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.2546898780000006, 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018476389999999999, 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.556 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39028 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297530+0000", 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297529+0000", 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297560+0000", 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0514e-05 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297569+0000", 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.297575+0000", 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302181+0000", 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046059589999999997 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302282+0000", 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010151 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.302358+0000", 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5735000000000006e-05 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.305000+0000", 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026415259999999999 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315922+0000", 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010921985 2024-04-26T12:15:23.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.315973+0000", 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1897999999999997e-05 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.316006+0000", 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2715000000000001e-05 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0284345829999992, 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:23.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0283457390000006, 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:23.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40099 5.0 5:0b62973d:::benchmark_data_smithi069_31227_object40098:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.9093292490000007, 2024-04-26T12:15:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018142968999999998, 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40099 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642890+0000", 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642970+0000", 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0208000000000002e-05 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642979+0000", 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6459999999999999e-06 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.642982+0000", 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.501e-06 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646416+0000", 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034334499999999998 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646523+0000", 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107423 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.646614+0000", 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0826000000000001e-05 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649441+0000", 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002827272 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660958+0000", 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011516587999999999 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.660999+0000", 2024-04-26T12:15:23.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1501999999999997e-05 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661033+0000", 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4026000000000003e-05 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.584 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.9027518790000002, 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:23.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:23.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.9003057699999992, 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:23.591 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:23.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.8997257320000003, 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40127 5.8 5:13ae5772:::benchmark_data_smithi069_31227_object40126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.8985246409999998, 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018042539, 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40127 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653695+0000", 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653694+0000", 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653756+0000", 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2235000000000003e-05 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653768+0000", 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1838000000000001e-05 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.653775+0000", 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.438e-06 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664004+0000", 2024-04-26T12:15:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010229264 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664077+0000", 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2962999999999999e-05 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664146+0000", 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9523999999999994e-05 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666735+0000", 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025888489999999998 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671666+0000", 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049309250000000001 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671704+0000", 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7499000000000001e-05 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671738+0000", 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3849000000000001e-05 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50476 5.4 5:2c6eadac:::benchmark_data_smithi069_31227_object50475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4520390760000002, 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018700795999999999, 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50476 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100180+0000", 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100214+0000", 2024-04-26T12:15:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3896000000000002e-05 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100221+0000", 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100227+0000", 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6459999999999998e-06 2024-04-26T12:15:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106611+0000", 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063837039999999996 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106726+0000", 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115661 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106855+0000", 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128186 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.109133+0000", 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022781670000000002 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118804+0000", 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096710839999999999 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118844+0000", 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0405999999999999e-05 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118881+0000", 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7150999999999997e-05 2024-04-26T12:15:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51736 5.8 5:17ffc05c:::benchmark_data_smithi069_31227_object51735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.0190677890000002, 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019106003, 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51736 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533151+0000", 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533182+0000", 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0991999999999997e-05 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533191+0000", 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533197+0000", 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4479999999999999e-06 2024-04-26T12:15:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534047+0000", 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085020199999999999 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534122+0000", 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4904e-05 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534247+0000", 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125241 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537303+0000", 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030558360000000001 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552160+0000", 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014856362999999999 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552217+0000", 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7754000000000003e-05 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552258+0000", 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0614000000000001e-05 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51738 5.8 5:10901916:::benchmark_data_smithi069_31227_object51737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.0188355009999999, 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019114662000000001, 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51738 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533505+0000", 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012143500000000001 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533516+0000", 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1031e-05 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533523+0000", 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537326+0000", 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038034509999999998 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537402+0000", 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5873999999999999e-05 2024-04-26T12:15:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5947999999999999e-05 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540283+0000", 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028045320000000002 2024-04-26T12:15:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552413+0000", 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012130395 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552464+0000", 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0574000000000001e-05 2024-04-26T12:15:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552499+0000", 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5264e-05 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51740 5.0 5:03a2d37d:::benchmark_data_smithi069_31227_object51739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.0179597469999999, 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018101987, 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51740 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534260+0000", 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534259+0000", 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534321+0000", 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2378000000000005e-05 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534341+0000", 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9573e-05 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534350+0000", 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537321+0000", 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029708909999999998 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537401+0000", 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0768999999999999e-05 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6599000000000003e-05 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540265+0000", 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027868049999999998 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552278+0000", 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012013239 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552327+0000", 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9438999999999999e-05 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552362+0000", 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4544e-05 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:62440 5.8 5:1aecf3b3:::benchmark_data_smithi069_31227_object62439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.0857556239999999, 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019189951, 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 62440 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466463+0000", 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466537+0000", 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3996000000000001e-05 2024-04-26T12:15:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466545+0000", 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1720000000000007e-06 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466550+0000", 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5600000000000004e-06 2024-04-26T12:15:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473833+0000", 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072829909999999999 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473902+0000", 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9620000000000001e-05 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473982+0000", 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9294000000000003e-05 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.480007+0000", 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060249800000000001 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485579+0000", 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055726509999999996 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485622+0000", 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2141999999999997e-05 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485654+0000", 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2459000000000002e-05 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.49415315599999998, 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64612 5.0 5:09dee88d:::benchmark_data_smithi069_31227_object64611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.25745862600000002, 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019269178000000001, 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64612 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294824+0000", 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3053999999999996e-05 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294830+0000", 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5429999999999999e-06 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294834+0000", 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0810000000000004e-06 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301309+0000", 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006475069 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301419+0000", 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110192 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301507+0000", 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7076000000000005e-05 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308534+0000", 2024-04-26T12:15:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070278809999999997 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313939+0000", 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054041820000000004 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313987+0000", 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8575000000000002e-05 2024-04-26T12:15:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314030+0000", 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3053000000000003e-05 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64620 5.0 5:0c82d98b:::benchmark_data_smithi069_31227_object64619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.25525853500000001, 2024-04-26T12:15:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01923395, 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64620 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297006+0000", 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5843999999999997e-05 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297014+0000", 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3549999999999999e-06 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297019+0000", 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8969999999999999e-06 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308655+0000", 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011636502999999999 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308774+0000", 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011843 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308861+0000", 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7368999999999996e-05 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311398+0000", 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002537526 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316113+0000", 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047143439999999997 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316161+0000", 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7712e-05 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316195+0000", 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4536999999999998e-05 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.25221419699999997, 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:23.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:23.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:23.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:23.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.25170970799999998, 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:23.680 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:23.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:23.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.687 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64629 5.0 5:02f7d0fe:::benchmark_data_smithi069_31227_object64628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.25140057599999999, 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021120738, 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64629 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300912+0000", 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3806000000000003e-05 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300923+0000", 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300930+0000", 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311469+0000", 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010538659000000001 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311584+0000", 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011458700000000001 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014452900000000001 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321119+0000", 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093907230000000001 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321864+0000", 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00074479199999999998 2024-04-26T12:15:23.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321905+0000", 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1192000000000001e-05 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321940+0000", 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5024000000000002e-05 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.694 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64798 5.9 5:961f0b1a:::benchmark_data_smithi069_31227_object64797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.186065384, 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018658523999999999, 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64798 2024-04-26T12:15:23.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366235+0000", 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1206999999999997e-05 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366244+0000", 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3419999999999997e-06 2024-04-26T12:15:23.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366250+0000", 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1750000000000002e-06 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.368907+0000", 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026570209999999999 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.369027+0000", 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119066 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.384720+0000", 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015693291000000002 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.384772+0000", 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1731999999999999e-05 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.384813+0000", 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1229000000000001e-05 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:23.701 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:23.701 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:23.701 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:23.702 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:15:23.703 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:23.704 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:23.700+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:23.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 19 16 65790 65774 216.345 164.188 0.00585362 0.00461969 2024-04-26T12:15:23.803 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:23.800+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:23.825 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:23.826 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:23.826 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:23.844 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:23.844 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:23.847 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:23.847 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:23.863 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:23.863 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:23.875 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:23.919 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:23.918+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:24.005 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:24.003+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:24.027 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:24.027 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:24.041 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:24.125 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:24.124+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:24.206 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:24.205+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:24.233 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:24.233 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:24.246 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:24.308 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:24.306+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:24.389 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:24.390 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:24.402 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:24.409 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:24.407+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:24.509 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:24.508+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:24.588 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:24.588 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:24.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:24.645 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:24.644+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:24.712 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:24.711+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:24.725 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:15:24.741 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:24.742 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:24.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:2024-04-26T12:15:24.752566+0000 min lat: 0.000918112 max lat: 1.01397 avg lat: 0.00467601 2024-04-26T12:15:24.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T12:15:24.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 20 16 68417 68401 213.736 164.188 0.0131101 0.00467601 2024-04-26T12:15:24.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:24.813 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:24.811+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:24.836 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-26T12:15:24.907 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:24.907 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:24.913 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:24.912+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:24.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:24.937 INFO:teuthology.orchestra.console.smithi113:Power on completed 2024-04-26T12:15:25.014 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:25.013+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:25.038 DEBUG:teuthology.orchestra.console.smithi113:Waiting for login prompt 2024-04-26T12:15:25.038 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi113 2024-04-26T12:15:25.072 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:25.072 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:25.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:25.126 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:25.125+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:25.216 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:25.215+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:25.235 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:25.236 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:25.251 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:25.317 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:25.315+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:25.395 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:25.396 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:25.407 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:25.417 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:25.415+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:25.517 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:25.516+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:25.550 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:25.551 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:25.564 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:25.648 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:25.647+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:25.714 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:15:25.719 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:25.718+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:25.751 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:25.751 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:25.752 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 21 16 70928 70912 211.031 156.938 0.00954814 0.00473567 2024-04-26T12:15:25.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:25.821 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:25.819+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:25.848 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:25.918 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:25.918 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:25.922 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:25.921+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:25.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:25.986 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:26.005 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:26.006 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:26.009 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:26.009 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:26.022 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:26.021+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:26.123 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:26.122+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:26.125 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:26.125 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:26.125 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:26.125 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:26.125 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:26.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:26.224 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:26.223+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:52115 5.a 5:5d601bf1:::benchmark_data_smithi069_31227_object52114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.6284671819999996, 2024-04-26T12:15:26.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015623575000000001, 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52115 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666360+0000", 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666359+0000", 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666472+0000", 2024-04-26T12:15:26.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113158 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666483+0000", 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0592e-05 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.666491+0000", 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670239+0000", 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037479000000000002 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670314+0000", 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5463000000000006e-05 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.670385+0000", 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.676032+0000", 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056472600000000003 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681896+0000", 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058638229999999998 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681948+0000", 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2061000000000002e-05 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:18.681983+0000", 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5432000000000002e-05 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.0883981289999998, 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:26.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:26.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.0855731459999998, 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:26.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53593 5.3 5:c1e11dd9:::benchmark_data_smithi069_31227_object53592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.0842854490000002, 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015984143999999999, 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53593 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:26.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210541+0000", 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210562+0000", 2024-04-26T12:15:26.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1222000000000001e-05 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210567+0000", 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5199999999999999e-06 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210570+0000", 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1640000000000001e-06 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217784+0000", 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007214359 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217889+0000", 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105086 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226187+0000", 2024-04-26T12:15:26.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082971880000000005 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226261+0000", 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4091999999999995e-05 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226526+0000", 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026496499999999998 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62508 5.a 5:5ae92930:::benchmark_data_smithi069_31227_object62507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7995820350000002, 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016616539, 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62508 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495244+0000", 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495330+0000", 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6191000000000002e-05 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495342+0000", 2024-04-26T12:15:26.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495349+0000", 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9619999999999996e-06 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502562+0000", 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072129940000000003 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502674+0000", 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112186 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502815+0000", 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014114999999999999 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.504979+0000", 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002163828 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511812+0000", 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068327220000000003 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511841+0000", 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9793000000000001e-05 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511862+0000", 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0054000000000001e-05 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62774 5.a 5:54f6c8b5:::benchmark_data_smithi069_31227_object62773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6972187910000001, 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015716633000000001, 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62774 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597608+0000", 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597687+0000", 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.894e-05 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597697+0000", 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0834e-05 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597707+0000", 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8349999999999999e-06 2024-04-26T12:15:26.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.602517+0000", 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048097460000000002 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.602587+0000", 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0557999999999998e-05 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.602696+0000", 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108509 2024-04-26T12:15:26.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.607174+0000", 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044781430000000004 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613249+0000", 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060746849999999998 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613290+0000", 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1477999999999998e-05 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613325+0000", 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4538e-05 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62775 5.a 5:50b9397d:::benchmark_data_smithi069_31227_object62774:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.597913+0000", 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6969140970000001, 2024-04-26T12:15:26.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015483640999999999, 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62775 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597913+0000", 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597913+0000", 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597912+0000", 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.597995+0000", 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2526000000000002e-05 2024-04-26T12:15:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.598004+0000", 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2830000000000007e-06 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.598010+0000", 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7350000000000001e-06 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.604353+0000", 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063433819999999998 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.604482+0000", 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012896699999999999 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.604608+0000", 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126344 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.607202+0000", 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025936449999999999 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613333+0000", 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061308480000000004 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613367+0000", 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4422999999999999e-05 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.613397+0000", 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9339000000000001e-05 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63241 5.2 5:46cc3d96:::benchmark_data_smithi069_31227_object63240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.509610935, 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016524549999999999, 2024-04-26T12:15:26.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63241 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785290+0000", 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4809999999999997e-05 2024-04-26T12:15:26.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785301+0000", 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0735e-05 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785307+0000", 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788592+0000", 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032850589999999999 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788711+0000", 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011880200000000001 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801600+0000", 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012888599000000001 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801671+0000", 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1507000000000005e-05 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801741+0000", 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9256000000000002e-05 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63242 5.2 5:4911c375:::benchmark_data_smithi069_31227_object63241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.509462391, 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016514994000000002, 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63242 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785364+0000", 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785421+0000", 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785427+0000", 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7470000000000002e-06 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785430+0000", 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790741+0000", 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053110060000000001 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790864+0000", 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122192 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801750+0000", 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010886132999999999 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801811+0000", 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1736000000000007e-05 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801880+0000", 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8195999999999996e-05 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63246 5.2 5:47433149:::benchmark_data_smithi069_31227_object63245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.786495+0000", 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.50833211, 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503283, 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63246 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786495+0000", 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786495+0000", 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786494+0000", 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786582+0000", 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8065000000000005e-05 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786592+0000", 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8970000000000003e-06 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.786597+0000", 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5390000000000001e-06 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.792955+0000", 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006358196 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.793121+0000", 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000166222 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801889+0000", 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087673990000000004 2024-04-26T12:15:26.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801931+0000", 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2509000000000002e-05 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801998+0000", 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.711e-05 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.352 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63574 5.c 5:3fc33bb1:::benchmark_data_smithi069_31227_object63573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.914169+0000", 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.3806579139999999, 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015942899, 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63574 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914169+0000", 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914169+0000", 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914168+0000", 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914236+0000", 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7663999999999995e-05 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914246+0000", 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0006e-05 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914252+0000", 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.918000+0000", 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003747411 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.918149+0000", 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014882900000000001 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.929965+0000", 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011816617999999999 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.930024+0000", 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9202e-05 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.930112+0000", 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7533000000000004e-05 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63576 5.c 5:376b4ed2:::benchmark_data_smithi069_31227_object63575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.914873+0000", 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.3799544130000001, 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015568284999999999, 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914873+0000", 2024-04-26T12:15:26.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914873+0000", 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914872+0000", 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914949+0000", 2024-04-26T12:15:26.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7189999999999998e-05 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914959+0000", 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5510000000000005e-06 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.914965+0000", 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8340000000000001e-06 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.920296+0000", 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053309730000000001 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.920612+0000", 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000315099 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.930142+0000", 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095300569999999998 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.930347+0000", 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020579499999999999 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.930441+0000", 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3468999999999996e-05 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.362 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5930650530000001, 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:26.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:26.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65664 5.a 5:50c3b5a0:::benchmark_data_smithi069_31227_object65663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:26.368 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5909647319999998, 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015955363, 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65664 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703902+0000", 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0852000000000001e-05 2024-04-26T12:15:26.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703912+0000", 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1900000000000001e-06 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703918+0000", 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.705843+0000", 2024-04-26T12:15:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019248309999999999 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.706010+0000", 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000166386 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.706383+0000", 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000373543 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708847+0000", 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024639950000000001 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719701+0000", 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010853834 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719784+0000", 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3455000000000006e-05 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719818+0000", 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3281000000000002e-05 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.550335107, 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:26.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:71627 5.c 5:340fc5a4:::benchmark_data_smithi069_31227_object71626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:26.379 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.28091339900000001, 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016704157000000001, 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 71627 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:26.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013913+0000", 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013971+0000", 2024-04-26T12:15:26.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8498000000000001e-05 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013997+0000", 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5945e-05 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.014004+0000", 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021720+0000", 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077157399999999996 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021830+0000", 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110135 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030482+0000", 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086519070000000003 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030540+0000", 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7843999999999997e-05 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030618+0000", 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7930999999999996e-05 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72168 5.c 5:3a3f218e:::benchmark_data_smithi069_31227_object72167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.063965086000000004, 2024-04-26T12:15:26.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016793069000000001, 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72168 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230861+0000", 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230969+0000", 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107705 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230980+0000", 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1221e-05 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230988+0000", 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235726+0000", 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047381380000000002 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235808+0000", 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1499e-05 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247498+0000", 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011690459 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247583+0000", 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5167000000000006e-05 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247655+0000", 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1596999999999999e-05 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72169 5.c 5:32a9709f:::benchmark_data_smithi069_31227_object72168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.063830667999999993, 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016774866999999999, 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72169 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231031+0000", 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5289e-05 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231039+0000", 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3059999999999998e-06 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231050+0000", 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237587+0000", 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006536338 2024-04-26T12:15:26.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237748+0000", 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016125100000000001 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247665+0000", 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009917136 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247710+0000", 2024-04-26T12:15:26.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641999999999997e-05 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247771+0000", 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1616000000000001e-05 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:26.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.061558089000000003, 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:26.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:26.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:26.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.060828379000000002, 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:26.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:26.404 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:26.406 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:26.406 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:26.404+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:26.506 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:26.505+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:26.554 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:26.554 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:72988 5.b e26/16)", 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.552567+0000", 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000153268, 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000170841, 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552567+0000", 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552567+0000", 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552567+0000", 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552569+0000", 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552574+0000", 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552578+0000", 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.053e-06 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72986 5.b 5:dd3cac1b:::benchmark_data_smithi069_31227_object72985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.547294+0000", 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0054260339999999997, 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055006550000000001, 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72986 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547294+0000", 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547294+0000", 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547293+0000", 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547362+0000", 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8994999999999999e-05 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547372+0000", 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4590000000000004e-06 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547380+0000", 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7710000000000006e-06 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547423+0000", 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3720000000000002e-05 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547546+0000", 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012291299999999999 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:26.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547625+0000", 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8768000000000002e-05 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551141+0000", 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035159509999999998 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72988 5.b 5:dbd6729d:::benchmark_data_smithi069_31227_object72987:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.562 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.547457+0000", 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052632199999999999, 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054571510000000004, 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72988 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547457+0000", 2024-04-26T12:15:26.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547457+0000", 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547456+0000", 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547489+0000", 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2607999999999997e-05 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547496+0000", 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3599999999999998e-06 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.547501+0000", 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9679999999999997e-06 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549253+0000", 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017514290000000001 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549363+0000", 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110567 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549503+0000", 2024-04-26T12:15:26.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013947699999999999 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72991 5.d 5:b252e6f8:::benchmark_data_smithi069_31227_object72990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.548905+0000", 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0038150010000000002, 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040898499999999999, 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72991 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.548905+0000", 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.548905+0000", 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.548904+0000", 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.548972+0000", 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8317000000000003e-05 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.548985+0000", 2024-04-26T12:15:26.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2471e-05 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.548991+0000", 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549035+0000", 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3316999999999999e-05 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549127+0000", 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2755000000000002e-05 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72992 5.d 5:bdb01ea6:::benchmark_data_smithi069_31227_object72991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.549003+0000", 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00371704, 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040500110000000001, 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:26.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72992 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549003+0000", 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549003+0000", 2024-04-26T12:15:26.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549003+0000", 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549035+0000", 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2394999999999997e-05 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549042+0000", 2024-04-26T12:15:26.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1550000000000001e-06 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549047+0000", 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8389999999999997e-06 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551467+0000", 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024196450000000002 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551575+0000", 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108317 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72994 5.d 5.50102e6d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.549225+0000", 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034951719999999999, 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038761619999999998, 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72994 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549225+0000", 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549225+0000", 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549224+0000", 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549288+0000", 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4051000000000001e-05 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549296+0000", 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1640000000000001e-06 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549304+0000", 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4109999999999999e-06 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.578 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72995 5.d 5.7f2610bd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.549467+0000", 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003253223, 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036684040000000001, 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72995 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549467+0000", 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549467+0000", 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549466+0000", 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549540+0000", 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3394999999999998e-05 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549546+0000", 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3319999999999997e-06 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.549550+0000", 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.048e-06 2024-04-26T12:15:26.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72996 5.4 5:26a91150:::benchmark_data_smithi069_31227_object72995:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.550375+0000", 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0023452809999999998, 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027947710000000001, 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72996 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550375+0000", 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550375+0000", 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550374+0000", 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550534+0000", 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015948899999999999 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550544+0000", 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0451999999999999e-05 2024-04-26T12:15:26.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550552+0000", 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6550000000000004e-06 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550723+0000", 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017110699999999999 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550851+0000", 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012792899999999999 2024-04-26T12:15:26.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550996+0000", 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014513500000000001 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72998 5.f 5:f3538aed:::benchmark_data_smithi069_31227_object72997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.550703+0000", 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020172739999999999, 2024-04-26T12:15:26.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002539337, 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72998 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550703+0000", 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550703+0000", 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550702+0000", 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550827+0000", 2024-04-26T12:15:26.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012466800000000001 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550840+0000", 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3032e-05 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550845+0000", 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7709999999999997e-06 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550890+0000", 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5689999999999998e-05 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551036+0000", 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014565499999999999 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:72999 5.0 5:0bdcafa7:::benchmark_data_smithi069_31227_object72998:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.590 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.550853+0000", 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018673780000000001, 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024558499999999999, 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 72999 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550853+0000", 2024-04-26T12:15:26.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550853+0000", 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550852+0000", 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550881+0000", 2024-04-26T12:15:26.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8158999999999999e-05 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550886+0000", 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.75e-06 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550890+0000", 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1970000000000001e-06 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550921+0000", 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1445000000000001e-05 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551020+0000", 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9364000000000006e-05 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551099+0000", 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8308999999999999e-05 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.594 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:73000 5.0 5:07df89eb:::benchmark_data_smithi069_31227_object72999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.550897+0000", 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001823524, 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024892579999999998, 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 73000 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550897+0000", 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550897+0000", 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550896+0000", 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550935+0000", 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8840000000000001e-05 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550942+0000", 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.092e-06 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.550948+0000", 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:15:26.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.553202+0000", 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022542880000000001 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.553338+0000", 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013570100000000001 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:73002 5.f 5:f8be18f2:::benchmark_data_smithi069_31227_object73001:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.551288+0000", 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001432656, 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021652820000000001, 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 73002 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551288+0000", 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551288+0000", 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551287+0000", 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551386+0000", 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9264000000000004e-05 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551397+0000", 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1511999999999999e-05 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551404+0000", 2024-04-26T12:15:26.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3119999999999999e-06 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.553058+0000", 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016543319999999999 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.553231+0000", 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017331399999999999 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:73003 5.b 5:d83dd7be:::benchmark_data_smithi069_31227_object73002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.551413+0000", 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001307592, 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021092379999999998, 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 73003 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551413+0000", 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551413+0000", 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551412+0000", 2024-04-26T12:15:26.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551444+0000", 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.184e-05 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551451+0000", 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551455+0000", 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.78e-06 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551504+0000", 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8196999999999999e-05 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551650+0000", 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014646 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.551820+0000", 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169918 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:72986 5.b e26/16)", 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.552534+0000", 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00018590800000000001, 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010541280000000001, 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:26.607 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552534+0000", 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552534+0000", 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:26.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552533+0000", 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552543+0000", 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.363e-06 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552551+0000", 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6470000000000004e-06 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:26.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.552557+0000", 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7270000000000004e-06 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 14 2024-04-26T12:15:26.610 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:26.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-26T12:15:26.612 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:26.610+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:26.612 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:26.711 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:15:26.712 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:26.710+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:26.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 22 16 73536 73520 208.847 163 0.00300363 0.00478524 2024-04-26T12:15:26.799 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:26.799 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:26.799 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:26.799 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:26.799 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:26.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:26.812 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:26.811+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:26.913 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:26.911+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:27.001 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.474613185000001, 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.474524341, 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:27.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:27.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.013 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.348930481, 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:27.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:27.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.346484372000001, 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.345904334, 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.025 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:27.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:50476 5.4 5:2c6eadac:::benchmark_data_smithi069_31227_object50475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.898217678, 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018700795999999999, 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 50476 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100181+0000", 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100180+0000", 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100214+0000", 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3896000000000002e-05 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100221+0000", 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.100227+0000", 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6459999999999998e-06 2024-04-26T12:15:27.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106611+0000", 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063837039999999996 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106726+0000", 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115661 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.106855+0000", 2024-04-26T12:15:27.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128186 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.109133+0000", 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022781670000000002 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118804+0000", 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0096710839999999999 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118844+0000", 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0405999999999999e-05 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.118881+0000", 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7150999999999997e-05 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51736 5.8 5:17ffc05c:::benchmark_data_smithi069_31227_object51735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:27.036 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4652463910000009, 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019106003, 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51736 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:27.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533152+0000", 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533151+0000", 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533182+0000", 2024-04-26T12:15:27.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0991999999999997e-05 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533191+0000", 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533197+0000", 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4479999999999999e-06 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534047+0000", 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085020199999999999 2024-04-26T12:15:27.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534122+0000", 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4904e-05 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.534247+0000", 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125241 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537303+0000", 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030558360000000001 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552160+0000", 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014856362999999999 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552217+0000", 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7754000000000003e-05 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552258+0000", 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0614000000000001e-05 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51738 5.8 5:10901916:::benchmark_data_smithi069_31227_object51737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4650141029999997, 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019114662000000001, 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51738 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533505+0000", 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012143500000000001 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533516+0000", 2024-04-26T12:15:27.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1031e-05 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533523+0000", 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537326+0000", 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038034509999999998 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537402+0000", 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5873999999999999e-05 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5947999999999999e-05 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540283+0000", 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028045320000000002 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552413+0000", 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012130395 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552464+0000", 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0574000000000001e-05 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552499+0000", 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5264e-05 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:62440 5.8 5:1aecf3b3:::benchmark_data_smithi069_31227_object62439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.5319342259999997, 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019189951, 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 62440 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466463+0000", 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466537+0000", 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3996000000000001e-05 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466545+0000", 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1720000000000007e-06 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466550+0000", 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5600000000000004e-06 2024-04-26T12:15:27.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473833+0000", 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072829909999999999 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473902+0000", 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9620000000000001e-05 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473982+0000", 2024-04-26T12:15:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9294000000000003e-05 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.480007+0000", 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060249800000000001 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485579+0000", 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055726509999999996 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485622+0000", 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2141999999999997e-05 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485654+0000", 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2459000000000002e-05 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:27.053 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.9403317580000001, 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:27.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.058 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64612 5.0 5:09dee88d:::benchmark_data_smithi069_31227_object64611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.7036372279999998, 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019269178000000001, 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64612 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294824+0000", 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3053999999999996e-05 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294830+0000", 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5429999999999999e-06 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294834+0000", 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0810000000000004e-06 2024-04-26T12:15:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301309+0000", 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006475069 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301419+0000", 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110192 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301507+0000", 2024-04-26T12:15:27.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7076000000000005e-05 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308534+0000", 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070278809999999997 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313939+0000", 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054041820000000004 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313987+0000", 2024-04-26T12:15:27.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8575000000000002e-05 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314030+0000", 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3053000000000003e-05 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64620 5.0 5:0c82d98b:::benchmark_data_smithi069_31227_object64619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.7014371370000001, 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01923395, 2024-04-26T12:15:27.064 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64620 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297006+0000", 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5843999999999997e-05 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297014+0000", 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3549999999999999e-06 2024-04-26T12:15:27.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297019+0000", 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8969999999999999e-06 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308655+0000", 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011636502999999999 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308774+0000", 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011843 2024-04-26T12:15:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308861+0000", 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7368999999999996e-05 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311398+0000", 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002537526 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316113+0000", 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047143439999999997 2024-04-26T12:15:27.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316161+0000", 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7712e-05 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316195+0000", 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4536999999999998e-05 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.069 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6983927990000001, 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:27.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:27.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.075 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6978883099999997, 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:27.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:27.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64629 5.0 5:02f7d0fe:::benchmark_data_smithi069_31227_object64628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.081 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6975791779999998, 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021120738, 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64629 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:27.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300912+0000", 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3806000000000003e-05 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300923+0000", 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300930+0000", 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311469+0000", 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010538659000000001 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311584+0000", 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011458700000000001 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014452900000000001 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321119+0000", 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093907230000000001 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321864+0000", 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00074479199999999998 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321905+0000", 2024-04-26T12:15:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1192000000000001e-05 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321940+0000", 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5024000000000002e-05 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64798 5.9 5:961f0b1a:::benchmark_data_smithi069_31227_object64797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6322439859999998, 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.018658523999999999, 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64798 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366154+0000", 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366235+0000", 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1206999999999997e-05 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366244+0000", 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3419999999999997e-06 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.366250+0000", 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1750000000000002e-06 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.368907+0000", 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026570209999999999 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.369027+0000", 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119066 2024-04-26T12:15:27.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.384720+0000", 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015693291000000002 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.384772+0000", 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1731999999999999e-05 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.384813+0000", 2024-04-26T12:15:27.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1229000000000001e-05 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71822 5.4 5:20b40e6f:::benchmark_data_smithi069_31227_object71821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.909557222, 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020733079000000001, 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71822 2024-04-26T12:15:27.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088907+0000", 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6464000000000006e-05 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088912+0000", 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7299999999999996e-06 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088916+0000", 2024-04-26T12:15:27.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0790000000000002e-06 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097755+0000", 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008839286 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097869+0000", 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011418500000000001 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.098014+0000", 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014409700000000001 2024-04-26T12:15:27.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109464+0000", 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011450431 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109504+0000", 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0439999999999999e-05 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109537+0000", 2024-04-26T12:15:27.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2147000000000002e-05 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109574+0000", 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7540999999999999e-05 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71825 5.4 5:2c7e5216:::benchmark_data_smithi069_31227_object71824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.90940560000000004, 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020667386999999999, 2024-04-26T12:15:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71825 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088992+0000", 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089039+0000", 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6616000000000002e-05 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089044+0000", 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7400000000000004e-06 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089047+0000", 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099399+0000", 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010351931 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099490+0000", 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1699000000000004e-05 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099596+0000", 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106051 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109607+0000", 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010010544999999999 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109612+0000", 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109639+0000", 2024-04-26T12:15:27.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6974e-05 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109660+0000", 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1109999999999999e-05 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.90689666800000002, 2024-04-26T12:15:27.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:27.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71833 5.4 5:2835a1f7:::benchmark_data_smithi069_31227_object71832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.90496039399999995, 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019580810000000001, 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71833 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093437+0000", 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093543+0000", 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010636 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093556+0000", 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2203e-05 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093563+0000", 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5660000000000001e-06 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106409+0000", 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012845663 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106527+0000", 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011846200000000001 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106611+0000", 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3460000000000004e-05 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112920+0000", 2024-04-26T12:15:27.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063096740000000004 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112935+0000", 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4729000000000001e-05 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112986+0000", 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0796e-05 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:27.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.113019+0000", 2024-04-26T12:15:27.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.277e-05 2024-04-26T12:15:27.114 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.114 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.114 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.114 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.114 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.114 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:27.115 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:27.114+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:27.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:27.216 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:27.214+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:27.272 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:27.272 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74883 5.7 5:e0df1066:::benchmark_data_smithi069_31227_object74882:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.265415+0000", 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0051378170000000003, 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051641589999999998, 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74883 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265415+0000", 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265415+0000", 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265414+0000", 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265440+0000", 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5694000000000002e-05 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265446+0000", 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0480000000000004e-06 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265450+0000", 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3780000000000003e-06 2024-04-26T12:15:27.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267435+0000", 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019840579999999999 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267549+0000", 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114565 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:74880 5.b e27/16 5:d25f9762:::benchmark_data_smithi069_31227_object74879:head v 27'4681, mlcod=27'4679)", 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.265600+0000", 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0049531619999999997, 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050470369999999999, 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265600+0000", 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265600+0000", 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265599+0000", 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265679+0000", 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9924000000000003e-05 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265688+0000", 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999998e-06 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265693+0000", 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5799999999999999e-06 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266276+0000", 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058266700000000004 2024-04-26T12:15:27.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266293+0000", 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7207e-05 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74884 5.2 5:4963506d:::benchmark_data_smithi069_31227_object74883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.265795+0000", 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0047573659999999999, 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049125569999999997, 2024-04-26T12:15:27.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74884 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265795+0000", 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265795+0000", 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265787+0000", 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999914 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265890+0000", 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103064 2024-04-26T12:15:27.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265898+0000", 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265902+0000", 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268024+0000", 2024-04-26T12:15:27.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021220900000000001 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268165+0000", 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014085899999999999 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:74885 5.e e27/16 5:7a631441:::benchmark_data_smithi069_31227_object74884:head v 27'4724, mlcod=27'4722)", 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.266297+0000", 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0042553770000000003, 2024-04-26T12:15:27.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004470155, 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266297+0000", 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266297+0000", 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266297+0000", 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266380+0000", 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.284e-05 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266387+0000", 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.17e-06 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266391+0000", 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.617e-06 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266422+0000", 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0818999999999997e-05 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266441+0000", 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8331000000000001e-05 2024-04-26T12:15:27.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74887 5.c 5:3f195be2:::benchmark_data_smithi069_31227_object74886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.267824+0000", 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027285450000000002, 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030000769999999999, 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74887 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267824+0000", 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267824+0000", 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267823+0000", 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267850+0000", 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7032000000000001e-05 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267864+0000", 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3502e-05 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.267876+0000", 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2447e-05 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269360+0000", 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483414 2024-04-26T12:15:27.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269494+0000", 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013494200000000001 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74888 5.1 5:8e6bcb50:::benchmark_data_smithi069_31227_object74887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.268167+0000", 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0023859250000000001, 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00272317, 2024-04-26T12:15:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74888 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268167+0000", 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268167+0000", 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268166+0000", 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268242+0000", 2024-04-26T12:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6296000000000003e-05 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268252+0000", 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5899999999999997e-06 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268271+0000", 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9216999999999999e-05 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268339+0000", 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7957e-05 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268453+0000", 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114239 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74889 5.3 5:ce63395b:::benchmark_data_smithi069_31227_object74888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.268283+0000", 2024-04-26T12:15:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022694270000000001, 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026725780000000001, 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74889 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268283+0000", 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268283+0000", 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268283+0000", 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268342+0000", 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9713000000000002e-05 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268351+0000", 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268358+0000", 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3010000000000003e-06 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268401+0000", 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3068000000000002e-05 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268545+0000", 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014388899999999999 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:74886 5.e e27/16 5:70f5f48c:::benchmark_data_smithi069_31227_object74885:head v 27'4725, mlcod=27'4722)", 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.268348+0000", 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022047910000000002, 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026680940000000002, 2024-04-26T12:15:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268348+0000", 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268348+0000", 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268347+0000", 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268375+0000", 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8231000000000001e-05 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268384+0000", 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-04-26T12:15:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268391+0000", 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6120000000000004e-06 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268579+0000", 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018778100000000001 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.268597+0000", 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8261e-05 2024-04-26T12:15:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74890 5.5 5:a7837c01:::benchmark_data_smithi069_31227_object74889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.269666+0000", 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00088632100000000003, 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001405353, 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74890 2024-04-26T12:15:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269666+0000", 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269666+0000", 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269665+0000", 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269731+0000", 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5172000000000006e-05 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269743+0000", 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2512e-05 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269751+0000", 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1419999999999993e-06 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269797+0000", 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5583e-05 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.269924+0000", 2024-04-26T12:15:27.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127148 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:74891 5.8 e27/16 5:1080b3bc:::benchmark_data_smithi069_31227_object74890:head v 27'4689, mlcod=27'4687)", 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.270899+0000", 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9996538, 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023101900000000001, 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.308 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.270899+0000", 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.270899+0000", 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.270898+0000", 2024-04-26T12:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.270978+0000", 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0524000000000004e-05 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.270987+0000", 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8880000000000003e-06 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.270993+0000", 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1430000000000003e-06 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.271045+0000", 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1218999999999999e-05 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.271064+0000", 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9284999999999999e-05 2024-04-26T12:15:27.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74872 5.c 5:37e51aad:::benchmark_data_smithi069_31227_object74871:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.261866+0000", 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0086869289999999995, 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093206299999999999, 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74872 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.261866+0000", 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.261866+0000", 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.261865+0000", 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.261935+0000", 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9416000000000001e-05 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.261940+0000", 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6409999999999999e-06 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.261950+0000", 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0071000000000001e-05 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.261983+0000", 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2492e-05 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.262081+0000", 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7802999999999999e-05 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:74871 5.4 e27/16 5:2b64373b:::benchmark_data_smithi069_31227_object74870:head v 27'4695, mlcod=27'4691)", 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.263809+0000", 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.006744094, 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074414679999999997, 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.263809+0000", 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.263809+0000", 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.263808+0000", 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.263891+0000", 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2732999999999995e-05 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.263911+0000", 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0208e-05 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.263917+0000", 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.392e-06 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264072+0000", 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154528 2024-04-26T12:15:27.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264091+0000", 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9235000000000001e-05 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74877 5.c 5:3e895873:::benchmark_data_smithi069_31227_object74876:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.264274+0000", 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0062789279999999996, 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070399429999999999, 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74877 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264274+0000", 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264274+0000", 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264273+0000", 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264319+0000", 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6211000000000002e-05 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264332+0000", 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2819999999999999e-05 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264338+0000", 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2169999999999999e-06 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264425+0000", 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6546999999999997e-05 2024-04-26T12:15:27.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.264573+0000", 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014815 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:74882 5.c 5:369e6cbe:::benchmark_data_smithi069_31227_object74881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.265355+0000", 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.005198004, 2024-04-26T12:15:27.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060288590000000001, 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74882 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265355+0000", 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265355+0000", 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265354+0000", 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265397+0000", 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3328000000000003e-05 2024-04-26T12:15:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265405+0000", 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.187e-06 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.265410+0000", 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4410000000000001e-06 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266571+0000", 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011609210000000001 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.266699+0000", 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012773 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 14 2024-04-26T12:15:27.327 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:27.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:27.329 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:27.327+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:27.429 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:27.428+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:27.518 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:27.518 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:27.530 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:27.529+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:27.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:27.631 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:27.630+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5175079609999997, 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5146829779999997, 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:27.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53593 5.3 5:c1e11dd9:::benchmark_data_smithi069_31227_object53592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:27.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5133952809999993, 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015984143999999999, 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53593 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210542+0000", 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210541+0000", 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210562+0000", 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1222000000000001e-05 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210567+0000", 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5199999999999999e-06 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.210570+0000", 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1640000000000001e-06 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217784+0000", 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007214359 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.217889+0000", 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105086 2024-04-26T12:15:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226187+0000", 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082971880000000005 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226261+0000", 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4091999999999995e-05 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226526+0000", 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026496499999999998 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62508 5.a 5:5ae92930:::benchmark_data_smithi069_31227_object62507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2286918670000002, 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016616539, 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62508 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495244+0000", 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495330+0000", 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6191000000000002e-05 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495342+0000", 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495349+0000", 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9619999999999996e-06 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502562+0000", 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072129940000000003 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502674+0000", 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112186 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502815+0000", 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014114999999999999 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.504979+0000", 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002163828 2024-04-26T12:15:27.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511812+0000", 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068327220000000003 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511841+0000", 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9793000000000001e-05 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511862+0000", 2024-04-26T12:15:27.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0054000000000001e-05 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63241 5.2 5:46cc3d96:::benchmark_data_smithi069_31227_object63240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9387207669999995, 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016524549999999999, 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63241 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785290+0000", 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4809999999999997e-05 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785301+0000", 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0735e-05 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785307+0000", 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788592+0000", 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032850589999999999 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788711+0000", 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011880200000000001 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801600+0000", 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012888599000000001 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801671+0000", 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1507000000000005e-05 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801741+0000", 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9256000000000002e-05 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63242 5.2 5:4911c375:::benchmark_data_smithi069_31227_object63241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9385722229999995, 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016514994000000002, 2024-04-26T12:15:27.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63242 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785364+0000", 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785421+0000", 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785427+0000", 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7470000000000002e-06 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785430+0000", 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790741+0000", 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053110060000000001 2024-04-26T12:15:27.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790864+0000", 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122192 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801750+0000", 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010886132999999999 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801811+0000", 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1736000000000007e-05 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801880+0000", 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8195999999999996e-05 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:27.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0221748850000001, 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65664 5.a 5:50c3b5a0:::benchmark_data_smithi069_31227_object65663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0200745639999997, 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015955363, 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65664 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703862+0000", 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703902+0000", 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0852000000000001e-05 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703912+0000", 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1900000000000001e-06 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703918+0000", 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.705843+0000", 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019248309999999999 2024-04-26T12:15:27.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.706010+0000", 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000166386 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.706383+0000", 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000373543 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708847+0000", 2024-04-26T12:15:27.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024639950000000001 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719701+0000", 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010853834 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719784+0000", 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3455000000000006e-05 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719818+0000", 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3281000000000002e-05 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.979444939, 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:27.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:71627 5.c 5:340fc5a4:::benchmark_data_smithi069_31227_object71626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7100232310000001, 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016704157000000001, 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 71627 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013913+0000", 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013971+0000", 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8498000000000001e-05 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013997+0000", 2024-04-26T12:15:27.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5945e-05 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.014004+0000", 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021720+0000", 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077157399999999996 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021830+0000", 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110135 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030482+0000", 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086519070000000003 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030540+0000", 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7843999999999997e-05 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030618+0000", 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7930999999999996e-05 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72168 5.c 5:3a3f218e:::benchmark_data_smithi069_31227_object72167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.493074918, 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016793069000000001, 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72168 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230861+0000", 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230969+0000", 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107705 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230980+0000", 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1221e-05 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230988+0000", 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235726+0000", 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047381380000000002 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235808+0000", 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1499e-05 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247498+0000", 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011690459 2024-04-26T12:15:27.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247583+0000", 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5167000000000006e-05 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247655+0000", 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1596999999999999e-05 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72169 5.c 5:32a9709f:::benchmark_data_smithi069_31227_object72168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4929405, 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016774866999999999, 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72169 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231031+0000", 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5289e-05 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231039+0000", 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3059999999999998e-06 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231050+0000", 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-04-26T12:15:27.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237587+0000", 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006536338 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237748+0000", 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016125100000000001 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247665+0000", 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009917136 2024-04-26T12:15:27.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247710+0000", 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641999999999997e-05 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247771+0000", 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1616000000000001e-05 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.490667921, 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:27.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4899382110000001, 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:27.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:27.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75217 5.a 5:50e5b023:::benchmark_data_smithi069_31227_object75216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.386985+0000", 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.336952007, 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016162276999999999, 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75217 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.386985+0000", 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.386985+0000", 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.386984+0000", 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387091+0000", 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106829 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387100+0000", 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5840000000000001e-06 2024-04-26T12:15:27.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387110+0000", 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.392087+0000", 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049773430000000004 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.392199+0000", 2024-04-26T12:15:27.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112104 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.392340+0000", 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000140228 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400210+0000", 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078702560000000008 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.403075+0000", 2024-04-26T12:15:27.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028654689999999998 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.403128+0000", 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.223e-05 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.403147+0000", 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9551999999999998e-05 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.33682004799999998, 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.33339162700000002, 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:27.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25713069500000002, 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:27.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:27.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.256997849, 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.22659415399999999, 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:27.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:27.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:27.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:27.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:27.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:27.835 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:27.836 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 23 16 76122 76106 206.793 161.625 0.00359586 0.00483283 2024-04-26T12:15:27.837 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:27.837 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:27.835+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:27.937 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:27.936+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:27.981 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.981 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:76706 5.e 5:7ecc479f:::benchmark_data_smithi069_31227_object76705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.975173+0000", 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048585340000000003, 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048852549999999998, 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76706 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975173+0000", 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975173+0000", 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975173+0000", 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975249+0000", 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6249999999999997e-05 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975257+0000", 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.272e-06 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975261+0000", 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7960000000000003e-06 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977120+0000", 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018584700000000001 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977258+0000", 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013797200000000001 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977390+0000", 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132001 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:76700 5.a e27/16 5:58f95e90:::benchmark_data_smithi069_31227_object76699:head v 27'4791, mlcod=27'4788)", 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.975804+0000", 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042277779999999997, 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043374210000000002, 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975804+0000", 2024-04-26T12:15:27.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975804+0000", 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975804+0000", 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975881+0000", 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6872000000000005e-05 2024-04-26T12:15:27.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975888+0000", 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.515e-06 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975892+0000", 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6119999999999999e-06 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975932+0000", 2024-04-26T12:15:27.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0462e-05 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.975954+0000", 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1611e-05 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:76710 5.d 5:bc575b6b:::benchmark_data_smithi069_31227_object76709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.977459+0000", 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025729170000000001, 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027457290000000001, 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.989 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76710 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977459+0000", 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977459+0000", 2024-04-26T12:15:27.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977458+0000", 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977537+0000", 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8335000000000001e-05 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977545+0000", 2024-04-26T12:15:27.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8040000000000007e-06 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977551+0000", 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5799999999999999e-06 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977580+0000", 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8861999999999999e-05 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977657+0000", 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7066999999999999e-05 2024-04-26T12:15:27.992 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:76707 5.a e27/16 5:502f7f75:::benchmark_data_smithi069_31227_object76706:head v 27'4792, mlcod=27'4789)", 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.977962+0000", 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020699680000000002, 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023053629999999999, 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977962+0000", 2024-04-26T12:15:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977962+0000", 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.977962+0000", 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.978039+0000", 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7575000000000002e-05 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.978047+0000", 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4080000000000001e-06 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.978051+0000", 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.978089+0000", 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8794000000000002e-05 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.978109+0000", 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9950999999999999e-05 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:76714 5.e 5:7a682e2f:::benchmark_data_smithi069_31227_object76713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.979764+0000", 2024-04-26T12:15:27.996 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00026789899999999999, 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00057139500000000004, 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76714 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979764+0000", 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979764+0000", 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979763+0000", 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979826+0000", 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.321e-05 2024-04-26T12:15:27.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979839+0000", 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.242e-05 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979845+0000", 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1789999999999996e-06 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979876+0000", 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1550000000000001e-05 2024-04-26T12:15:27.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979991+0000", 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011408699999999999 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980301+0000", 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000310224 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:76715 5.4 5:293f6de4:::benchmark_data_smithi069_31227_object76714:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:28.000 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.979852+0000", 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00018018400000000001, 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00057007599999999998, 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76715 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979852+0000", 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979852+0000", 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979851+0000", 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979911+0000", 2024-04-26T12:15:28.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9500000000000003e-05 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979917+0000", 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.302e-06 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979921+0000", 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9589999999999997e-06 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:28.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979959+0000", 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7534999999999999e-05 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980086+0000", 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012756700000000001 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980238+0000", 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000152206 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:76709 5.a e27/16 5:500b7565:::benchmark_data_smithi069_31227_object76708:head v 27'4793, mlcod=27'4789)", 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.979812+0000", 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000220208, 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00067380999999999995, 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979812+0000", 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979812+0000", 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979811+0000", 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979948+0000", 2024-04-26T12:15:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136422 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979958+0000", 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0604999999999999e-05 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979963+0000", 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8130000000000003e-06 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980002+0000", 2024-04-26T12:15:28.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9085000000000003e-05 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980020+0000", 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7305000000000001e-05 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:76706 5.e e27/16)", 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.979977+0000", 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.4617999999999998e-05, 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000578643, 2024-04-26T12:15:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979977+0000", 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979977+0000", 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979977+0000", 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979979+0000", 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9319999999999999e-06 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979983+0000", 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0770000000000001e-06 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.979986+0000", 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8540000000000001e-06 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:76717 5.9 5:9f53f49c:::benchmark_data_smithi069_31227_object76716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.980330+0000", 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997025, 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027406300000000001, 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:28.011 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76717 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980330+0000", 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980330+0000", 2024-04-26T12:15:28.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980329+0000", 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980445+0000", 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011628 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980455+0000", 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3340000000000008e-06 2024-04-26T12:15:28.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980463+0000", 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0479999999999999e-06 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980512+0000", 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9508000000000001e-05 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:76718 5.d 5.6f8a2a5d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.980478+0000", 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995537, 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017965900000000001, 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76718 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:28.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980478+0000", 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980478+0000", 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980478+0000", 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:28.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980518+0000", 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9777999999999998e-05 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980525+0000", 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3440000000000003e-06 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980531+0000", 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7960000000000001e-06 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:76720 5.0 5.e3efda30 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.980543+0000", 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9994893, 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016250100000000001, 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 76720 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980543+0000", 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980543+0000", 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980542+0000", 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:28.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980575+0000", 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3337999999999998e-05 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980583+0000", 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.481e-06 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.980588+0000", 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.288e-06 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:28.020 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:28.021 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-26T12:15:28.021 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:28.021 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:28.022 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:28.038 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:28.037+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:28.139 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:28.138+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:28.146 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:28.146 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:28.146 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:28.166 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:28.166 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:28.169 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:28.169 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:28.209 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:28.209 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:28.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:28.261 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:28.260+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:28.341 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:28.340+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:28.409 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:28.409 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:28.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:28.463 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:28.462+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:28.543 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:28.542+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:28.570 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:28.570 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:28.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:28.669 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:28.668+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:28.725 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:15:28.744 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:28.743+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:28.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 24 16 78726 78710 204.957 162.75 0.0173126 0.0048765 2024-04-26T12:15:28.784 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:28.784 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:28.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:28.845 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:28.843+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:28.946 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:28.944+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:29.009 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:29.047 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:29.046+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:29.148 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:29.146+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:29.158 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:29.158 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:29.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:29.249 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.247+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:29.309 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:29.309 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:29.323 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:29.364 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.363+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:29.450 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.449+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:29.507 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:29.508 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:29.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:29.560 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.559+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:29.651 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.650+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:29.674 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:29.674 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:29.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:29.721 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:15:29.752 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.751+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:29.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 25 16 81279 81263 203.141 159.562 0.0113938 0.00492005 2024-04-26T12:15:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:29.885 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:29.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:29.887 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.885+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:29.987 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:29.986+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:30.040 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:30.040 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:30.055 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:30.088 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:30.087+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:30.171 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:30.189 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:30.188+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:30.204 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:30.205 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:30.217 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:30.289 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:30.288+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:30.293 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:30.293 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:30.293 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:30.313 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:30.313 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:30.316 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:30.317 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:30.358 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:30.359 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:30.359 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:30.359 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:30.359 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:30.372 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:30.390 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:30.389+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:30.490 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:30.489+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:30.523 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.997038474, 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:30.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:30.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:30.529 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.99694963, 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:30.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.871355769999999, 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.535 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:30.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.868909661, 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.541 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:30.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.546 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.868329622999999, 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:30.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:30.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:30.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:51738 5.8 5:10901916:::benchmark_data_smithi069_31227_object51737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.987439392000001, 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019114662000000001, 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 51738 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533384+0000", 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533505+0000", 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012143500000000001 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533516+0000", 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1031e-05 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.533523+0000", 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:15:30.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537326+0000", 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038034509999999998 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537402+0000", 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5873999999999999e-05 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.537478+0000", 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5947999999999999e-05 2024-04-26T12:15:30.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.540283+0000", 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028045320000000002 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552413+0000", 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012130395 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552464+0000", 2024-04-26T12:15:30.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0574000000000001e-05 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:18.552499+0000", 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5264e-05 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:62440 5.8 5:1aecf3b3:::benchmark_data_smithi069_31227_object62439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.0543595149999998, 2024-04-26T12:15:30.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019189951, 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 62440 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466463+0000", 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466537+0000", 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3996000000000001e-05 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466545+0000", 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1720000000000007e-06 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466550+0000", 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5600000000000004e-06 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473833+0000", 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072829909999999999 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473902+0000", 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9620000000000001e-05 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473982+0000", 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9294000000000003e-05 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.480007+0000", 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060249800000000001 2024-04-26T12:15:30.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485579+0000", 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055726509999999996 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485622+0000", 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2141999999999997e-05 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485654+0000", 2024-04-26T12:15:30.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2459000000000002e-05 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.4627570470000002, 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.564 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:30.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.569 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64612 5.0 5:09dee88d:::benchmark_data_smithi069_31227_object64611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.2260625169999999, 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019269178000000001, 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64612 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:30.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294824+0000", 2024-04-26T12:15:30.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3053999999999996e-05 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294830+0000", 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5429999999999999e-06 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294834+0000", 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0810000000000004e-06 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301309+0000", 2024-04-26T12:15:30.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006475069 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301419+0000", 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110192 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301507+0000", 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7076000000000005e-05 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308534+0000", 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070278809999999997 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313939+0000", 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054041820000000004 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313987+0000", 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8575000000000002e-05 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314030+0000", 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3053000000000003e-05 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64620 5.0 5:0c82d98b:::benchmark_data_smithi069_31227_object64619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.2238624260000002, 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01923395, 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64620 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:30.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297006+0000", 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5843999999999997e-05 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297014+0000", 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3549999999999999e-06 2024-04-26T12:15:30.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297019+0000", 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8969999999999999e-06 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308655+0000", 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011636502999999999 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308774+0000", 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011843 2024-04-26T12:15:30.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308861+0000", 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7368999999999996e-05 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311398+0000", 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002537526 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316113+0000", 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047143439999999997 2024-04-26T12:15:30.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316161+0000", 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7712e-05 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316195+0000", 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4536999999999998e-05 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.580 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.2208180879999997, 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.2203135989999998, 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:30.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:30.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:30.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64629 5.0 5:02f7d0fe:::benchmark_data_smithi069_31227_object64628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.2200044669999999, 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021120738, 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64629 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300912+0000", 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3806000000000003e-05 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300923+0000", 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300930+0000", 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311469+0000", 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010538659000000001 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311584+0000", 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011458700000000001 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014452900000000001 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321119+0000", 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093907230000000001 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321864+0000", 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00074479199999999998 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321905+0000", 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1192000000000001e-05 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321940+0000", 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5024000000000002e-05 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71822 5.4 5:20b40e6f:::benchmark_data_smithi069_31227_object71821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.4319825110000002, 2024-04-26T12:15:30.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020733079000000001, 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71822 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088907+0000", 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6464000000000006e-05 2024-04-26T12:15:30.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088912+0000", 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7299999999999996e-06 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088916+0000", 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0790000000000002e-06 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097755+0000", 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008839286 2024-04-26T12:15:30.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097869+0000", 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011418500000000001 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.098014+0000", 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014409700000000001 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109464+0000", 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011450431 2024-04-26T12:15:30.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109504+0000", 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0439999999999999e-05 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109537+0000", 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2147000000000002e-05 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109574+0000", 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7540999999999999e-05 2024-04-26T12:15:30.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71825 5.4 5:2c7e5216:::benchmark_data_smithi069_31227_object71824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.4318308890000004, 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020667386999999999, 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71825 2024-04-26T12:15:30.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088992+0000", 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089039+0000", 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6616000000000002e-05 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089044+0000", 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7400000000000004e-06 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089047+0000", 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:15:30.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099399+0000", 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010351931 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099490+0000", 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1699000000000004e-05 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099596+0000", 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106051 2024-04-26T12:15:30.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109607+0000", 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010010544999999999 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109612+0000", 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109639+0000", 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6974e-05 2024-04-26T12:15:30.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109660+0000", 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1109999999999999e-05 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.429321957, 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:30.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:30.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71833 5.4 5:2835a1f7:::benchmark_data_smithi069_31227_object71832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.4273856829999998, 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019580810000000001, 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71833 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093437+0000", 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093543+0000", 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010636 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093556+0000", 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2203e-05 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093563+0000", 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5660000000000001e-06 2024-04-26T12:15:30.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106409+0000", 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012845663 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106527+0000", 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011846200000000001 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106611+0000", 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3460000000000004e-05 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112920+0000", 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063096740000000004 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112935+0000", 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4729000000000001e-05 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112986+0000", 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0796e-05 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.113019+0000", 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.277e-05 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75770 5.0 5:0750049a:::benchmark_data_smithi069_31227_object75769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.9129747610000001, 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020158269999999999, 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75770 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607848+0000", 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607883+0000", 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4894999999999997e-05 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607890+0000", 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1350000000000003e-06 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607896+0000", 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614168+0000", 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062712499999999999 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614289+0000", 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012123100000000001 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614416+0000", 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012734700000000001 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.618384+0000", 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039681810000000003 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627925+0000", 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095406540000000008 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627973+0000", 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7621999999999999e-05 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.628007+0000", 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4455999999999997e-05 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75783 5.0 5:0b5f41ff:::benchmark_data_smithi069_31227_object75782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.907635709, 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019750569999999999, 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75783 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:30.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613187+0000", 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613283+0000", 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5416999999999998e-05 2024-04-26T12:15:30.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613288+0000", 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0050000000000004e-06 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613291+0000", 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4060000000000001e-06 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626275+0000", 2024-04-26T12:15:30.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012983552000000001 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626363+0000", 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7960999999999994e-05 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626451+0000", 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8518999999999997e-05 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.630586+0000", 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041342460000000003 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632862+0000", 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022765929999999999 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632903+0000", 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0847999999999999e-05 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632938+0000", 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5451000000000003e-05 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.628 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75931 5.9 5:9d52651e:::benchmark_data_smithi069_31227_object75930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.8457544160000001, 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020086336999999999, 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75931 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:30.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675068+0000", 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675133+0000", 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4485000000000003e-05 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675142+0000", 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1800000000000002e-06 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675148+0000", 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7740000000000001e-06 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679709+0000", 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045611159999999996 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679820+0000", 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110567 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695076+0000", 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015256809 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695115+0000", 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8501999999999998e-05 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695155+0000", 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0553999999999998e-05 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:30.633 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:30.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:30.635 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:30.633+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:30.735 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:30.734+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:30.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 26 16 83917 83901 201.669 164.875 0.005831 0.00495612 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:83999 5.c 5:3585f741:::benchmark_data_smithi069_31227_object83998:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.789278+0000", 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0053315480000000002, 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053624140000000002, 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 83999 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789278+0000", 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789278+0000", 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789277+0000", 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789313+0000", 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6180000000000003e-05 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789321+0000", 2024-04-26T12:15:30.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3129999999999999e-06 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789326+0000", 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1620000000000001e-06 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789574+0000", 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024828600000000001 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789690+0000", 2024-04-26T12:15:30.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011603300000000001 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84002 5.c 5:3ae8d747:::benchmark_data_smithi069_31227_object84001:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.789463+0000", 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0051461620000000001, 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052442269999999997, 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84002 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789463+0000", 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789463+0000", 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789462+0000", 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789520+0000", 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7921999999999999e-05 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789529+0000", 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5299999999999996e-06 2024-04-26T12:15:30.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.789535+0000", 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2750000000000001e-06 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791669+0000", 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021337439999999999 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791811+0000", 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142144 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84006 5.5 5:a01d26b6:::benchmark_data_smithi069_31227_object84005:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.791504+0000", 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003104889, 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032483260000000002, 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84006 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791504+0000", 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791504+0000", 2024-04-26T12:15:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791503+0000", 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791533+0000", 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9544e-05 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791545+0000", 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1921e-05 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791552+0000", 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3579999999999997e-06 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.791625+0000", 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2538000000000002e-05 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792143+0000", 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000518254 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794749+0000", 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026064199999999999 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84008 5.7 5:e151a14b:::benchmark_data_smithi069_31227_object84007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.792336+0000", 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022731320000000002, 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024974289999999998, 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84008 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792336+0000", 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792336+0000", 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792335+0000", 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792413+0000", 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8250999999999993e-05 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792438+0000", 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4640000000000001e-05 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792445+0000", 2024-04-26T12:15:30.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8430000000000004e-06 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792477+0000", 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1696000000000003e-05 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792559+0000", 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2687000000000003e-05 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84009 5.c 5:3c1af77d:::benchmark_data_smithi069_31227_object84008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.792453+0000", 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002156491, 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002455184, 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84009 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792453+0000", 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792453+0000", 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792452+0000", 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792477+0000", 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4545999999999998e-05 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792482+0000", 2024-04-26T12:15:30.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1189999999999996e-06 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792485+0000", 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793678+0000", 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011928869999999999 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793796+0000", 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117589 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84010 5.7 5:ee378599:::benchmark_data_smithi069_31227_object84009:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.792497+0000", 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002111702, 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024910100000000001, 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84010 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792497+0000", 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792497+0000", 2024-04-26T12:15:30.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792497+0000", 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792523+0000", 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5760000000000001e-05 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792528+0000", 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9049999999999996e-06 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792537+0000", 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3910000000000004e-06 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794570+0000", 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002032814 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794694+0000", 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012431899999999999 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84013 5.7 5.e9b27ee7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.792543+0000", 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0020658199999999999, 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025007670000000001, 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84013 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792543+0000", 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792543+0000", 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792543+0000", 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792665+0000", 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012244600000000001 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792671+0000", 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4369999999999998e-06 2024-04-26T12:15:30.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792678+0000", 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1919999999999999e-06 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84014 5.1 5:81dc2d3e:::benchmark_data_smithi069_31227_object84013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.792682+0000", 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019273809999999999, 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024086609999999999, 2024-04-26T12:15:30.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84014 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792682+0000", 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792682+0000", 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792681+0000", 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792758+0000", 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6415999999999995e-05 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792764+0000", 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0290000000000002e-06 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792768+0000", 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.715e-06 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792808+0000", 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0575999999999999e-05 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792924+0000", 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115758 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:84007 5.0 e28/16 5:08bf66c1:::benchmark_data_smithi069_31227_object84006:head v 28'5231, mlcod=28'5229)", 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.792762+0000", 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00184709, 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002390554, 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792762+0000", 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792762+0000", 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792761+0000", 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792877+0000", 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115591 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792888+0000", 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0719e-05 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792894+0000", 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2249999999999997e-06 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792937+0000", 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2920000000000002e-05 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792960+0000", 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3084000000000001e-05 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84015 5.a 5:5088aa3e:::benchmark_data_smithi069_31227_object84014:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.792777+0000", 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0018326169999999999, 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002435193, 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84015 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792777+0000", 2024-04-26T12:15:30.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792777+0000", 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792776+0000", 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792914+0000", 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000137577 2024-04-26T12:15:30.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792922+0000", 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5399999999999996e-06 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792929+0000", 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3969999999999999e-06 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.792974+0000", 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5651e-05 2024-04-26T12:15:30.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793143+0000", 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168441 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793273+0000", 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013034 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84016 5.c 5.44047d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.837 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.793010+0000", 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001599612, 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002278141, 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84016 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793010+0000", 2024-04-26T12:15:30.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793010+0000", 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793009+0000", 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793076+0000", 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7408000000000002e-05 2024-04-26T12:15:30.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793090+0000", 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3363000000000001e-05 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.793098+0000", 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9310000000000008e-06 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:84011 5.0 e28/16)", 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.794552+0000", 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6815999999999999e-05, 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078498499999999998, 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794552+0000", 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794552+0000", 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794552+0000", 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794620+0000", 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8571999999999993e-05 2024-04-26T12:15:30.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794629+0000", 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2310000000000002e-06 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794635+0000", 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6559999999999997e-06 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84018 5.a 5:5e1612f7:::benchmark_data_smithi069_31227_object84017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.794953+0000", 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9996557, 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043418299999999999, 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84018 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794953+0000", 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794953+0000", 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794936+0000", 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999828 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794984+0000", 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7836000000000001e-05 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.794993+0000", 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6589999999999996e-06 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795000+0000", 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6000000000000001e-06 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795216+0000", 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216195 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795301+0000", 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4826000000000004e-05 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:84019 5.5 5:a2d78094:::benchmark_data_smithi069_31227_object84018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.795215+0000", 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9993939, 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024543299999999998, 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 84019 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795215+0000", 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795215+0000", 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795214+0000", 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795270+0000", 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6036999999999999e-05 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795279+0000", 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9940000000000006e-06 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795286+0000", 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795324+0000", 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8970000000000001e-05 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.795442+0000", 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001172 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:83988 5.c 5:3b2abecc:::benchmark_data_smithi069_31227_object83987:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:30.784988+0000", 2024-04-26T12:15:30.851 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0096213800000000006, 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010542922999999999, 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 83988 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.784988+0000", 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.784988+0000", 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.784987+0000", 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.785031+0000", 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3968999999999999e-05 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.785043+0000", 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1915e-05 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.785049+0000", 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6320000000000002e-06 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.787043+0000", 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019934140000000002 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:30.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:30.787153+0000", 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110469 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 15 2024-04-26T12:15:30.855 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:30.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:30.857 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:30.855+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:30.957 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:30.955+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:31.054 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:31.054 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:31.057 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:31.056+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:31.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:31.158 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:31.157+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:31.258 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:31.257+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.059964937, 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:31.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:31.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:31.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:31.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.057139954, 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:31.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62508 5.a 5:5ae92930:::benchmark_data_smithi069_31227_object62507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7711488430000006, 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016616539, 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62508 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495244+0000", 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495330+0000", 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6191000000000002e-05 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495342+0000", 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495349+0000", 2024-04-26T12:15:31.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9619999999999996e-06 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502562+0000", 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072129940000000003 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502674+0000", 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112186 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502815+0000", 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014114999999999999 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.504979+0000", 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002163828 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511812+0000", 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068327220000000003 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511841+0000", 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9793000000000001e-05 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511862+0000", 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0054000000000001e-05 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63241 5.2 5:46cc3d96:::benchmark_data_smithi069_31227_object63240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4811777429999999, 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016524549999999999, 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63241 2024-04-26T12:15:31.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785290+0000", 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4809999999999997e-05 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785301+0000", 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0735e-05 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785307+0000", 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788592+0000", 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032850589999999999 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788711+0000", 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011880200000000001 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801600+0000", 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012888599000000001 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801671+0000", 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1507000000000005e-05 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801741+0000", 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9256000000000002e-05 2024-04-26T12:15:31.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63242 5.2 5:4911c375:::benchmark_data_smithi069_31227_object63241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.481029199, 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016514994000000002, 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63242 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785364+0000", 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785421+0000", 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785427+0000", 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7470000000000002e-06 2024-04-26T12:15:31.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785430+0000", 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790741+0000", 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053110060000000001 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790864+0000", 2024-04-26T12:15:31.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122192 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801750+0000", 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010886132999999999 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801811+0000", 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1736000000000007e-05 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801880+0000", 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8195999999999996e-05 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.5646318609999996, 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.301 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.5219019149999999, 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:71627 5.c 5:340fc5a4:::benchmark_data_smithi069_31227_object71626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2524802069999996, 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016704157000000001, 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 71627 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:31.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013913+0000", 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013971+0000", 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8498000000000001e-05 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013997+0000", 2024-04-26T12:15:31.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5945e-05 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.014004+0000", 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021720+0000", 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077157399999999996 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021830+0000", 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110135 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030482+0000", 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086519070000000003 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030540+0000", 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7843999999999997e-05 2024-04-26T12:15:31.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030618+0000", 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7930999999999996e-05 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72168 5.c 5:3a3f218e:::benchmark_data_smithi069_31227_object72167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.035531894, 2024-04-26T12:15:31.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016793069000000001, 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72168 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230861+0000", 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230969+0000", 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107705 2024-04-26T12:15:31.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230980+0000", 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1221e-05 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230988+0000", 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235726+0000", 2024-04-26T12:15:31.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047381380000000002 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235808+0000", 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1499e-05 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247498+0000", 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011690459 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247583+0000", 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5167000000000006e-05 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247655+0000", 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1596999999999999e-05 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72169 5.c 5:32a9709f:::benchmark_data_smithi069_31227_object72168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.035397476, 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016774866999999999, 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72169 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231031+0000", 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5289e-05 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231039+0000", 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3059999999999998e-06 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231050+0000", 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237587+0000", 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006536338 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237748+0000", 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016125100000000001 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247665+0000", 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009917136 2024-04-26T12:15:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247710+0000", 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641999999999997e-05 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247771+0000", 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1616000000000001e-05 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0331248970000004, 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0323951869999997, 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8792770239999999, 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8758486030000001, 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:31.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7995876710000003, 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7994548249999998, 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7690511300000002, 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:31.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:31.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:85029 5.e e28/16 5:79e939cf:::benchmark_data_smithi069_31227_object85028:head v 28'5366, mlcod=28'5362)", 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.092394535999999999, 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016734427, 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:31.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174068+0000", 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9467000000000004e-05 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174079+0000", 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1226000000000001e-05 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174086+0000", 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1800000000000001e-06 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.176343+0000", 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022574750000000001 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.176363+0000", 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.963e-05 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.190668+0000", 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014305605000000001 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.190734+0000", 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5467000000000002e-05 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.071861458000000003, 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:31.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:31.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:31.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.047704831000000003, 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:31.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:31.374 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:31.376 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:31.376 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:31.374+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:31.476 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:31.475+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85907 5.9 5:9109d1a7:::benchmark_data_smithi069_31227_object85906:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.514154+0000", 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016576340000000001, 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001675185, 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85907 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514154+0000", 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514154+0000", 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514153+0000", 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514333+0000", 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000180285 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514347+0000", 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3755e-05 2024-04-26T12:15:31.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514353+0000", 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5379999999999999e-06 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514397+0000", 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3804000000000003e-05 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514531+0000", 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013435199999999999 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85910 5.9 5.708be5f9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.514364+0000", 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014469719999999999, 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015043470000000001, 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:31.521 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85910 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514364+0000", 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514364+0000", 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514364+0000", 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514392+0000", 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7670000000000001e-05 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514397+0000", 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1590000000000001e-06 2024-04-26T12:15:31.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514400+0000", 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85890 5.f 5:f5a25cc8:::benchmark_data_smithi069_31227_object85889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.504747+0000", 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.011063943, 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011154022, 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85890 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.504747+0000", 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.504747+0000", 2024-04-26T12:15:31.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.504746+0000", 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.504830+0000", 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3169000000000003e-05 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.504842+0000", 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2478e-05 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.504856+0000", 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3560000000000001e-05 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508157+0000", 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003301207 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508276+0000", 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118794 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85892 5.8 5:1346beb8:::benchmark_data_smithi069_31227_object85891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.507385+0000", 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0084265039999999996, 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085547179999999994, 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.528 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85892 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507385+0000", 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507385+0000", 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507384+0000", 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507439+0000", 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4583999999999998e-05 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507448+0000", 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4029999999999996e-06 2024-04-26T12:15:31.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507453+0000", 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9590000000000003e-06 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507838+0000", 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00038460000000000002 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.507931+0000", 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3049999999999998e-05 2024-04-26T12:15:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508046+0000", 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115764 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510804+0000", 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00275713 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85898 5.d 5:b3a3b883:::benchmark_data_smithi069_31227_object85897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.508157+0000", 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0076542010000000002, 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078335639999999995, 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85898 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508157+0000", 2024-04-26T12:15:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508157+0000", 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508156+0000", 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508217+0000", 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0847000000000002e-05 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508227+0000", 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4450000000000002e-06 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508232+0000", 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1279999999999999e-06 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508269+0000", 2024-04-26T12:15:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6718999999999999e-05 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508391+0000", 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000122497 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:85896 5.a e28/16 5:5b29daed:::benchmark_data_smithi069_31227_object85895:head v 28'5376, mlcod=28'5372)", 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.508388+0000", 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0074237720000000004, 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076371039999999996, 2024-04-26T12:15:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508388+0000", 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508388+0000", 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508387+0000", 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508460+0000", 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3120999999999993e-05 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508466+0000", 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2259999999999996e-06 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508469+0000", 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3129999999999999e-06 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508505+0000", 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5596000000000003e-05 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.508516+0000", 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1154e-05 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:85897 5.a e28/16 5:505b03d2:::benchmark_data_smithi069_31227_object85896:head v 28'5377, mlcod=28'5372)", 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.509876+0000", 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0059351630000000002, 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061781780000000003, 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.509876+0000", 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.509876+0000", 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.509876+0000", 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.509924+0000", 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8665000000000002e-05 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.509934+0000", 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.509939+0000", 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9300000000000002e-06 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510821+0000", 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088194 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510840+0000", 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85899 5.4 5:22aef3ea:::benchmark_data_smithi069_31227_object85898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.510516+0000", 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052956430000000001, 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055790450000000004, 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85899 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510516+0000", 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510516+0000", 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510515+0000", 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510549+0000", 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4177000000000002e-05 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510560+0000", 2024-04-26T12:15:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1323e-05 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510566+0000", 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0090000000000004e-06 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510630+0000", 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3207999999999995e-05 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510739+0000", 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109706 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.510876+0000", 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136842 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.515263+0000", 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043872449999999997 2024-04-26T12:15:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85901 5.e 5:7d2bd08e:::benchmark_data_smithi069_31227_object85900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.511172+0000", 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046396069999999996, 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049633059999999998, 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85901 2024-04-26T12:15:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511172+0000", 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511172+0000", 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511171+0000", 2024-04-26T12:15:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511254+0000", 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3608000000000003e-05 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511266+0000", 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1715999999999999e-05 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511273+0000", 2024-04-26T12:15:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511317+0000", 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3878000000000002e-05 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511423+0000", 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106469 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511542+0000", 2024-04-26T12:15:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118503 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.514366+0000", 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028240000000000001 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85902 5.4 5:2dd5079b:::benchmark_data_smithi069_31227_object85901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.511284+0000", 2024-04-26T12:15:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045277160000000002, 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004890953, 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85902 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511284+0000", 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511284+0000", 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511283+0000", 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511370+0000", 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7219000000000006e-05 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511381+0000", 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1052e-05 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511387+0000", 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2089999999999996e-06 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.513581+0000", 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021939099999999999 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.513714+0000", 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000133008 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.513853+0000", 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000139025 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:85903 5.f 5:fbe86bfe:::benchmark_data_smithi069_31227_object85902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.511394+0000", 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00441743, 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048174560000000003, 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 85903 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511394+0000", 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511394+0000", 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511393+0000", 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511427+0000", 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3216000000000002e-05 2024-04-26T12:15:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511433+0000", 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7349999999999999e-06 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511439+0000", 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3399999999999997e-06 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511471+0000", 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2103000000000001e-05 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.511591+0000", 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120382 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-26T12:15:31.560 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:31.561 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:31.605 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:31.604+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:31.678 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:31.677+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:31.707 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:31.707 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:31.719 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:31.734 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:15:31.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 27 16 86550 86534 200.294 164.562 0.00464102 0.00499009 2024-04-26T12:15:31.804 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:31.803+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:31.881 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:31.879+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:31.907 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.381265556999999, 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.381176712999999, 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.255582853, 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.253136743999999, 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.252556706, 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:62440 5.8 5:1aecf3b3:::benchmark_data_smithi069_31227_object62439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.4385865980000005, 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019189951, 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 62440 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466464+0000", 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466463+0000", 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466537+0000", 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3996000000000001e-05 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466545+0000", 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1720000000000007e-06 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.466550+0000", 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5600000000000004e-06 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473833+0000", 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072829909999999999 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473902+0000", 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9620000000000001e-05 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.473982+0000", 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9294000000000003e-05 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.480007+0000", 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060249800000000001 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485579+0000", 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055726509999999996 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485622+0000", 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2141999999999997e-05 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:22.485654+0000", 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2459000000000002e-05 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.8469841299999992, 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64612 5.0 5:09dee88d:::benchmark_data_smithi069_31227_object64611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.6102895999999998, 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019269178000000001, 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64612 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294824+0000", 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3053999999999996e-05 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294830+0000", 2024-04-26T12:15:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5429999999999999e-06 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294834+0000", 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0810000000000004e-06 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301309+0000", 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006475069 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301419+0000", 2024-04-26T12:15:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110192 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301507+0000", 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7076000000000005e-05 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308534+0000", 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070278809999999997 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313939+0000", 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054041820000000004 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313987+0000", 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8575000000000002e-05 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314030+0000", 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3053000000000003e-05 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64620 5.0 5:0c82d98b:::benchmark_data_smithi069_31227_object64619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.6080895089999991, 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01923395, 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64620 2024-04-26T12:15:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297006+0000", 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5843999999999997e-05 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297014+0000", 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3549999999999999e-06 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297019+0000", 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8969999999999999e-06 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308655+0000", 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011636502999999999 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308774+0000", 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011843 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308861+0000", 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7368999999999996e-05 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311398+0000", 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002537526 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316113+0000", 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047143439999999997 2024-04-26T12:15:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316161+0000", 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7712e-05 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316195+0000", 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4536999999999998e-05 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.6050451710000004, 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.6045406819999997, 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64629 5.0 5:02f7d0fe:::benchmark_data_smithi069_31227_object64628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.6042315499999997, 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021120738, 2024-04-26T12:15:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64629 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300912+0000", 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3806000000000003e-05 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300923+0000", 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300930+0000", 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311469+0000", 2024-04-26T12:15:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010538659000000001 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311584+0000", 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011458700000000001 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014452900000000001 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321119+0000", 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093907230000000001 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321864+0000", 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00074479199999999998 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321905+0000", 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1192000000000001e-05 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321940+0000", 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5024000000000002e-05 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71822 5.4 5:20b40e6f:::benchmark_data_smithi069_31227_object71821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.816209594, 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020733079000000001, 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71822 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088907+0000", 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6464000000000006e-05 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088912+0000", 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7299999999999996e-06 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088916+0000", 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0790000000000002e-06 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097755+0000", 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008839286 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097869+0000", 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011418500000000001 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.098014+0000", 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014409700000000001 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109464+0000", 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011450431 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109504+0000", 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0439999999999999e-05 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109537+0000", 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2147000000000002e-05 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109574+0000", 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7540999999999999e-05 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71825 5.4 5:2c7e5216:::benchmark_data_smithi069_31227_object71824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.8160579720000003, 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020667386999999999, 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71825 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088992+0000", 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089039+0000", 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6616000000000002e-05 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089044+0000", 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7400000000000004e-06 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089047+0000", 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099399+0000", 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010351931 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099490+0000", 2024-04-26T12:15:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1699000000000004e-05 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099596+0000", 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106051 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109607+0000", 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010010544999999999 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109612+0000", 2024-04-26T12:15:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109639+0000", 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6974e-05 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109660+0000", 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1109999999999999e-05 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.8135490399999998, 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71833 5.4 5:2835a1f7:::benchmark_data_smithi069_31227_object71832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.8116127659999997, 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019580810000000001, 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71833 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093437+0000", 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093543+0000", 2024-04-26T12:15:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010636 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093556+0000", 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2203e-05 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093563+0000", 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5660000000000001e-06 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106409+0000", 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012845663 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106527+0000", 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011846200000000001 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106611+0000", 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3460000000000004e-05 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112920+0000", 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063096740000000004 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112935+0000", 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4729000000000001e-05 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112986+0000", 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0796e-05 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.113019+0000", 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.277e-05 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75770 5.0 5:0750049a:::benchmark_data_smithi069_31227_object75769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2972018439999999, 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020158269999999999, 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75770 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607848+0000", 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607883+0000", 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4894999999999997e-05 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607890+0000", 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1350000000000003e-06 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607896+0000", 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614168+0000", 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062712499999999999 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614289+0000", 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012123100000000001 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614416+0000", 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012734700000000001 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.618384+0000", 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039681810000000003 2024-04-26T12:15:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627925+0000", 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095406540000000008 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627973+0000", 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7621999999999999e-05 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.628007+0000", 2024-04-26T12:15:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4455999999999997e-05 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75783 5.0 5:0b5f41ff:::benchmark_data_smithi069_31227_object75782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2918627919999999, 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019750569999999999, 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75783 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613187+0000", 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613283+0000", 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5416999999999998e-05 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613288+0000", 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0050000000000004e-06 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613291+0000", 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4060000000000001e-06 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626275+0000", 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012983552000000001 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626363+0000", 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7960999999999994e-05 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626451+0000", 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8518999999999997e-05 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.630586+0000", 2024-04-26T12:15:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041342460000000003 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632862+0000", 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022765929999999999 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632903+0000", 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0847999999999999e-05 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632938+0000", 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5451000000000003e-05 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75931 5.9 5:9d52651e:::benchmark_data_smithi069_31227_object75930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.229981499, 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020086336999999999, 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75931 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675068+0000", 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675133+0000", 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4485000000000003e-05 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675142+0000", 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1800000000000002e-06 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675148+0000", 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7740000000000001e-06 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679709+0000", 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045611159999999996 2024-04-26T12:15:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679820+0000", 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110567 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695076+0000", 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015256809 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695115+0000", 2024-04-26T12:15:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8501999999999998e-05 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695155+0000", 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0553999999999998e-05 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:86632 5.0 5:06282ec4:::benchmark_data_smithi069_31227_object86631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.12140780399999999, 2024-04-26T12:15:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019377893, 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 86632 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783642+0000", 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783672+0000", 2024-04-26T12:15:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0088000000000001e-05 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783679+0000", 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6359999999999997e-06 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783684+0000", 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5740000000000003e-06 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.788843+0000", 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051585809999999998 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.789004+0000", 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016137700000000001 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.789147+0000", 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014224800000000001 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.794502+0000", 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005355233 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.802942+0000", 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084403240000000008 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.802991+0000", 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9008000000000002e-05 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.803021+0000", 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9470000000000001e-05 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:32.023 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:32.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:32.025 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:32.023+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:32.125 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:32.124+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:32.182 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87675 5.2 5.1fbc552 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.179846+0000", 2024-04-26T12:15:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00071182699999999995, 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00073144300000000002, 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87675 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179846+0000", 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179846+0000", 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179845+0000", 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179888+0000", 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3245999999999999e-05 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179896+0000", 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179901+0000", 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9280000000000001e-06 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87676 5.a 5.c340e1ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.179906+0000", 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00065189899999999995, 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000735284, 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87676 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179906+0000", 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179906+0000", 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179905+0000", 2024-04-26T12:15:32.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179929+0000", 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3587999999999998e-05 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179935+0000", 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179939+0000", 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87652 5.a 5:5cab192e:::benchmark_data_smithi069_31227_object87651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.171025+0000", 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.009532792, 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096907350000000007, 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87652 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171025+0000", 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171025+0000", 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171024+0000", 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171068+0000", 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4305999999999999e-05 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171077+0000", 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5040000000000002e-06 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171084+0000", 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0400000000000004e-06 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171141+0000", 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7226999999999999e-05 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171270+0000", 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012893599999999999 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171406+0000", 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013590999999999999 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177105+0000", 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005699394 2024-04-26T12:15:32.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87654 5.a 5:55dcd18c:::benchmark_data_smithi069_31227_object87653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.171166+0000", 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0093915270000000002, 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096433530000000003, 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87654 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171166+0000", 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171166+0000", 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171165+0000", 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171199+0000", 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3822000000000002e-05 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171209+0000", 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0112000000000001e-05 2024-04-26T12:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171215+0000", 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6380000000000001e-06 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.174866+0000", 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036514609999999999 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175011+0000", 2024-04-26T12:15:32.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014479299999999999 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175155+0000", 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014393000000000001 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87655 5.a 5:5bfe21dc:::benchmark_data_smithi069_31227_object87654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.171221+0000", 2024-04-26T12:15:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0093365689999999994, 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096646260000000008, 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87655 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171221+0000", 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171221+0000", 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171220+0000", 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171253+0000", 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2259999999999999e-05 2024-04-26T12:15:32.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171260+0000", 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1330000000000001e-06 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.171265+0000", 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177146+0000", 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058808189999999998 2024-04-26T12:15:32.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177272+0000", 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012665899999999999 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177443+0000", 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000170199 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87660 5.a 5:559179c4:::benchmark_data_smithi069_31227_object87659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.172471+0000", 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0080865020000000006, 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085007020000000006, 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87660 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.172471+0000", 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.172471+0000", 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.172471+0000", 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.172500+0000", 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9779000000000001e-05 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.172507+0000", 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.172513+0000", 2024-04-26T12:15:32.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179396+0000", 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068832759999999998 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179505+0000", 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108942 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179633+0000", 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012769100000000001 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87666 5.2 5:47dcc694:::benchmark_data_smithi069_31227_object87665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.174976+0000", 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0055819950000000002, 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060449129999999998, 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87666 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.174976+0000", 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.174976+0000", 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.174975+0000", 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175006+0000", 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1265e-05 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175014+0000", 2024-04-26T12:15:32.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7300000000000005e-06 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175019+0000", 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.541e-06 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179409+0000", 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043901340000000004 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179532+0000", 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87667 5.6 5:6bf8e0fd:::benchmark_data_smithi069_31227_object87666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.175330+0000", 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0052275009999999998, 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057334769999999998, 2024-04-26T12:15:32.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87667 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175330+0000", 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175330+0000", 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175329+0000", 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175452+0000", 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012242500000000001 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175461+0000", 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9390000000000003e-06 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.175467+0000", 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9410000000000004e-06 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178480+0000", 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030129470000000002 2024-04-26T12:15:32.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178588+0000", 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108836 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:87669 5.e e28/16 5:74cccaf7:::benchmark_data_smithi069_31227_object87668:head v 28'5538, mlcod=28'5535)", 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.176922+0000", 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0036350839999999998, 2024-04-26T12:15:32.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041745269999999999, 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.176922+0000", 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.176922+0000", 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.176922+0000", 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.176970+0000", 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8081000000000003e-05 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.176979+0000", 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2e-06 2024-04-26T12:15:32.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.176985+0000", 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6890000000000001e-06 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178519+0000", 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015342159999999999 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178543+0000", 2024-04-26T12:15:32.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.376e-05 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87672 5.3 5:c3f15e87:::benchmark_data_smithi069_31227_object87671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.177837+0000", 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027209059999999999, 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032913880000000001, 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87672 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177837+0000", 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177837+0000", 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177836+0000", 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177983+0000", 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014740099999999999 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177993+0000", 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8779999999999993e-06 2024-04-26T12:15:32.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.177998+0000", 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178030+0000", 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2181000000000002e-05 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178148+0000", 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011808599999999999 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87673 5.c 5:3d5cb36c:::benchmark_data_smithi069_31227_object87672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.178100+0000", 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00245729, 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030615799999999999, 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87673 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178100+0000", 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178100+0000", 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178100+0000", 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178220+0000", 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012009400000000001 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178229+0000", 2024-04-26T12:15:32.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1949999999999992e-06 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178233+0000", 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4560000000000002e-06 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178267+0000", 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3460999999999997e-05 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.178344+0000", 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6747000000000002e-05 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:87654 5.a e28/16)", 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.179476+0000", 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0010814380000000001, 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001716752, 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:32.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179476+0000", 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179476+0000", 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179475+0000", 2024-04-26T12:15:32.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179483+0000", 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8639999999999996e-06 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179494+0000", 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1119e-05 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179501+0000", 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:87674 5.c 5:36c1977e:::benchmark_data_smithi069_31227_object87673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:32.179765+0000", 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00079206600000000002, 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014552499999999999, 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:32.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 87674 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179765+0000", 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:32.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179765+0000", 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179765+0000", 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179806+0000", 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1621e-05 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:32.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179817+0000", 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0675e-05 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.179836+0000", 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8952000000000001e-05 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.180298+0000", 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046194699999999999 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:32.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:32.180427+0000", 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012874100000000001 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 13 2024-04-26T12:15:32.234 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:32.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:32.236 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:32.234+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:32.318 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:32.336 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:32.335+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:32.394 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:32.394 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:32.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:32.437 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:32.436+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:32.445 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:32.465 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:32.465 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:32.467 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:32.468 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:32.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-04-26T12:15:32.538 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:32.537+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:32.602 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:32.602 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:32.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:32.658 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:32.656+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:32.731 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:15:32.740 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:32.738+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:32.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 28 16 89153 89137 198.95 162.688 0.0027231 0.00502371 2024-04-26T12:15:32.757 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:32.757 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:32.770 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:32.841 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:32.839+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:32.914 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:32.914 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:32.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:32.941 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:32.940+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:33.042 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:33.041+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:33.112 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:33.112 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:33.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:33.143 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:33.141+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:33.244 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:33.242+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:33.281 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:33.281 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:33.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:33.379 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:33.378+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:33.444 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:33.443+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:33.493 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:33.493 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:33.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:33.545 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:33.544+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:33.646 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:33.645+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:33.701 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:33.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:33.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 29 16 91752 91736 197.691 162.438 0.005288 0.00505564 2024-04-26T12:15:33.760 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:33.759+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:33.847 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:33.846+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:33.857 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:33.857 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:33.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:33.954 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:33.953+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:34.048 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:34.047+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:34.053 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:34.053 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:34.065 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:34.150 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:34.149+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:34.250 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:34.248+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:34.252 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:34.252 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:34.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:34.350 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:34.349+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:34.421 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:34.421 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:34.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:34.468 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:34.477 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:34.476+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:34.552 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:34.551+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:34.589 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:34.589 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:34.593 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:34.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:34.612 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:34.612 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:34.615 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:34.615 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:34.687 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:34.686+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:34.745 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:15:34.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 30 15 94328 94313 196.47 161.062 0.00350104 0.00508744 2024-04-26T12:15:34.754 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:34.753+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.587499759, 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.584674776, 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:62508 5.a 5:5ae92930:::benchmark_data_smithi069_31227_object62507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.298683665, 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016616539, 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62508 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495245+0000", 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495244+0000", 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495330+0000", 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6191000000000002e-05 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495342+0000", 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.495349+0000", 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9619999999999996e-06 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502562+0000", 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072129940000000003 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502674+0000", 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112186 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.502815+0000", 2024-04-26T12:15:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014114999999999999 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.504979+0000", 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002163828 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511812+0000", 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068327220000000003 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511841+0000", 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9793000000000001e-05 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.511862+0000", 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0054000000000001e-05 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63241 5.2 5:46cc3d96:::benchmark_data_smithi069_31227_object63240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.008712565, 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016524549999999999, 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63241 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785216+0000", 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785290+0000", 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4809999999999997e-05 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785301+0000", 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0735e-05 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785307+0000", 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788592+0000", 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032850589999999999 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.788711+0000", 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011880200000000001 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801600+0000", 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012888599000000001 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801671+0000", 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1507000000000005e-05 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801741+0000", 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9256000000000002e-05 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:63242 5.2 5:4911c375:::benchmark_data_smithi069_31227_object63241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.008564021, 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016514994000000002, 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63242 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785365+0000", 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785364+0000", 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785421+0000", 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785427+0000", 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7470000000000002e-06 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.785430+0000", 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790741+0000", 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053110060000000001 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.790864+0000", 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122192 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801750+0000", 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010886132999999999 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801811+0000", 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1736000000000007e-05 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:22.801880+0000", 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8195999999999996e-05 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.092166683, 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.049436737000001, 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:71627 5.c 5:340fc5a4:::benchmark_data_smithi069_31227_object71626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7800150289999994, 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016704157000000001, 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 71627 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013913+0000", 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013971+0000", 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8498000000000001e-05 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013997+0000", 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5945e-05 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.014004+0000", 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021720+0000", 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077157399999999996 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021830+0000", 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110135 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030482+0000", 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086519070000000003 2024-04-26T12:15:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030540+0000", 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7843999999999997e-05 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030618+0000", 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7930999999999996e-05 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72168 5.c 5:3a3f218e:::benchmark_data_smithi069_31227_object72167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5630667159999998, 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016793069000000001, 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72168 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230861+0000", 2024-04-26T12:15:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230969+0000", 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107705 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230980+0000", 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1221e-05 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230988+0000", 2024-04-26T12:15:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235726+0000", 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047381380000000002 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235808+0000", 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1499e-05 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247498+0000", 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011690459 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247583+0000", 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5167000000000006e-05 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247655+0000", 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1596999999999999e-05 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72169 5.c 5:32a9709f:::benchmark_data_smithi069_31227_object72168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5629322979999998, 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016774866999999999, 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72169 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231031+0000", 2024-04-26T12:15:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5289e-05 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231039+0000", 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3059999999999998e-06 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231050+0000", 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237587+0000", 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006536338 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237748+0000", 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016125100000000001 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247665+0000", 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009917136 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247710+0000", 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641999999999997e-05 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247771+0000", 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1616000000000001e-05 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5606597190000002, 2024-04-26T12:15:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5599300090000003, 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4068118460000001, 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4033834250000004, 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.3271224930000001, 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.3269896469999996, 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.296585952, 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:85029 5.e e28/16 5:79e939cf:::benchmark_data_smithi069_31227_object85028:head v 28'5366, mlcod=28'5362)", 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6199293580000003, 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016734427, 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174068+0000", 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9467000000000004e-05 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174079+0000", 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1226000000000001e-05 2024-04-26T12:15:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174086+0000", 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1800000000000001e-06 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.176343+0000", 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022574750000000001 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.176363+0000", 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.963e-05 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.190668+0000", 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014305605000000001 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.190734+0000", 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5467000000000002e-05 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5993962800000001, 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5752396530000001, 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:34.897 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:34.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:34.898 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:34.896+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:34.999 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:34.997+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95040 5.e 5:70f197df:::benchmark_data_smithi069_31227_object95039:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.031605+0000", 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.011091251999999999, 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011110101000000001, 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95040 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.031605+0000", 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.031605+0000", 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.031604+0000", 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.031700+0000", 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6181000000000006e-05 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.031710+0000", 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2469999999999997e-06 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.031716+0000", 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2829999999999998e-06 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035063+0000", 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033473040000000002 2024-04-26T12:15:35.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035201+0000", 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013791699999999999 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035358+0000", 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015668799999999999 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040619+0000", 2024-04-26T12:15:35.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0052615819999999999 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95050 5.f 5:f13bf9f4:::benchmark_data_smithi069_31227_object95049:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.035231+0000", 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0074646230000000001, 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007535333, 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95050 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035231+0000", 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035231+0000", 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035230+0000", 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035283+0000", 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035294+0000", 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.113e-05 2024-04-26T12:15:35.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035301+0000", 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3019999999999997e-06 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035353+0000", 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1617999999999999e-05 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035467+0000", 2024-04-26T12:15:35.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011459900000000001 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95052 5.b 5:d4a8a7d8:::benchmark_data_smithi069_31227_object95051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.035372+0000", 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0073240700000000002, 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074325119999999996, 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95052 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035372+0000", 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035372+0000", 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035371+0000", 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035402+0000", 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0759000000000001e-05 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035409+0000", 2024-04-26T12:15:35.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1189999999999999e-06 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035414+0000", 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035478+0000", 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3657000000000004e-05 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035556+0000", 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8057000000000002e-05 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035639+0000", 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2622999999999998e-05 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038747+0000", 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031082729999999999 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95055 5.e 5:7ada936a:::benchmark_data_smithi069_31227_object95054:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.035933+0000", 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0067631389999999996, 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006914328, 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95055 2024-04-26T12:15:35.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035933+0000", 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035933+0000", 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035932+0000", 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.035993+0000", 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0715999999999999e-05 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036004+0000", 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1764e-05 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036011+0000", 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037615+0000", 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016035050000000001 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037759+0000", 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014411099999999999 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037842+0000", 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3108000000000005e-05 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040673+0000", 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028308600000000001 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:95053 5.a e29/16 5:53f8e6e4:::benchmark_data_smithi069_31227_object95052:head v 29'5921, mlcod=29'5918)", 2024-04-26T12:15:35.062 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.036127+0000", 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0065690949999999996, 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0067606059999999997, 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036127+0000", 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036127+0000", 2024-04-26T12:15:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036126+0000", 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036206+0000", 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9987000000000005e-05 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036215+0000", 2024-04-26T12:15:35.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3019999999999995e-06 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036220+0000", 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2059999999999998e-06 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036296+0000", 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6521999999999997e-05 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036315+0000", 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8386999999999999e-05 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95057 5.0 5:0ac48a93:::benchmark_data_smithi069_31227_object95056:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.036421+0000", 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0062753210000000004, 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064991049999999998, 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95057 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036421+0000", 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036421+0000", 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036420+0000", 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036541+0000", 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012097800000000001 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036552+0000", 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0981999999999999e-05 2024-04-26T12:15:35.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036558+0000", 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1129999999999997e-06 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036618+0000", 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9762000000000001e-05 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036737+0000", 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118984 2024-04-26T12:15:35.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.036863+0000", 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126604 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040580+0000", 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037165129999999998 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95058 5.f 5:fc9b7797:::benchmark_data_smithi069_31227_object95057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.037513+0000", 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0051828259999999998, 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005449069, 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95058 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037513+0000", 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037513+0000", 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037512+0000", 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037540+0000", 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8113999999999999e-05 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037552+0000", 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2186e-05 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.037559+0000", 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6540000000000002e-06 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040533+0000", 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029735679999999998 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040674+0000", 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014105500000000001 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95060 5.f 5.b3f245af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.038185+0000", 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045108350000000004, 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048162209999999999, 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95060 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038185+0000", 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038185+0000", 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038184+0000", 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038253+0000", 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8740999999999998e-05 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038263+0000", 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7659999999999993e-06 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038268+0000", 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5690000000000004e-06 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95061 5.e 5:7495bae3:::benchmark_data_smithi069_31227_object95060:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.038307+0000", 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004388444, 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047234879999999996, 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95061 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038307+0000", 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038307+0000", 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038307+0000", 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038377+0000", 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038386+0000", 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8389999999999996e-06 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.038391+0000", 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9420000000000003e-06 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040694+0000", 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023035289999999999 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040811+0000", 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117204 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040938+0000", 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012636799999999999 2024-04-26T12:15:35.081 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95062 5.f 5.dbf7f92f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.039128+0000", 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035681630000000001, 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039388080000000002, 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95062 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.039128+0000", 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.039128+0000", 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.039127+0000", 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.039204+0000", 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7064000000000006e-05 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.039212+0000", 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9379999999999992e-06 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.039219+0000", 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3029999999999996e-06 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95066 5.9 5:928d75a7:::benchmark_data_smithi069_31227_object95065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.040785+0000", 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001910763, 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002310758, 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95066 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040785+0000", 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040785+0000", 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040784+0000", 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040817+0000", 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2032000000000001e-05 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040827+0000", 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0287e-05 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040832+0000", 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9439999999999996e-06 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040873+0000", 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1254999999999997e-05 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.041003+0000", 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129682 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.088 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95067 5.9 5.8d83f5a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.040840+0000", 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001855832, 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022874549999999999, 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95067 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040840+0000", 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040840+0000", 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040840+0000", 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040898+0000", 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8378000000000002e-05 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040903+0000", 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4419999999999997e-06 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.040907+0000", 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5559999999999999e-06 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.092 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:35.092 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:15:35.092 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:35.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:35.138 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:35.135+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:35.200 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:35.199+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:35.234 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:35.234 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:35.234 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:35.234 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:35.234 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:35.248 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:35.302 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:35.300+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:35.402 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:35.401+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:35.437 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.91019623, 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:35.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.910107386, 2024-04-26T12:15:35.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.784513526000001, 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:35.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.782067417, 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.455 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:35.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40124 5.0 5:0349ef64:::benchmark_data_smithi069_31227_object40123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.781487379000001, 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019312958000000002, 2024-04-26T12:15:35.461 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40124 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652494+0000", 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652493+0000", 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652583+0000", 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9846999999999995e-05 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652591+0000", 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.652601+0000", 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664022+0000", 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011421176 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664140+0000", 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118077 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.664268+0000", 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000127995 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.666757+0000", 2024-04-26T12:15:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024890200000000002 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671743+0000", 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049864499999999999 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671779+0000", 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5645000000000002e-05 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671807+0000", 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7775000000000001e-05 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.375914803000001, 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.467 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64612 5.0 5:09dee88d:::benchmark_data_smithi069_31227_object64611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.139220272999999, 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019269178000000001, 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64612 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294761+0000", 2024-04-26T12:15:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294824+0000", 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3053999999999996e-05 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294830+0000", 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5429999999999999e-06 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.294834+0000", 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0810000000000004e-06 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301309+0000", 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006475069 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301419+0000", 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110192 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.301507+0000", 2024-04-26T12:15:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7076000000000005e-05 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308534+0000", 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070278809999999997 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313939+0000", 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054041820000000004 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.313987+0000", 2024-04-26T12:15:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8575000000000002e-05 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314030+0000", 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3053000000000003e-05 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64620 5.0 5:0c82d98b:::benchmark_data_smithi069_31227_object64619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.137020182000001, 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.01923395, 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64620 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.296961+0000", 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297006+0000", 2024-04-26T12:15:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5843999999999997e-05 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297014+0000", 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3549999999999999e-06 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.297019+0000", 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8969999999999999e-06 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308655+0000", 2024-04-26T12:15:35.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011636502999999999 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308774+0000", 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011843 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308861+0000", 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7368999999999996e-05 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311398+0000", 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002537526 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316113+0000", 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047143439999999997 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316161+0000", 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7712e-05 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316195+0000", 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4536999999999998e-05 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.133975844, 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:35.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:35.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.133471354999999, 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.495 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64629 5.0 5:02f7d0fe:::benchmark_data_smithi069_31227_object64628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.133162222999999, 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021120738, 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64629 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:35.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300912+0000", 2024-04-26T12:15:35.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3806000000000003e-05 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300923+0000", 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300930+0000", 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311469+0000", 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010538659000000001 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311584+0000", 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011458700000000001 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014452900000000001 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321119+0000", 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093907230000000001 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321864+0000", 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00074479199999999998 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321905+0000", 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1192000000000001e-05 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321940+0000", 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5024000000000002e-05 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71822 5.4 5:20b40e6f:::benchmark_data_smithi069_31227_object71821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3451402669999997, 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020733079000000001, 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.501 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71822 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:35.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088907+0000", 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6464000000000006e-05 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088912+0000", 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7299999999999996e-06 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088916+0000", 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0790000000000002e-06 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097755+0000", 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008839286 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097869+0000", 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011418500000000001 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.098014+0000", 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014409700000000001 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109464+0000", 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011450431 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109504+0000", 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0439999999999999e-05 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109537+0000", 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2147000000000002e-05 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109574+0000", 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7540999999999999e-05 2024-04-26T12:15:35.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71825 5.4 5:2c7e5216:::benchmark_data_smithi069_31227_object71824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3449886450000008, 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020667386999999999, 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.507 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71825 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088992+0000", 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089039+0000", 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6616000000000002e-05 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089044+0000", 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7400000000000004e-06 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089047+0000", 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099399+0000", 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010351931 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099490+0000", 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1699000000000004e-05 2024-04-26T12:15:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099596+0000", 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106051 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109607+0000", 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010010544999999999 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109612+0000", 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:15:35.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109639+0000", 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6974e-05 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109660+0000", 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1109999999999999e-05 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3424797129999995, 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71833 5.4 5:2835a1f7:::benchmark_data_smithi069_31227_object71832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.3405434389999993, 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019580810000000001, 2024-04-26T12:15:35.518 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71833 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093437+0000", 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093543+0000", 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010636 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093556+0000", 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2203e-05 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093563+0000", 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5660000000000001e-06 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106409+0000", 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012845663 2024-04-26T12:15:35.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106527+0000", 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011846200000000001 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106611+0000", 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3460000000000004e-05 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112920+0000", 2024-04-26T12:15:35.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063096740000000004 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112935+0000", 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4729000000000001e-05 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112986+0000", 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0796e-05 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.113019+0000", 2024-04-26T12:15:35.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.277e-05 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75770 5.0 5:0750049a:::benchmark_data_smithi069_31227_object75769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.8261325169999996, 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020158269999999999, 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.524 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75770 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607848+0000", 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607883+0000", 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4894999999999997e-05 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607890+0000", 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1350000000000003e-06 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607896+0000", 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614168+0000", 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062712499999999999 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614289+0000", 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012123100000000001 2024-04-26T12:15:35.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614416+0000", 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012734700000000001 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.618384+0000", 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039681810000000003 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627925+0000", 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095406540000000008 2024-04-26T12:15:35.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627973+0000", 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7621999999999999e-05 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.628007+0000", 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4455999999999997e-05 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.529 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75783 5.0 5:0b5f41ff:::benchmark_data_smithi069_31227_object75782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.8207934650000004, 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019750569999999999, 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75783 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613187+0000", 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613283+0000", 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5416999999999998e-05 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613288+0000", 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0050000000000004e-06 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613291+0000", 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4060000000000001e-06 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626275+0000", 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012983552000000001 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626363+0000", 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7960999999999994e-05 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626451+0000", 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8518999999999997e-05 2024-04-26T12:15:35.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.630586+0000", 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041342460000000003 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632862+0000", 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022765929999999999 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632903+0000", 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0847999999999999e-05 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632938+0000", 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5451000000000003e-05 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75931 5.9 5:9d52651e:::benchmark_data_smithi069_31227_object75930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.7589121720000005, 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020086336999999999, 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75931 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675068+0000", 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675133+0000", 2024-04-26T12:15:35.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4485000000000003e-05 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675142+0000", 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1800000000000002e-06 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675148+0000", 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7740000000000001e-06 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679709+0000", 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045611159999999996 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679820+0000", 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110567 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695076+0000", 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015256809 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695115+0000", 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8501999999999998e-05 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695155+0000", 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0553999999999998e-05 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:86632 5.0 5:06282ec4:::benchmark_data_smithi069_31227_object86631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:35.540 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.650338477, 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019377893, 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 86632 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:35.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783642+0000", 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783672+0000", 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0088000000000001e-05 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783679+0000", 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6359999999999997e-06 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783684+0000", 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5740000000000003e-06 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.788843+0000", 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051585809999999998 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.789004+0000", 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016137700000000001 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.789147+0000", 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014224800000000001 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.794502+0000", 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005355233 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.802942+0000", 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084403240000000008 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.802991+0000", 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9008000000000002e-05 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.803021+0000", 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9470000000000001e-05 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:95282 5.0 5:09d695a8:::benchmark_data_smithi069_31227_object95281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:35.123192+0000", 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.31078913699999999, 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019376659000000001, 2024-04-26T12:15:35.546 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 95282 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.123192+0000", 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.123192+0000", 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.123192+0000", 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.123292+0000", 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9967e-05 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.123297+0000", 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3190000000000002e-06 2024-04-26T12:15:35.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.123301+0000", 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1819999999999999e-06 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.125221+0000", 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001919685 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.125362+0000", 2024-04-26T12:15:35.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014118900000000001 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.125506+0000", 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143669 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.128433+0000", 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029272109999999999 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.142497+0000", 2024-04-26T12:15:35.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.014064676 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.142534+0000", 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6245000000000003e-05 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:35.142569+0000", 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5108999999999999e-05 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:35.554 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:35.554 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:35.555 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:35.553+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:35.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:35.655 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:35.654+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:35.715 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:35.715 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:35.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:96801 5.a 5:517f4a4b:::benchmark_data_smithi069_31227_object96800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.707279+0000", 2024-04-26T12:15:35.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0067568769999999997, 2024-04-26T12:15:35.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067765430000000003, 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 96801 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.707279+0000", 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.707279+0000", 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.707278+0000", 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.707374+0000", 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6007000000000004e-05 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.707397+0000", 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3059999999999999e-05 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.707404+0000", 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.708953+0000", 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001549145 2024-04-26T12:15:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.709069+0000", 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115637 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.709205+0000", 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013608500000000001 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:35.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711287+0000", 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020817219999999998 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:96805 5.c 5:37524d48:::benchmark_data_smithi069_31227_object96804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.710242+0000", 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0037937169999999998, 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003861972, 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:35.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 96805 2024-04-26T12:15:35.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710242+0000", 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710242+0000", 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710240+0000", 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710335+0000", 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4773999999999998e-05 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710348+0000", 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2743e-05 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710355+0000", 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1180000000000003e-06 2024-04-26T12:15:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710389+0000", 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3470000000000003e-05 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.710484+0000", 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5786999999999996e-05 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:96797 5.4 e29/16 5:29bd2e5a:::benchmark_data_smithi069_31227_object96796:head v 29'6043, mlcod=29'6039)", 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.711782+0000", 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022529949999999998, 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023645979999999999, 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711782+0000", 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711782+0000", 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711782+0000", 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711844+0000", 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2169999999999996e-05 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711850+0000", 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711853+0000", 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0970000000000002e-06 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711884+0000", 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1288999999999998e-05 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.711902+0000", 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7907e-05 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:96807 5.5 5:a6c52cb8:::benchmark_data_smithi069_31227_object96806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.712312+0000", 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001723484, 2024-04-26T12:15:35.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018965659999999999, 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 96807 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712312+0000", 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712312+0000", 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712311+0000", 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712418+0000", 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106495 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712427+0000", 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6930000000000002e-06 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712432+0000", 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4870000000000004e-06 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712476+0000", 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190999999999998e-05 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.712584+0000", 2024-04-26T12:15:35.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001078 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:96808 5.b e29/16 5:dafe90ad:::benchmark_data_smithi069_31227_object96807:head v 29'6101, mlcod=29'6098)", 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.713094+0000", 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00094145399999999999, 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001181739, 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713094+0000", 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713094+0000", 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713094+0000", 2024-04-26T12:15:35.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713134+0000", 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0315000000000003e-05 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713141+0000", 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9380000000000003e-06 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713145+0000", 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5159999999999996e-06 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713197+0000", 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1724000000000001e-05 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713214+0000", 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6847e-05 2024-04-26T12:15:35.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:96811 5.c 5:387b82af:::benchmark_data_smithi069_31227_object96810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.713045+0000", 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00099066499999999995, 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001292465, 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:35.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 96811 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713045+0000", 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713045+0000", 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713044+0000", 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713250+0000", 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020633500000000001 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713259+0000", 2024-04-26T12:15:35.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3469999999999999e-06 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713266+0000", 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2930000000000003e-06 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713853+0000", 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058693799999999996 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.713979+0000", 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126468 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:96816 5.1 5:8eb57596:::benchmark_data_smithi069_31227_object96815:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.714097+0000", 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999385, 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000287559, 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 96816 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714097+0000", 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714097+0000", 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714096+0000", 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714180+0000", 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3405000000000005e-05 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714190+0000", 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0033e-05 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714196+0000", 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5869999999999998e-06 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714237+0000", 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0379000000000001e-05 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714367+0000", 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001305 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:96809 5.e e29/16 5:7ed0014b:::benchmark_data_smithi069_31227_object96808:head v 29'6081, mlcod=29'6078)", 2024-04-26T12:15:35.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.714177+0000", 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998584, 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024531999999999999, 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714177+0000", 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714177+0000", 2024-04-26T12:15:35.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714176+0000", 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714226+0000", 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9552000000000003e-05 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714236+0000", 2024-04-26T12:15:35.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0726e-05 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714243+0000", 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3640000000000004e-06 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714292+0000", 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9225999999999999e-05 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:35.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714311+0000", 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8831e-05 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:96812 5.4 e29/16)", 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:35.714255+0000", 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997802, 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000194568, 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714255+0000", 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714255+0000", 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714255+0000", 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714319+0000", 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3876999999999998e-05 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714326+0000", 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:35.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:35.714331+0000", 2024-04-26T12:15:35.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9389999999999996e-06 2024-04-26T12:15:35.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:35.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:35.754 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:35.754 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 9 2024-04-26T12:15:35.754 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:35.756 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:15:35.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:35.757 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 31 16 96921 96905 195.357 162 0.00408771 0.00511636 2024-04-26T12:15:35.758 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:35.756+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:35.858 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:35.857+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:35.913 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:35.913 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:35.914 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:35.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:35.971 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:35.969+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:36.060 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:36.057+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:36.081 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:36.081 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.873037564000001, 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:36.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.870212581000001, 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:36.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.377704487999999, 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.334974541999999, 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:36.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:36.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:71627 5.c 5:340fc5a4:::benchmark_data_smithi069_31227_object71626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.065552834, 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016704157000000001, 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 71627 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013914+0000", 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013913+0000", 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013971+0000", 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8498000000000001e-05 2024-04-26T12:15:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.013997+0000", 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5945e-05 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.014004+0000", 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021720+0000", 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077157399999999996 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.021830+0000", 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110135 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030482+0000", 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086519070000000003 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030540+0000", 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7843999999999997e-05 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.030618+0000", 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7930999999999996e-05 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72168 5.c 5:3a3f218e:::benchmark_data_smithi069_31227_object72167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8486045210000004, 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016793069000000001, 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72168 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230862+0000", 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230861+0000", 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230969+0000", 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107705 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230980+0000", 2024-04-26T12:15:36.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1221e-05 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230988+0000", 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1259999999999998e-06 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235726+0000", 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047381380000000002 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.235808+0000", 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1499e-05 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247498+0000", 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011690459 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247583+0000", 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5167000000000006e-05 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247655+0000", 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1596999999999999e-05 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72169 5.c 5:32a9709f:::benchmark_data_smithi069_31227_object72168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8484701030000004, 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016774866999999999, 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72169 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.230996+0000", 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231031+0000", 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5289e-05 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231039+0000", 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3059999999999998e-06 2024-04-26T12:15:36.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.231050+0000", 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237587+0000", 2024-04-26T12:15:36.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006536338 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.237748+0000", 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016125100000000001 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247665+0000", 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009917136 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247710+0000", 2024-04-26T12:15:36.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641999999999997e-05 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.247771+0000", 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1616000000000001e-05 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8461975240000008, 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:36.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:36.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:36.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8454678139999992, 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:36.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6923496510000007, 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6889212300000001, 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:36.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:36.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:36.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:36.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6126602979999998, 2024-04-26T12:15:36.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6125274520000001, 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5821237569999997, 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:85029 5.e e28/16 5:79e939cf:::benchmark_data_smithi069_31227_object85028:head v 28'5366, mlcod=28'5362)", 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.905467163, 2024-04-26T12:15:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016734427, 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.173999+0000", 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174068+0000", 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9467000000000004e-05 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174079+0000", 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1226000000000001e-05 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.174086+0000", 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1800000000000001e-06 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.176343+0000", 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022574750000000001 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.176363+0000", 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.963e-05 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.190668+0000", 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014305605000000001 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.190734+0000", 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5467000000000002e-05 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8849340850000003, 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8607774580000003, 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:94068 5.4 e29/16 5:212207bf:::benchmark_data_smithi069_31227_object94067:head v 29'5879, mlcod=29'5877)", 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4309882890000001, 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017212221999999999, 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648531+0000", 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3179e-05 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648538+0000", 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9160000000000004e-06 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648542+0000", 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4479999999999996e-06 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648592+0000", 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0154000000000001e-05 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648611+0000", 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8216999999999999e-05 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665631+0000", 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017019875 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665690+0000", 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789e-05 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94071 5.c 5:3ba5dc03:::benchmark_data_smithi069_31227_object94070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.648678+0000", 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.430788006, 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016756857999999999, 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94071 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648678+0000", 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648678+0000", 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648678+0000", 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648842+0000", 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164489 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648850+0000", 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2749999999999995e-06 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648856+0000", 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000003e-06 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648910+0000", 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3816000000000001e-05 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.649001+0000", 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1080000000000002e-05 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665262+0000", 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016261330000000001 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665366+0000", 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103317 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665435+0000", 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9567999999999995e-05 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94173 5.a 5:54be2579:::benchmark_data_smithi069_31227_object94172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.388466472, 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017270364, 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94173 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.690999+0000", 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691028+0000", 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8328999999999999e-05 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691035+0000", 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691041+0000", 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.695986+0000", 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049451989999999999 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696166+0000", 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017971799999999999 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696321+0000", 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154876 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.704730+0000", 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084090209999999992 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708169+0000", 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003439302 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708234+0000", 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5157e-05 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708270+0000", 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6322000000000002e-05 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:36.184 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:36.186 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:36.186 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:36.184+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:36.286 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:36.284+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98441 5.8 5:18a7f790:::benchmark_data_smithi069_31227_object98440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.328399+0000", 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0054056759999999999, 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054329360000000002, 2024-04-26T12:15:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98441 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.328399+0000", 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.328399+0000", 2024-04-26T12:15:36.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.328398+0000", 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.328452+0000", 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.328462+0000", 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9909999999999997e-06 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.328468+0000", 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.329656+0000", 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001187759 2024-04-26T12:15:36.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.329775+0000", 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118783 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.329909+0000", 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013453599999999999 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98443 5.9 5:965dea00:::benchmark_data_smithi069_31227_object98442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.330016+0000", 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037889260000000002, 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039029020000000002, 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98443 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330016+0000", 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330016+0000", 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330015+0000", 2024-04-26T12:15:36.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330072+0000", 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6493999999999998e-05 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330082+0000", 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7489999999999993e-06 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330092+0000", 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8719999999999997e-06 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330176+0000", 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4211999999999999e-05 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330307+0000", 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013152300000000001 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.344 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:98425 5.b e30/16)", 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.330070+0000", 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037349599999999998, 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039165210000000001, 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330070+0000", 2024-04-26T12:15:36.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330070+0000", 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330069+0000", 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330074+0000", 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8489999999999997e-06 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330086+0000", 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1711e-05 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330093+0000", 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9809999999999997e-06 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98445 5.9 5:9fab5794:::benchmark_data_smithi069_31227_object98444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.330109+0000", 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0036962570000000001, 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00391005, 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98445 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330109+0000", 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330109+0000", 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330108+0000", 2024-04-26T12:15:36.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330165+0000", 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7021999999999997e-05 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330175+0000", 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.026e-05 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330182+0000", 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4330000000000001e-06 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.332556+0000", 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023741830000000002 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.332698+0000", 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014221599999999999 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.353 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:98430 5.b e30/16)", 2024-04-26T12:15:36.353 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.330401+0000", 2024-04-26T12:15:36.353 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034037619999999998, 2024-04-26T12:15:36.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036511870000000002, 2024-04-26T12:15:36.353 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.353 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330401+0000", 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330401+0000", 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330401+0000", 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330404+0000", 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3689999999999998e-06 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330412+0000", 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6079999999999998e-06 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330417+0000", 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2900000000000002e-06 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98450 5.8 5:1a785982:::benchmark_data_smithi069_31227_object98449:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.331350+0000", 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024550969999999998, 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027408990000000002, 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.356 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98450 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331350+0000", 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331350+0000", 2024-04-26T12:15:36.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331349+0000", 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331407+0000", 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8186999999999997e-05 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331421+0000", 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.383e-05 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331429+0000", 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3599999999999996e-06 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331798+0000", 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00036927100000000001 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331915+0000", 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116792 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.332065+0000", 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000150116 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98451 5.e 5:7630c7df:::benchmark_data_smithi069_31227_object98450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.331626+0000", 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021785239999999998, 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025033799999999999, 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98451 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331626+0000", 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331626+0000", 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331626+0000", 2024-04-26T12:15:36.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331706+0000", 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0585000000000002e-05 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331728+0000", 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.194e-05 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331736+0000", 2024-04-26T12:15:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6290000000000001e-06 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331781+0000", 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4688999999999999e-05 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.331919+0000", 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000138761 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.332065+0000", 2024-04-26T12:15:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014596999999999999 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98454 5.b 5.d27968fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.333469+0000", 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00033594799999999998, 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00071490499999999995, 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98454 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333469+0000", 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333469+0000", 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333468+0000", 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333541+0000", 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3088000000000002e-05 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333557+0000", 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6319000000000001e-05 2024-04-26T12:15:36.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333565+0000", 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7109999999999995e-06 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98455 5.4 5:273beaaa:::benchmark_data_smithi069_31227_object98454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.333575+0000", 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00023011700000000001, 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00066812399999999997, 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.368 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98455 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333575+0000", 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333575+0000", 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333574+0000", 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333599+0000", 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5023000000000001e-05 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333605+0000", 2024-04-26T12:15:36.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1879999999999999e-06 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333611+0000", 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3630000000000002e-06 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333656+0000", 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4873999999999998e-05 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333784+0000", 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000128119 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.333866+0000", 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2156000000000004e-05 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:98441 5.8 e30/16 ondisk, result = 0)", 2024-04-26T12:15:36.372 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.334242+0000", 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995627, 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0069999999999997e-05, 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334242+0000", 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334242+0000", 2024-04-26T12:15:36.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334241+0000", 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334249+0000", 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9179999999999994e-06 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334258+0000", 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6659999999999997e-06 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334262+0000", 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5159999999999996e-06 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334294+0000", 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1498999999999998e-05 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.334301+0000", 2024-04-26T12:15:36.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7100000000000001e-06 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98425 5.b 5:d5799684:::benchmark_data_smithi069_31227_object98424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.322692+0000", 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.011112798, 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011699147999999999, 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98425 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322692+0000", 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322692+0000", 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322691+0000", 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322727+0000", 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5845e-05 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322738+0000", 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0740000000000001e-05 2024-04-26T12:15:36.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322744+0000", 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322799+0000", 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4781000000000003e-05 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.322916+0000", 2024-04-26T12:15:36.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011714000000000001 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.323029+0000", 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112929 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98430 5.b 5:da6bdeb5:::benchmark_data_smithi069_31227_object98429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.324448+0000", 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.009356662, 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0099903230000000006, 2024-04-26T12:15:36.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98430 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.324448+0000", 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.324448+0000", 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.324448+0000", 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.324504+0000", 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6569e-05 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.324514+0000", 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8539999999999992e-06 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.324522+0000", 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3459999999999994e-06 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326781+0000", 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022587430000000001 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326910+0000", 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012889299999999999 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.327049+0000", 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013855000000000001 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98432 5.b 5:df395bda:::benchmark_data_smithi069_31227_object98431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.325710+0000", 2024-04-26T12:15:36.384 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0080952909999999993, 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087768610000000004, 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98432 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.325710+0000", 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.325710+0000", 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.325709+0000", 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.325780+0000", 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1536000000000001e-05 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.325793+0000", 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2692e-05 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.325801+0000", 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2870000000000004e-06 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.329840+0000", 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040386409999999999 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.329963+0000", 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012349400000000001 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.330162+0000", 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019879199999999999 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98436 5.b 5:d1f5b5f8:::benchmark_data_smithi069_31227_object98435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.388 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.326529+0000", 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0072763849999999998, 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080299280000000004, 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98436 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326529+0000", 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326529+0000", 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326528+0000", 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326607+0000", 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9240999999999996e-05 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326618+0000", 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0560999999999999e-05 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.326625+0000", 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.332261+0000", 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056353169999999999 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.332399+0000", 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000138665 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.332495+0000", 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5530000000000002e-05 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 14 2024-04-26T12:15:36.392 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:36.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:36.394 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:36.392+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:36.495 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:36.492+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:36.579 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:36.580 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:36.580 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:36.580 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:36.580 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:36.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:36.595 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:36.593+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:36.616 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:36.696 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:36.695+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39741 5.8 5:1e957f7d:::benchmark_data_smithi069_31227_object39740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:36.708 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.182252101, 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019483252, 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39741 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523785+0000", 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523784+0000", 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523854+0000", 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9115000000000005e-05 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523863+0000", 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523869+0000", 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9020000000000004e-06 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529329+0000", 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054605189999999996 2024-04-26T12:15:36.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529460+0000", 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013030299999999999 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.529532+0000", 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2584999999999997e-05 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536940+0000", 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074074329999999997 2024-04-26T12:15:36.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543183+0000", 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006243373 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543231+0000", 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7765000000000001e-05 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543268+0000", 2024-04-26T12:15:36.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7533000000000001e-05 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:39742 5.8 5:107232eb:::benchmark_data_smithi069_31227_object39741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.182163256999999, 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019479018000000001, 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.714 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 39742 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523874+0000", 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523902+0000", 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8458000000000001e-05 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523908+0000", 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4459999999999998e-06 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.523912+0000", 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532408+0000", 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084965990000000005 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532495+0000", 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6898999999999996e-05 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.532571+0000", 2024-04-26T12:15:36.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5972999999999999e-05 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.536977+0000", 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044060180000000003 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543281+0000", 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063039180000000004 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543320+0000", 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9239999999999997e-05 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.543353+0000", 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2558999999999998e-05 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:36.719 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.056569397000001, 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:36.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40123 5.0 5:0918bf91:::benchmark_data_smithi069_31227_object40122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.054123288, 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019741399, 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40123 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651914+0000", 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651913+0000", 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651975+0000", 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2409000000000005e-05 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651987+0000", 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1379999999999999e-05 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.651993+0000", 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661159+0000", 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091653800000000007 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661286+0000", 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012764699999999999 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.661419+0000", 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132717 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663980+0000", 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025608499999999999 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671566+0000", 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075856029999999998 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671623+0000", 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7673999999999997e-05 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.671655+0000", 2024-04-26T12:15:36.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2069000000000001e-05 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.647970674, 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:36.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.406031714999999, 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:36.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:36.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:36.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:36.740 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.405527226, 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64629 5.0 5:02f7d0fe:::benchmark_data_smithi069_31227_object64628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:36.746 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.405218094, 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021120738, 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64629 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300912+0000", 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3806000000000003e-05 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300923+0000", 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300930+0000", 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311469+0000", 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010538659000000001 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311584+0000", 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011458700000000001 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014452900000000001 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321119+0000", 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093907230000000001 2024-04-26T12:15:36.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321864+0000", 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00074479199999999998 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321905+0000", 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1192000000000001e-05 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321940+0000", 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5024000000000002e-05 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.751 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71822 5.4 5:20b40e6f:::benchmark_data_smithi069_31227_object71821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.617196138000001, 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020733079000000001, 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71822 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.752 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088907+0000", 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6464000000000006e-05 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088912+0000", 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7299999999999996e-06 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088916+0000", 2024-04-26T12:15:36.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0790000000000002e-06 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097755+0000", 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008839286 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097869+0000", 2024-04-26T12:15:36.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011418500000000001 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.098014+0000", 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014409700000000001 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109464+0000", 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011450431 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109504+0000", 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0439999999999999e-05 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109537+0000", 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2147000000000002e-05 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109574+0000", 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7540999999999999e-05 2024-04-26T12:15:36.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71825 5.4 5:2c7e5216:::benchmark_data_smithi069_31227_object71824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.617044516, 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020667386999999999, 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.758 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71825 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:36.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088992+0000", 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089039+0000", 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6616000000000002e-05 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089044+0000", 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7400000000000004e-06 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089047+0000", 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099399+0000", 2024-04-26T12:15:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010351931 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099490+0000", 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1699000000000004e-05 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099596+0000", 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106051 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109607+0000", 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010010544999999999 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109612+0000", 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109639+0000", 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6974e-05 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109660+0000", 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1109999999999999e-05 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.614535584, 2024-04-26T12:15:36.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71833 5.4 5:2835a1f7:::benchmark_data_smithi069_31227_object71832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.61259931, 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019580810000000001, 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.770 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71833 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093438+0000", 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093437+0000", 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093543+0000", 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010636 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093556+0000", 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2203e-05 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.093563+0000", 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5660000000000001e-06 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106409+0000", 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012845663 2024-04-26T12:15:36.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106527+0000", 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011846200000000001 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.106611+0000", 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3460000000000004e-05 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112920+0000", 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063096740000000004 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112935+0000", 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4729000000000001e-05 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112986+0000", 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0796e-05 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.113019+0000", 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.277e-05 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75770 5.0 5:0750049a:::benchmark_data_smithi069_31227_object75769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0981883880000005, 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020158269999999999, 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.776 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75770 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607849+0000", 2024-04-26T12:15:36.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607848+0000", 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607883+0000", 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4894999999999997e-05 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607890+0000", 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1350000000000003e-06 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.607896+0000", 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614168+0000", 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0062712499999999999 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614289+0000", 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012123100000000001 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.614416+0000", 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012734700000000001 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.618384+0000", 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039681810000000003 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627925+0000", 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095406540000000008 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.627973+0000", 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7621999999999999e-05 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.628007+0000", 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4455999999999997e-05 2024-04-26T12:15:36.781 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75783 5.0 5:0b5f41ff:::benchmark_data_smithi069_31227_object75782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0928493360000004, 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019750569999999999, 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.782 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75783 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613188+0000", 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613187+0000", 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613283+0000", 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5416999999999998e-05 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613288+0000", 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0050000000000004e-06 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.613291+0000", 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4060000000000001e-06 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626275+0000", 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012983552000000001 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626363+0000", 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7960999999999994e-05 2024-04-26T12:15:36.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.626451+0000", 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8518999999999997e-05 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.630586+0000", 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041342460000000003 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632862+0000", 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022765929999999999 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632903+0000", 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0847999999999999e-05 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.632938+0000", 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5451000000000003e-05 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.787 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:75931 5.9 5:9d52651e:::benchmark_data_smithi069_31227_object75930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0309680429999997, 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020086336999999999, 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.788 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 75931 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675069+0000", 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675068+0000", 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675133+0000", 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4485000000000003e-05 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675142+0000", 2024-04-26T12:15:36.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1800000000000002e-06 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.675148+0000", 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7740000000000001e-06 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679709+0000", 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045611159999999996 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.679820+0000", 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110567 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695076+0000", 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015256809 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695115+0000", 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8501999999999998e-05 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:27.695155+0000", 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0553999999999998e-05 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:86632 5.0 5:06282ec4:::benchmark_data_smithi069_31227_object86631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.9223943480000001, 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019377893, 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.793 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 86632 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783643+0000", 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783642+0000", 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783672+0000", 2024-04-26T12:15:36.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0088000000000001e-05 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783679+0000", 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6359999999999997e-06 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.783684+0000", 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5740000000000003e-06 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.788843+0000", 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051585809999999998 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.789004+0000", 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016137700000000001 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.789147+0000", 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014224800000000001 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.794502+0000", 2024-04-26T12:15:36.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005355233 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.802942+0000", 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084403240000000008 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.802991+0000", 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9008000000000002e-05 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:31.803021+0000", 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9470000000000001e-05 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.262324738, 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.799 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:36.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:36.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98789 5.8 5:130e01ea:::benchmark_data_smithi069_31227_object98788:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.450844+0000", 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.25519323999999999, 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020678021000000001, 2024-04-26T12:15:36.805 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98789 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450844+0000", 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450844+0000", 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450843+0000", 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450942+0000", 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9183000000000002e-05 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450954+0000", 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450960+0000", 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461698+0000", 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010737202 2024-04-26T12:15:36.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461791+0000", 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3157000000000003e-05 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461947+0000", 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015671899999999999 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466605+0000", 2024-04-26T12:15:36.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046571939999999999 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.471432+0000", 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048272150000000002 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.471480+0000", 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8593e-05 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.471522+0000", 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1588000000000002e-05 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98793 5.8 5:157a8c53:::benchmark_data_smithi069_31227_object98792:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.454139+0000", 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.251898609, 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020065100999999998, 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.811 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98793 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454139+0000", 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454139+0000", 2024-04-26T12:15:36.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454138+0000", 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454199+0000", 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1177000000000001e-05 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454206+0000", 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0520000000000004e-06 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454211+0000", 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.464106+0000", 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098951950000000007 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.464246+0000", 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013977400000000001 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.464387+0000", 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014139900000000001 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.471375+0000", 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069881279999999997 2024-04-26T12:15:36.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.474126+0000", 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027511419999999998 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.474173+0000", 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6573000000000003e-05 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.474204+0000", 2024-04-26T12:15:36.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0905000000000003e-05 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98897 5.8 5:14a2d0e0:::benchmark_data_smithi069_31227_object98896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.495221+0000", 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.21081636300000001, 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.019537756999999999, 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:36.817 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98897 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.495221+0000", 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.495221+0000", 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:36.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.495220+0000", 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.495285+0000", 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5262e-05 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:36.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.495295+0000", 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3149999999999998e-06 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.495303+0000", 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7669999999999992e-06 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.500486+0000", 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051821999999999997 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.500605+0000", 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119548 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.500748+0000", 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000142416 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.507412+0000", 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066641570000000004 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.514685+0000", 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072735849999999999 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.514726+0000", 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0500000000000002e-05 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.514759+0000", 2024-04-26T12:15:36.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2710999999999999e-05 2024-04-26T12:15:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:36.823 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:36.823 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:36.824 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:36.825 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:36.825 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:36.825 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 32 16 99341 99325 193.979 151.25 0.00449546 0.00515227 2024-04-26T12:15:36.826 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:36.826 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:36.823+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:36.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:36.827 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:36.828 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:36.925 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:36.924+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:36.978 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:36.979 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:36.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:37.025 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:37.024+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:37.126 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:37.125+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:37.148 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:37.148 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:37.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:37.228 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:37.226+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:37.319 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:37.319 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:37.328 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:37.327+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:37.333 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:37.429 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:37.427+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:37.477 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:37.477 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:37.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:37.530 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:37.528+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:37.631 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:37.629+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:37.635 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:37.635 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:37.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:37.732 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:37.731+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:37.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 33 16 101969 101953 193.077 164.25 0.00346641 0.00517681 2024-04-26T12:15:37.758 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:15:37.794 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:37.795 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:37.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:37.851 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:37.850+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:37.936 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:37.933+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:37.962 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:37.963 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:37.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:38.060 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:38.059+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:38.136 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:38.135+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:38.168 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:38.168 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:38.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:38.237 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:38.235+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:38.337 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:38.336+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:38.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-26T12:15:38.378 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:38.378 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:38.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:38.438 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:38.437+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:38.530 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:38.530 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:38.538 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:38.537+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:38.543 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:38.640 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:38.638+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:38.725 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:38.725 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:38.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:38.741 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:38.739+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:15:38.753 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 34 16 104500 104484 192.051 158.188 0.00423289 0.00520414 2024-04-26T12:15:38.829 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:38.841 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:38.840+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:38.876 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:38.876 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:38.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:38.942 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:38.941+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:38.958 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:38.958 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:38.958 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:38.978 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:38.978 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:38.981 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:38.981 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:39.042 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:105193 5.e e31/16 5:7b7539c7:::benchmark_data_smithi069_31227_object105192:head v 31'6619, mlcod=31'6614)", 2024-04-26T12:15:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.034473+0000", 2024-04-26T12:15:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0058843940000000003, 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059005969999999996, 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034473+0000", 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034473+0000", 2024-04-26T12:15:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034472+0000", 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034582+0000", 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110369 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034592+0000", 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6390000000000004e-06 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034598+0000", 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.035035+0000", 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043736799999999999 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.035055+0000", 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9856000000000001e-05 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105205 5.6 5.8909b936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.036181+0000", 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0041755450000000001, 2024-04-26T12:15:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042349730000000004, 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105205 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036181+0000", 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036181+0000", 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036181+0000", 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036258+0000", 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7211000000000003e-05 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036273+0000", 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036279+0000", 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8900000000000001e-06 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:105196 5.e e31/16 5:79a787ba:::benchmark_data_smithi069_31227_object105195:head v 31'6620, mlcod=31'6615)", 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.036300+0000", 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040573750000000002, 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00414869, 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036300+0000", 2024-04-26T12:15:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036300+0000", 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036299+0000", 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036332+0000", 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3596000000000002e-05 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036343+0000", 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0336000000000001e-05 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036349+0000", 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2430000000000002e-06 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037061+0000", 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071156099999999999 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037087+0000", 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6440000000000001e-05 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105206 5.a 5:502ce354:::benchmark_data_smithi069_31227_object105205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.036920+0000", 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0034373609999999999, 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00356646, 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105206 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036920+0000", 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036920+0000", 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036919+0000", 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036977+0000", 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8400999999999999e-05 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036986+0000", 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3100000000000006e-06 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.036993+0000", 2024-04-26T12:15:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6649999999999997e-06 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037037+0000", 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4023999999999997e-05 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037142+0000", 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104826 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037277+0000", 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013526200000000001 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5.bb4f08f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0030450820000000002, 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003238604, 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105208 5.2 5:4bd11460:::benchmark_data_smithi069_31227_object105207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037408+0000", 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029492390000000002, 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003195809, 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105208 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037408+0000", 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037408+0000", 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037407+0000", 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037446+0000", 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8779999999999998e-05 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037456+0000", 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0149000000000001e-05 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037462+0000", 2024-04-26T12:15:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6030000000000004e-06 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038977+0000", 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00151486 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.039086+0000", 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109627 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5.67556826 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0028894490000000001, 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003196988, 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105211 5.a 5:5ed52a2f:::benchmark_data_smithi069_31227_object105210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037849+0000", 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002507909, 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002874218, 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105211 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037849+0000", 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037849+0000", 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037848+0000", 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037952+0000", 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010347400000000001 2024-04-26T12:15:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037962+0000", 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9990000000000003e-06 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037968+0000", 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0580000000000003e-06 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.039030+0000", 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001062024 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.039131+0000", 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101236 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.039227+0000", 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:105210 5.e e31/16 5:74afc76c:::benchmark_data_smithi069_31227_object105209:head v 31'6621, mlcod=31'6616)", 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.038162+0000", 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002195078, 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002632864, 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038162+0000", 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038162+0000", 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038156+0000", 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999948 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038216+0000", 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9772999999999998e-05 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038225+0000", 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8589999999999994e-06 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038229+0000", 2024-04-26T12:15:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2910000000000001e-06 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.039051+0000", 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082167999999999998 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.039068+0000", 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6926999999999999e-05 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:105214 5.8 e31/16 5:1214c31c:::benchmark_data_smithi069_31227_object105213:head v 31'6546, mlcod=31'6544)", 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.038706+0000", 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001650751, 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021425789999999999, 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038706+0000", 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038706+0000", 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038706+0000", 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038766+0000", 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0520999999999999e-05 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038773+0000", 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.002e-06 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038777+0000", 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5580000000000001e-06 2024-04-26T12:15:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038818+0000", 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1004000000000002e-05 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.038838+0000", 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0100000000000001e-05 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105198 5.6 5:69ff23d8:::benchmark_data_smithi069_31227_object105197:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.032979+0000", 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0073777970000000002, 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079262840000000005, 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105198 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.032979+0000", 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.032979+0000", 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.032978+0000", 2024-04-26T12:15:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.033047+0000", 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8873000000000003e-05 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.033058+0000", 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0916e-05 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.033065+0000", 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.033306+0000", 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024099200000000001 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.033465+0000", 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159347 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105201 5.6 5:6a0a64b8:::benchmark_data_smithi069_31227_object105200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.034250+0000", 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0061066380000000002, 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067265880000000004, 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105201 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034250+0000", 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034250+0000", 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034250+0000", 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034293+0000", 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3677999999999998e-05 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034303+0000", 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.034311+0000", 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5480000000000004e-06 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037048+0000", 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027374949999999999 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037138+0000", 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9526999999999999e-05 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 12 2024-04-26T12:15:39.090 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:39.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:39.092 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:39.090+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:39.192 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:39.191+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:39.245 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:39.245 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:39.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:39.304 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:39.303+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:39.395 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:39.393+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:39.411 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:39.411 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:39.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:39.411 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:39.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.411 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:39.411 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.201683939999999, 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:39.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:39.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.198858956999999, 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:39.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.706350864000001, 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.663620917999999, 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.174843900000001, 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.174114189999999, 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:39.443 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.020996027000001, 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.017567606, 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.941306674, 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.941173828, 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.910770133, 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.2135804609999994, 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.1894238339999994, 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:94068 5.4 e29/16 5:212207bf:::benchmark_data_smithi069_31227_object94067:head v 29'5879, mlcod=29'5877)", 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7596346650000001, 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017212221999999999, 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648531+0000", 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3179e-05 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648538+0000", 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9160000000000004e-06 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648542+0000", 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4479999999999996e-06 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648592+0000", 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0154000000000001e-05 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648611+0000", 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8216999999999999e-05 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665631+0000", 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017019875 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665690+0000", 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789e-05 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94173 5.a 5:54be2579:::benchmark_data_smithi069_31227_object94172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7171128480000002, 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017270364, 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94173 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.690999+0000", 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691028+0000", 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8328999999999999e-05 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691035+0000", 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691041+0000", 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.695986+0000", 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049451989999999999 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696166+0000", 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017971799999999999 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696321+0000", 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154876 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.704730+0000", 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084090209999999992 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708169+0000", 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003439302 2024-04-26T12:15:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708234+0000", 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5157e-05 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708270+0000", 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6322000000000002e-05 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.7750583679999998, 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.37080091100000001, 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.37064527800000002, 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105215 5.6 5:656a38e4:::benchmark_data_smithi069_31227_object105214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.040962+0000", 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.36715116199999998, 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016847715999999999, 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105215 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.040962+0000", 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.040962+0000", 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.040961+0000", 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.041025+0000", 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4886000000000002e-05 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.041042+0000", 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6439e-05 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.041049+0000", 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8009999999999998e-06 2024-04-26T12:15:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.047621+0000", 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065721540000000002 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.047732+0000", 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110814 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057734+0000", 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010002024 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057758+0000", 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057809+0000", 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1311999999999999e-05 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.114804721, 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:39.518 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:39.519 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:39.520 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:39.518+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:39.620 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:39.619+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:39.667 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:106761 5.4 e31/16)", 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.662736+0000", 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003357236, 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033745089999999999, 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662736+0000", 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662736+0000", 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662736+0000", 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662740+0000", 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.805e-06 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662746+0000", 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8199999999999999e-06 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662751+0000", 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7430000000000002e-06 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.670 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106785 5.0 5:06730010:::benchmark_data_smithi069_31227_object106784:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.662767+0000", 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033264280000000002, 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034054519999999998, 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.671 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106785 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662767+0000", 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662767+0000", 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662767+0000", 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662811+0000", 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4267999999999997e-05 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662821+0000", 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9029999999999999e-06 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662827+0000", 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1290000000000001e-06 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665915+0000", 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030881950000000002 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.666041+0000", 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012606 2024-04-26T12:15:39.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.666174+0000", 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013242500000000001 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106790 5.8 5:161ec0bb:::benchmark_data_smithi069_31227_object106789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.665404+0000", 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00068961000000000001, 2024-04-26T12:15:39.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085033400000000001, 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106790 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665404+0000", 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665404+0000", 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665403+0000", 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665476+0000", 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3574999999999999e-05 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665490+0000", 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4323e-05 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665498+0000", 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3459999999999996e-06 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665939+0000", 2024-04-26T12:15:39.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000441008 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.666024+0000", 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5121e-05 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.666101+0000", 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7507000000000002e-05 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106791 5.9 5:91b283e2:::benchmark_data_smithi069_31227_object106790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.665600+0000", 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00049419500000000001, 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00073123700000000003, 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106791 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665600+0000", 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665600+0000", 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665599+0000", 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665678+0000", 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9584000000000002e-05 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665687+0000", 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.473e-06 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665692+0000", 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.361e-06 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665738+0000", 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5584999999999998e-05 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665861+0000", 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012320399999999999 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106793 5.9 5.66037749 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.665953+0000", 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000141147, 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044334600000000001, 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106793 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665953+0000", 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665953+0000", 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665952+0000", 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.665998+0000", 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:15:39.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.666009+0000", 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0509999999999999e-05 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.666016+0000", 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8029999999999999e-06 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106761 5.4 5:200cfb28:::benchmark_data_smithi069_31227_object106760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.654937+0000", 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.011156741, 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011506413, 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106761 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.654937+0000", 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.654937+0000", 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.654936+0000", 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.654969+0000", 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2586999999999998e-05 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.654978+0000", 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2050000000000008e-06 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.654984+0000", 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7180000000000001e-06 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.659901+0000", 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049172340000000004 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.660008+0000", 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106482 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.660093+0000", 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5368e-05 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.691 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106769 5.4 5:28d8921d:::benchmark_data_smithi069_31227_object106768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.658569+0000", 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0075251500000000004, 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079312870000000004, 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106769 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658569+0000", 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658569+0000", 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658568+0000", 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658612+0000", 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4505000000000002e-05 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658629+0000", 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6901999999999998e-05 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658635+0000", 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8300000000000001e-06 2024-04-26T12:15:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662291+0000", 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036559449999999999 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662389+0000", 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8270999999999995e-05 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662505+0000", 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115547 2024-04-26T12:15:39.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106774 5.4 5:2a2a22c2:::benchmark_data_smithi069_31227_object106773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.658995+0000", 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0070987020000000001, 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075795519999999998, 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106774 2024-04-26T12:15:39.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658995+0000", 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658995+0000", 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.658994+0000", 2024-04-26T12:15:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.659059+0000", 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4119000000000001e-05 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.659067+0000", 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4430000000000003e-06 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.659073+0000", 2024-04-26T12:15:39.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9449999999999998e-06 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.664378+0000", 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00530467 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.664502+0000", 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012414199999999999 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:39.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.664682+0000", 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018032200000000001 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106778 5.0 5:0b2a5f5a:::benchmark_data_smithi069_31227_object106777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.661624+0000", 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0044696600000000003, 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005015228, 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.700 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106778 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661624+0000", 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661624+0000", 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661623+0000", 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661660+0000", 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6495000000000002e-05 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661670+0000", 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0624e-05 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661676+0000", 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4389999999999999e-06 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661722+0000", 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6282000000000002e-05 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661863+0000", 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014081099999999999 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.661988+0000", 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125573 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:106781 5.0 5:0c55927e:::benchmark_data_smithi069_31227_object106780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.662603+0000", 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034902539999999999, 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040798939999999997, 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:39.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 106781 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662603+0000", 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662603+0000", 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662590+0000", 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999871 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662651+0000", 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0557000000000003e-05 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662680+0000", 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9291000000000001e-05 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.662690+0000", 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7070000000000004e-06 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.663946+0000", 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012559299999999999 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.664091+0000", 2024-04-26T12:15:39.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145458 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.664246+0000", 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015506 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-26T12:15:39.708 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:39.709 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:39.721 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:39.720+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:39.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 35 16 107024 107008 191.071 157.75 0.0051157 0.00523103 2024-04-26T12:15:39.822 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:39.821+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:39.855 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:39.856 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:39.856 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:39.856 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:39.856 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:39.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:39.953 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:39.952+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:40.024 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:40.023+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:40.053 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:40.053 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:40.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:40.053 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:40117 5.0 5:0a45abfe:::benchmark_data_smithi069_31227_object40116:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.401488211, 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020395948000000001, 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 40117 2024-04-26T12:15:40.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649468+0000", 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649467+0000", 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649573+0000", 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105536 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649581+0000", 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.649597+0000", 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6189999999999999e-05 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658232+0000", 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086346870000000003 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658336+0000", 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103849 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.658458+0000", 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012194200000000001 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.663844+0000", 2024-04-26T12:15:40.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053868509999999998 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669790+0000", 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059455749999999998 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669831+0000", 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0751000000000003e-05 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:14.669864+0000", 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.992889487999999, 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:40.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:40.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.750950529000001, 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:40.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:40.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:40.072 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.75044604, 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:40.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:40.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.078 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64629 5.0 5:02f7d0fe:::benchmark_data_smithi069_31227_object64628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.750136908000002, 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021120738, 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.079 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64629 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300819+0000", 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300912+0000", 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3806000000000003e-05 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300923+0000", 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:40.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300930+0000", 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311469+0000", 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010538659000000001 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311584+0000", 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011458700000000001 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014452900000000001 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321119+0000", 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093907230000000001 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321864+0000", 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00074479199999999998 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321905+0000", 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1192000000000001e-05 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321940+0000", 2024-04-26T12:15:40.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5024000000000002e-05 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71822 5.4 5:20b40e6f:::benchmark_data_smithi069_31227_object71821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.962114952, 2024-04-26T12:15:40.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020733079000000001, 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71822 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088841+0000", 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088907+0000", 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6464000000000006e-05 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088912+0000", 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7299999999999996e-06 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088916+0000", 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0790000000000002e-06 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097755+0000", 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008839286 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.097869+0000", 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011418500000000001 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.098014+0000", 2024-04-26T12:15:40.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014409700000000001 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109464+0000", 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011450431 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109504+0000", 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0439999999999999e-05 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109537+0000", 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2147000000000002e-05 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109574+0000", 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7540999999999999e-05 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.091 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71825 5.4 5:2c7e5216:::benchmark_data_smithi069_31227_object71824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.96196333, 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020667386999999999, 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71825 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088993+0000", 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.088992+0000", 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089039+0000", 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6616000000000002e-05 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089044+0000", 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7400000000000004e-06 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.089047+0000", 2024-04-26T12:15:40.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099399+0000", 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010351931 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099490+0000", 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1699000000000004e-05 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.099596+0000", 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106051 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109607+0000", 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010010544999999999 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109612+0000", 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109639+0000", 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6974e-05 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109660+0000", 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1109999999999999e-05 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.097 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.959454398, 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:40.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:40.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:40.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6072435519999999, 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.104 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:40.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98789 5.8 5:130e01ea:::benchmark_data_smithi069_31227_object98788:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.450844+0000", 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.6001120540000002, 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.020678021000000001, 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98789 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450844+0000", 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450844+0000", 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450843+0000", 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450942+0000", 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9183000000000002e-05 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450954+0000", 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.450960+0000", 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461698+0000", 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010737202 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461791+0000", 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3157000000000003e-05 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461947+0000", 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015671899999999999 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466605+0000", 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046571939999999999 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.471432+0000", 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048272150000000002 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.471480+0000", 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8593e-05 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.471522+0000", 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1588000000000002e-05 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.115 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.417197029, 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:40.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:40.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:40.119 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.4160818609999999, 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.120 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.124 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.4158092770000001, 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:40.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:40.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.41454272, 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.131 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.4143352719999998, 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:40.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.140 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.4139097879999998, 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:40.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.4136388480000002, 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.146 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:40.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.4125648489999998, 2024-04-26T12:15:40.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:40.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:40.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:40.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.69506221000000001, 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.158 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:40.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:40.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:40.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.69482581899999996, 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:40.164 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:40.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:40.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:40.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:40.170 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:40.172 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:40.170+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:40.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:40.272 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:40.271+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:40.327 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108472 5.5 5:a31e14b2:::benchmark_data_smithi069_31227_object108471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.320560+0000", 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0049946349999999999, 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050243850000000001, 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108472 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320560+0000", 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320560+0000", 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320560+0000", 2024-04-26T12:15:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320589+0000", 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8688e-05 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320593+0000", 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2230000000000001e-06 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320596+0000", 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9000000000000002e-06 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320931+0000", 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033516200000000001 2024-04-26T12:15:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.321080+0000", 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149052 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108473 5.2 5:4b088c9b:::benchmark_data_smithi069_31227_object108472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.320601+0000", 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0049543460000000001, 2024-04-26T12:15:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050600230000000003, 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108473 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320601+0000", 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320601+0000", 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320600+0000", 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320653+0000", 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2227e-05 2024-04-26T12:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320657+0000", 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320661+0000", 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2509999999999999e-06 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323867+0000", 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032064039999999999 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323988+0000", 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120544 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108475 5.7 5:e905c3b7:::benchmark_data_smithi069_31227_object108474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.322433+0000", 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0031217369999999999, 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003297201, 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108475 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322433+0000", 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322433+0000", 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322433+0000", 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322513+0000", 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0487000000000004e-05 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322522+0000", 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5709999999999998e-06 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322528+0000", 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-04-26T12:15:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322573+0000", 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5009999999999998e-05 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322685+0000", 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112178 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108476 5.7 5:e6f5b925:::benchmark_data_smithi069_31227_object108475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.322544+0000", 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0030111769999999999, 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032412209999999999, 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108476 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322544+0000", 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322544+0000", 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322543+0000", 2024-04-26T12:15:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322581+0000", 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800999999999999e-05 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322588+0000", 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9240000000000001e-06 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.322593+0000", 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9429999999999999e-06 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324752+0000", 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021591819999999999 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324870+0000", 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117401 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108478 5.7 5.11a29c17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.323044+0000", 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0025113280000000002, 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002799799, 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108478 2024-04-26T12:15:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323044+0000", 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323044+0000", 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323043+0000", 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323095+0000", 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1418999999999997e-05 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323104+0000", 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7289999999999995e-06 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323110+0000", 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9449999999999998e-06 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108479 5.2 5.13f92402 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.323136+0000", 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002419142, 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027587660000000002, 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108479 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323136+0000", 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323136+0000", 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323135+0000", 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323192+0000", 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6385999999999999e-05 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323199+0000", 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6569999999999997e-06 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323204+0000", 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9080000000000003e-06 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:108477 5.4 e31/16 5:2f9dff1a:::benchmark_data_smithi069_31227_object108476:head v 31'6740, mlcod=31'6738)", 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.323381+0000", 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0021741289999999999, 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002553661, 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323381+0000", 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323381+0000", 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323380+0000", 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323412+0000", 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1588999999999999e-05 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323420+0000", 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1550000000000007e-06 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323427+0000", 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323485+0000", 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8016000000000002e-05 2024-04-26T12:15:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323498+0000", 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3179e-05 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108482 5.5 5:a75c4ba8:::benchmark_data_smithi069_31227_object108481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.323351+0000", 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022040290000000001, 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026495210000000002, 2024-04-26T12:15:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108482 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323351+0000", 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323351+0000", 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323350+0000", 2024-04-26T12:15:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323422+0000", 2024-04-26T12:15:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1626999999999997e-05 2024-04-26T12:15:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323431+0000", 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323437+0000", 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9610000000000002e-06 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323480+0000", 2024-04-26T12:15:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3896999999999997e-05 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323561+0000", 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0819e-05 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:108480 5.e e31/16 5:760e5231:::benchmark_data_smithi069_31227_object108479:head v 31'6840, mlcod=31'6837)", 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.323586+0000", 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001968895, 2024-04-26T12:15:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024826639999999999, 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323586+0000", 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323586+0000", 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323586+0000", 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323648+0000", 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2574000000000001e-05 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323657+0000", 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323662+0000", 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2750000000000003e-06 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323706+0000", 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3761999999999999e-05 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323721+0000", 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5330000000000001e-05 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:108470 5.a e31/16 ondisk, result = 0)", 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.324826+0000", 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00072882700000000003, 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001283172, 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324826+0000", 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324826+0000", 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324826+0000", 2024-04-26T12:15:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324830+0000", 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324839+0000", 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7879999999999995e-06 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324844+0000", 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325912+0000", 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010672660000000001 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325918+0000", 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5509999999999996e-06 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108483 5.2 5.43e15402 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.324999+0000", 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000556195, 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001165098, 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108483 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324999+0000", 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324999+0000", 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.324998+0000", 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325042+0000", 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4567000000000002e-05 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325054+0000", 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1758e-05 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325061+0000", 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7399999999999998e-06 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:108481 5.4 e31/16 5:27cd3486:::benchmark_data_smithi069_31227_object108480:head v 31'6741, mlcod=31'6738)", 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.325131+0000", 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00042385300000000002, 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010841259999999999, 2024-04-26T12:15:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325131+0000", 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325131+0000", 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325131+0000", 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325205+0000", 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3827999999999999e-05 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325215+0000", 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0749e-05 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325220+0000", 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0390000000000004e-06 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325596+0000", 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037614000000000001 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.325621+0000", 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4737e-05 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108464 5.a 5:519ed8ed:::benchmark_data_smithi069_31227_object108463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.318324+0000", 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0072311750000000003, 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079515060000000005, 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108464 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318324+0000", 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318324+0000", 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318323+0000", 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318377+0000", 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4097000000000001e-05 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318395+0000", 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7802999999999999e-05 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318412+0000", 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6657e-05 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318464+0000", 2024-04-26T12:15:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2791999999999999e-05 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318605+0000", 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000140941 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.318848+0000", 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024277500000000001 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.323843+0000", 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049949490000000003 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108470 5.a 5:5857e413:::benchmark_data_smithi069_31227_object108469:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.320358+0000", 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.005197358, 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005994419, 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108470 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320358+0000", 2024-04-26T12:15:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320358+0000", 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320357+0000", 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320485+0000", 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012834200000000001 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320495+0000", 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5680000000000005e-06 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320500+0000", 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7419999999999997e-06 2024-04-26T12:15:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320908+0000", 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040849199999999999 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.321040+0000", 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013171799999999999 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.321174+0000", 2024-04-26T12:15:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013444999999999999 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.326220+0000", 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050459700000000003 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:108471 5.2 5:47e37ecb:::benchmark_data_smithi069_31227_object108470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.320506+0000", 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0050488920000000001, 2024-04-26T12:15:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059245490000000003, 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 108471 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320506+0000", 2024-04-26T12:15:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320506+0000", 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320506+0000", 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320547+0000", 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1219e-05 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320552+0000", 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320557+0000", 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059999999999996e-06 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.320902+0000", 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034557099999999997 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.321583+0000", 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00068008399999999996 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 15 2024-04-26T12:15:40.393 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:40.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:40.395 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:40.393+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:40.496 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:40.494+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:40.593 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:40.593 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:40.596 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:40.595+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:40.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:40.697 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:40.696+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:40.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 36 16 109562 109546 190.169 158.625 0.00622678 0.00525586 2024-04-26T12:15:40.757 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.551165083000001, 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.548340100000001, 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:40.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:40.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.055832006999999, 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:40.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:40.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:40.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.013102061000001, 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:40.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.524325042999999, 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:40.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:40.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:40.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.523595332999999, 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:40.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.370477170000001, 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:40.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:40.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.367048749, 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:40.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:40.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.804 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.290787817, 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:40.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:40.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.290654971, 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:40.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:40.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:40.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.260251276, 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:40.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.5630616039999996, 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:40.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.5389049769999996, 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:94068 5.4 e29/16 5:212207bf:::benchmark_data_smithi069_31227_object94067:head v 29'5879, mlcod=29'5877)", 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1091158080000003, 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017212221999999999, 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648531+0000", 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3179e-05 2024-04-26T12:15:40.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648538+0000", 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9160000000000004e-06 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648542+0000", 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4479999999999996e-06 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648592+0000", 2024-04-26T12:15:40.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0154000000000001e-05 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648611+0000", 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8216999999999999e-05 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665631+0000", 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017019875 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665690+0000", 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789e-05 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94173 5.a 5:54be2579:::benchmark_data_smithi069_31227_object94172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.0665939910000004, 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017270364, 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94173 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.690999+0000", 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691028+0000", 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8328999999999999e-05 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691035+0000", 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691041+0000", 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.695986+0000", 2024-04-26T12:15:40.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049451989999999999 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696166+0000", 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017971799999999999 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696321+0000", 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154876 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.704730+0000", 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084090209999999992 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708169+0000", 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003439302 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708234+0000", 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5157e-05 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708270+0000", 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6322000000000002e-05 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.124539511, 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:40.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:40.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7202820540000001, 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:40.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:40.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.720126421, 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:40.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:40.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:40.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.857 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.464285864, 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:40.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:109479 5.c 5:336c4c30:::benchmark_data_smithi069_31227_object109478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.037179482, 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017565104000000002, 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 109479 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720444+0000", 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0579e-05 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720452+0000", 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2350000000000002e-06 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720458+0000", 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722824+0000", 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023669279999999999 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722970+0000", 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014601499999999999 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737857+0000", 2024-04-26T12:15:40.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014886203000000001 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737903+0000", 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6346e-05 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737980+0000", 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6524000000000001e-05 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:40.868 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:40.868 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:40.869 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:40.870 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:40.867+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:40.969 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:40.968+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:40.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:110204 5.a e31/16 5:5b7f2b85:::benchmark_data_smithi069_31227_object110203:head v 31'6863, mlcod=31'6860)", 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.999656+0000", 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010090740000000001, 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010111966999999999, 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999656+0000", 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999656+0000", 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999656+0000", 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999723+0000", 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7632999999999994e-05 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999734+0000", 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0777e-05 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999738+0000", 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2089999999999999e-06 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999766+0000", 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8201e-05 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.999777+0000", 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0987e-05 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:110207 5.a e31/16 5:571ec087:::benchmark_data_smithi069_31227_object110206:head v 31'6864, mlcod=31'6860)", 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.001654+0000", 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0080924980000000001, 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081727559999999998, 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001654+0000", 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001654+0000", 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001654+0000", 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001730+0000", 2024-04-26T12:15:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5957000000000005e-05 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001738+0000", 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5129999999999996e-06 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001743+0000", 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001773+0000", 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0179e-05 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.001786+0000", 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2860000000000001e-05 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110222 5.d 5:b4d4e7c4:::benchmark_data_smithi069_31227_object110221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.003535+0000", 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00621136, 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063496639999999997, 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110222 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003535+0000", 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003535+0000", 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003534+0000", 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003598+0000", 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3454999999999995e-05 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003611+0000", 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3491e-05 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003618+0000", 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4579999999999998e-06 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005565+0000", 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001947035 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005664+0000", 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9264000000000004e-05 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110223 5.f 5:fe7ae7c2:::benchmark_data_smithi069_31227_object110222:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.003626+0000", 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061212189999999998, 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063214839999999996, 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110223 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003626+0000", 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003626+0000", 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003625+0000", 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003692+0000", 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6896999999999993e-05 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003701+0000", 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8100000000000004e-06 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003706+0000", 2024-04-26T12:15:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1669999999999998e-06 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005489+0000", 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017825499999999999 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005607+0000", 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011863500000000001 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:110211 5.a e31/16 5:5889f161:::benchmark_data_smithi069_31227_object110210:head v 31'6865, mlcod=31'6861)", 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.003658+0000", 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.006088563, 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006353956, 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003658+0000", 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003658+0000", 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003658+0000", 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003713+0000", 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5365000000000003e-05 2024-04-26T12:15:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003723+0000", 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8030000000000008e-06 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.003729+0000", 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9340000000000003e-06 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005227+0000", 2024-04-26T12:15:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014985809999999999 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005248+0000", 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1174000000000001e-05 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:110221 5.a e31/16 5:5b225168:::benchmark_data_smithi069_31227_object110220:head v 31'6866, mlcod=31'6861)", 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.005426+0000", 2024-04-26T12:15:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0043206449999999997, 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046367250000000004, 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005426+0000", 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005426+0000", 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005426+0000", 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005478+0000", 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2672e-05 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005487+0000", 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9160000000000007e-06 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.005493+0000", 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.314e-06 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008141+0000", 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026477530000000001 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008159+0000", 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7711999999999999e-05 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110230 5.8 5:1518ffae:::benchmark_data_smithi069_31227_object110229:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.008840+0000", 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00090651399999999997, 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001277037, 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110230 2024-04-26T12:15:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008840+0000", 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008840+0000", 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008839+0000", 2024-04-26T12:15:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008944+0000", 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010522999999999999 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008958+0000", 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.358e-05 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008974+0000", 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5866e-05 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009018+0000", 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4860000000000001e-05 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009102+0000", 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3744000000000003e-05 2024-04-26T12:15:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009184+0000", 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1889000000000002e-05 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110231 5.9 5:9406911a:::benchmark_data_smithi069_31227_object110230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.008985+0000", 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00076156100000000001, 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011999090000000001, 2024-04-26T12:15:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110231 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008985+0000", 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008985+0000", 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.008985+0000", 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009068+0000", 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3894999999999996e-05 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009082+0000", 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3298e-05 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009089+0000", 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.844e-06 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009122+0000", 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2960999999999998e-05 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.009202+0000", 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9932000000000007e-05 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-26T12:15:41.042 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:41.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:41.084 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:41.083+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:41.111 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:41.111 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:41.111 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:41.131 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:41.131 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:41.134 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:41.134 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:41.171 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:41.170+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:41.230 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:41.230 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:41.244 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:41.272 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:41.271+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:41.373 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:41.372+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:41.431 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:41.431 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:41.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:41.485 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:41.484+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:41.573 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:41.572+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:41.601 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:41.601 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:41.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:41.674 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:41.673+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:41.751 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:15:41.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 37 16 112138 112122 189.38 161 0.00917471 0.00527773 2024-04-26T12:15:41.763 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:41.763 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:41.775 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:41.773+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:41.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:41.876 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:41.874+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:41.969 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:41.969 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:41.977 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:41.976+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:41.979 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:42.078 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.077+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:42.126 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:42.126 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:42.139 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:42.180 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.179+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:42.280 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.279+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:42.322 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:42.322 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:42.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:42.418 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.417+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:42.481 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:42.480+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:42.515 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:42.515 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:42.527 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:42.582 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.581+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:42.683 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:42.683 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:42.683 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:42.682+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:42.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:42.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 38 16 114676 114660 188.571 158.625 0.00835104 0.00530035 2024-04-26T12:15:42.784 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.783+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:42.884 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.883+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:42.894 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:42.894 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:42.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:42.985 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:42.984+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:43.065 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:43.065 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:43.078 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:43.086 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:43.084+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:43.135 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:43.186 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:43.185+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:43.226 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:43.226 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:43.239 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:43.260 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:43.260 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:43.279 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:43.283 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:43.283 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:43.287 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:43.286+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:43.388 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:43.387+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:43.424 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:43.424 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:43.424 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:43.424 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:43.424 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:43.436 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:43.520 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:43.519+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:43.590 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:43.588+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:43.625 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:43.625 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:43.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:43.625 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:43.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.625 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.564791652, 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.631 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.322852693000002, 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:43.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:43.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.637 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.322348204000001, 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.531356561999999, 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.1791457159999998, 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:43.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:43.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.9890991930000004, 2024-04-26T12:15:43.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:43.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.658 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.9879840250000003, 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.659 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.663 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.9877114410000001, 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:43.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:43.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:43.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:43.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.986444884, 2024-04-26T12:15:43.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:43.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:43.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.9862374359999997, 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:43.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:43.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:43.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.9858119519999997, 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.680 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:43.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:43.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.9855410119999997, 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:43.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.9844670129999997, 2024-04-26T12:15:43.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:43.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:43.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.2669643739999996, 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.696 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:43.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:43.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.266727983, 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:43.702 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108245 5.0 5:0537b099:::benchmark_data_smithi069_31227_object108244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.223888+0000", 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3989704829999998, 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021273132, 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.708 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108245 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223888+0000", 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223888+0000", 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223887+0000", 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223950+0000", 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2836999999999995e-05 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223956+0000", 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5520000000000001e-06 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223961+0000", 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0550000000000001e-06 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.230889+0000", 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069288609999999997 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.230982+0000", 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2892000000000004e-05 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.231071+0000", 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8758000000000006e-05 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.234875+0000", 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003804431 2024-04-26T12:15:43.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.245098+0000", 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010222158 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.245139+0000", 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1445e-05 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.245161+0000", 2024-04-26T12:15:43.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1752000000000001e-05 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.394844392, 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.714 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:15:43.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:15:43.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.5155102830000002, 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:15:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:15:43.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:15:43.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 2.514344661, 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.726 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:15:43.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:15:43.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.32395476099999998, 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:43.733 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:43.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:15:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:43.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:15:43.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.739 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.739 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.739 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:43.739 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:43.739 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:43.740 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:43.739+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:43.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:43.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 39 16 117195 117179 187.772 157.438 0.00709766 0.00532285 2024-04-26T12:15:43.765 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:15:43.840 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:43.839+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:43.891 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:117518 5.7 5:eef4e46d:::benchmark_data_smithi069_31227_object117517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:43.889477+0000", 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00133654, 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00136046, 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117518 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889477+0000", 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889477+0000", 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889476+0000", 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889526+0000", 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0426999999999997e-05 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889537+0000", 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0798000000000001e-05 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889543+0000", 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5289999999999999e-06 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889583+0000", 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9897000000000001e-05 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.889710+0000", 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127928 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:117516 5.b e32/16 5:d8460754:::benchmark_data_smithi069_31227_object117515:head v 32'7394, mlcod=32'7391)", 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:43.890501+0000", 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00031174600000000001, 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038266, 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890501+0000", 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890501+0000", 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890501+0000", 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890559+0000", 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7782999999999999e-05 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890569+0000", 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0213e-05 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890575+0000", 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890605+0000", 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0243000000000002e-05 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890622+0000", 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6779e-05 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:117515 5.e e32/16 5:7368ba17:::benchmark_data_smithi069_31227_object117514:head v 32'7392, mlcod=32'7386)", 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:43.890581+0000", 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00023194900000000001, 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033383799999999998, 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890581+0000", 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890581+0000", 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890581+0000", 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890620+0000", 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9257e-05 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890625+0000", 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5329999999999996e-06 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890628+0000", 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.18e-06 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890659+0000", 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1569000000000002e-05 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890682+0000", 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2197000000000001e-05 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:117520 5.5 5:a0d293ad:::benchmark_data_smithi069_31227_object117519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:43.890746+0000", 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.7705000000000003e-05, 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020894300000000001, 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117520 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890746+0000", 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890746+0000", 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890745+0000", 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890799+0000", 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4258000000000001e-05 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890806+0000", 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890811+0000", 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-04-26T12:15:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890843+0000", 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2749000000000001e-05 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:43.890925+0000", 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1471000000000007e-05 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 4 2024-04-26T12:15:43.907 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:43.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:43.952 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:43.950+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:44.043 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:44.041+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:44.067 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:44.067 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:44.067 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:44.067 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:44.067 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:44.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:44.143 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:44.141+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:44.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-26T12:15:44.243 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:44.242+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:44.280 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:44.280 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.071443112000001, 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:44.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53591 5.3 5:cf5a2643:::benchmark_data_smithi069_31227_object53590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.068618129000001, 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01692198, 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53591 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209254+0000", 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209253+0000", 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209280+0000", 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6704e-05 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209288+0000", 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:44.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.209293+0000", 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215213+0000", 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059192760000000002 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.215359+0000", 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014620200000000001 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225529+0000", 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010169848 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226099+0000", 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057039999999999999 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.226176+0000", 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6656999999999995e-05 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.576110035999999, 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:44.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:44.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.533380090000001, 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:44.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.044603072000001, 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:44.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:44.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.043873361999999, 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:44.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:44.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:44.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.890755199000001, 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:44.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.887326777999998, 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.811065845999998, 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.810932999999999, 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:44.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:44.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:44.334 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.780529305000002, 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:44.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:44.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.339 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.083339633, 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:44.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.059183006, 2024-04-26T12:15:44.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:44.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:94068 5.4 e29/16 5:212207bf:::benchmark_data_smithi069_31227_object94067:head v 29'5879, mlcod=29'5877)", 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6293938370000003, 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017212221999999999, 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648531+0000", 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3179e-05 2024-04-26T12:15:44.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648538+0000", 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9160000000000004e-06 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648542+0000", 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4479999999999996e-06 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648592+0000", 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0154000000000001e-05 2024-04-26T12:15:44.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648611+0000", 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8216999999999999e-05 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665631+0000", 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017019875 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665690+0000", 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789e-05 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94173 5.a 5:54be2579:::benchmark_data_smithi069_31227_object94172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.5868720199999995, 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017270364, 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94173 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:44.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.690999+0000", 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691028+0000", 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8328999999999999e-05 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691035+0000", 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691041+0000", 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.695986+0000", 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049451989999999999 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696166+0000", 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017971799999999999 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696321+0000", 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154876 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.704730+0000", 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084090209999999992 2024-04-26T12:15:44.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708169+0000", 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003439302 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708234+0000", 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5157e-05 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708270+0000", 2024-04-26T12:15:44.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6322000000000002e-05 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.64481754, 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:44.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:44.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2405600830000001, 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2404044499999998, 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9845638929999998, 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:109479 5.c 5:336c4c30:::benchmark_data_smithi069_31227_object109478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.557457511, 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017565104000000002, 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 109479 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720444+0000", 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0579e-05 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720452+0000", 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2350000000000002e-06 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720458+0000", 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722824+0000", 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023669279999999999 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722970+0000", 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014601499999999999 2024-04-26T12:15:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737857+0000", 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014886203000000001 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737903+0000", 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6346e-05 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737980+0000", 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6524000000000001e-05 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:44.388 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:44.389 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:44.390 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:44.388+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:44.490 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:44.489+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:44.533 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:44.533 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:44.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.533 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:119167 5.0 5:0c449aca:::benchmark_data_smithi069_31227_object119166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:44.533 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.528361+0000", 2024-04-26T12:15:44.533 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0041078640000000001, 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004134708, 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 119167 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528361+0000", 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528361+0000", 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528360+0000", 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.535 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528424+0000", 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528438+0000", 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4139e-05 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528446+0000", 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9519999999999994e-06 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.536 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528480+0000", 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3587000000000002e-05 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528631+0000", 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000150987 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530010+0000", 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013789500000000001 2024-04-26T12:15:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:119170 5.f 5:f3aa898d:::benchmark_data_smithi069_31227_object119169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.528581+0000", 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0038876689999999998, 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040019950000000004, 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.538 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 119170 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528581+0000", 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528581+0000", 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528580+0000", 2024-04-26T12:15:44.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528652+0000", 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1896000000000004e-05 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528659+0000", 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528665+0000", 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6710000000000004e-06 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528710+0000", 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5299000000000001e-05 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528840+0000", 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012975899999999999 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.541 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:119172 5.9 5:985f4747:::benchmark_data_smithi069_31227_object119171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.528682+0000", 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003786785, 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039707830000000003, 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 119172 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.542 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528682+0000", 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528682+0000", 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528681+0000", 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528730+0000", 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9070999999999998e-05 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528739+0000", 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.969e-06 2024-04-26T12:15:44.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528745+0000", 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0970000000000002e-06 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528789+0000", 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3189000000000003e-05 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.528909+0000", 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012034 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:119176 5.4 5:2ae6b8d5:::benchmark_data_smithi069_31227_object119175:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.530650+0000", 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001818189, 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020668750000000001, 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.546 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 119176 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530650+0000", 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530650+0000", 2024-04-26T12:15:44.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530649+0000", 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530745+0000", 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6002999999999995e-05 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530756+0000", 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0372e-05 2024-04-26T12:15:44.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530763+0000", 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530824+0000", 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0970000000000001e-05 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.530988+0000", 2024-04-26T12:15:44.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000163907 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531168+0000", 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017924999999999999 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:119175 5.a e32/16 5:588c34b9:::benchmark_data_smithi069_31227_object119174:head v 32'7375, mlcod=32'7372)", 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.531213+0000", 2024-04-26T12:15:44.550 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0012551979999999999, 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015415330000000001, 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531213+0000", 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531213+0000", 2024-04-26T12:15:44.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531213+0000", 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531292+0000", 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9111999999999997e-05 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531303+0000", 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0652000000000001e-05 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531308+0000", 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9710000000000001e-06 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531345+0000", 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6866000000000002e-05 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.531357+0000", 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1932e-05 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:119179 5.f 5:fa7fa9df:::benchmark_data_smithi069_31227_object119178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.532067+0000", 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00040214599999999998, 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000719722, 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 119179 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532067+0000", 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532067+0000", 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532066+0000", 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532142+0000", 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6643999999999993e-05 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532153+0000", 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0541e-05 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532160+0000", 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2710000000000003e-06 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532203+0000", 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2583000000000002e-05 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.532324+0000", 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012174499999999999 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.557 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.558 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:44.558 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-04-26T12:15:44.558 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:44.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:44.591 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:44.590+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:44.693 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:44.690+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:44.698 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:44.698 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:44.698 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:44.698 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:44.698 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:44.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:44.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:2024-04-26T12:15:44.754144+0000 min lat: 0.000918112 max lat: 1.01397 avg lat: 0.00534344 2024-04-26T12:15:44.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T12:15:44.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 40 16 119738 119722 187.051 158.938 0.00428735 0.00534344 2024-04-26T12:15:44.765 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:15:44.798 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:44.797+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:44.894 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:44.892+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:44.901 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.840896617999999, 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.598957659, 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.598453169999999, 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.807461528000001, 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.925 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4552506820000009, 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:44.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2652041589999996, 2024-04-26T12:15:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2640889909999995, 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2638164070000002, 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:44.941 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:44.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2625498499999992, 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:44.947 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:44.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2623424019999998, 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:44.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:44.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2619169180000007, 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2616459780000007, 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:44.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:44.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2605719789999998, 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:44.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:44.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:44.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.5430693399999997, 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.976 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:44.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.5428329490000001, 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:44.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:44.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108245 5.0 5:0537b099:::benchmark_data_smithi069_31227_object108244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.223888+0000", 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.6750754490000004, 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021273132, 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.988 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108245 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223888+0000", 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223888+0000", 2024-04-26T12:15:44.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223887+0000", 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223950+0000", 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2836999999999995e-05 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223956+0000", 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5520000000000001e-06 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.223961+0000", 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0550000000000001e-06 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.230889+0000", 2024-04-26T12:15:44.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069288609999999997 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.230982+0000", 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2892000000000004e-05 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.231071+0000", 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8758000000000006e-05 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.234875+0000", 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003804431 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.245098+0000", 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010222158 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.245139+0000", 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1445e-05 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.245161+0000", 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1752000000000001e-05 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.6709493579999997, 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:15:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:44.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:44.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:15:44.999 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.7916152489999999, 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:45.000 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:15:45.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.7904496270000001, 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.006 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:15:45.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 1.6000597270000001, 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:45.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:45.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:45.017 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:45.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:45.020 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:45.017+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:45.120 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:45.118+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120819 5.b e33/16)", 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.176739+0000", 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000236083, 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025265999999999998, 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176739+0000", 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176739+0000", 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176738+0000", 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176768+0000", 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9502999999999999e-05 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176778+0000", 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0276e-05 2024-04-26T12:15:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176783+0000", 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5029999999999999e-06 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176971+0000", 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018887900000000001 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176988+0000", 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.63e-05 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120807 5.0 e33/16 5:02588cad:::benchmark_data_smithi069_31227_object120806:head v 33'7523, mlcod=33'7520)", 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.170899+0000", 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0060755469999999997, 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061542760000000002, 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.170899+0000", 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.170899+0000", 2024-04-26T12:15:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.170899+0000", 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.170972+0000", 2024-04-26T12:15:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3009999999999994e-05 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.170982+0000", 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0054000000000001e-05 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.170987+0000", 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6200000000000004e-06 2024-04-26T12:15:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.171033+0000", 2024-04-26T12:15:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6078000000000002e-05 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.171054+0000", 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0801e-05 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120813 5.b e33/16 5:dbbbdd70:::benchmark_data_smithi069_31227_object120812:head v 33'7604, mlcod=33'7601)", 2024-04-26T12:15:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.172048+0000", 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0049269589999999999, 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050590380000000001, 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172048+0000", 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172048+0000", 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172047+0000", 2024-04-26T12:15:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172104+0000", 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6368e-05 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172113+0000", 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6730000000000004e-06 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172120+0000", 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172151+0000", 2024-04-26T12:15:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1711000000000002e-05 2024-04-26T12:15:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172168+0000", 2024-04-26T12:15:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6481e-05 2024-04-26T12:15:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120811 5.0 e33/16 5:0bacb1b9:::benchmark_data_smithi069_31227_object120810:head v 33'7524, mlcod=33'7520)", 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.172653+0000", 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0043216779999999998, 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045048140000000002, 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172653+0000", 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172653+0000", 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172652+0000", 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172728+0000", 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5228000000000005e-05 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172738+0000", 2024-04-26T12:15:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8889999999999997e-06 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172744+0000", 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174092+0000", 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013480110000000001 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174240+0000", 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014756700000000001 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120814 5.8 e33/16 5:10973797:::benchmark_data_smithi069_31227_object120813:head v 33'7540, mlcod=33'7538)", 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.172922+0000", 2024-04-26T12:15:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040531600000000001, 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042885709999999997, 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172922+0000", 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172922+0000", 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172921+0000", 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.172990+0000", 2024-04-26T12:15:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9258999999999995e-05 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173000+0000", 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4660000000000005e-06 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173005+0000", 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174064+0000", 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010596379999999999 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174082+0000", 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7759999999999999e-05 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120817 5.3 5:c4193cfc:::benchmark_data_smithi069_31227_object120816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.173718+0000", 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0032562509999999999, 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035481990000000001, 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120817 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173718+0000", 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173718+0000", 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173718+0000", 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173807+0000", 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9582999999999999e-05 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173817+0000", 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9550000000000004e-06 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173824+0000", 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6950000000000003e-06 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.173880+0000", 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6291e-05 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174035+0000", 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015498399999999999 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120812 5.e e33/16 5:760e739a:::benchmark_data_smithi069_31227_object120811:head v 33'7603, mlcod=33'7597)", 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.174133+0000", 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0028420099999999998, 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00319404, 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174133+0000", 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174133+0000", 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174132+0000", 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174184+0000", 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1533000000000003e-05 2024-04-26T12:15:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174192+0000", 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3080000000000008e-06 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174198+0000", 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7370000000000003e-06 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174224+0000", 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-05 2024-04-26T12:15:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174240+0000", 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5806000000000001e-05 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120818 5.b e33/16 5:d29571e0:::benchmark_data_smithi069_31227_object120817:head v 33'7605, mlcod=33'7602)", 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.174323+0000", 2024-04-26T12:15:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0026520060000000002, 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030541869999999999, 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174323+0000", 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174323+0000", 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174322+0000", 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174382+0000", 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9755e-05 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174393+0000", 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0651e-05 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174400+0000", 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1980000000000004e-06 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174435+0000", 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5561000000000001e-05 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.174452+0000", 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6920999999999999e-05 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120821 5.a 5:53a45ffe:::benchmark_data_smithi069_31227_object120820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.175047+0000", 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019275570000000001, 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023881029999999999, 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120821 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175047+0000", 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175047+0000", 2024-04-26T12:15:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175046+0000", 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175107+0000", 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0918000000000002e-05 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175120+0000", 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2394e-05 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175127+0000", 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1019999999999999e-06 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175169+0000", 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2626000000000002e-05 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175298+0000", 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012866200000000001 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175421+0000", 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122621 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120820 5.0 e33/16 5:07c8ee68:::benchmark_data_smithi069_31227_object120819:head v 33'7525, mlcod=33'7521)", 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.175173+0000", 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001801221, 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023243449999999998, 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175173+0000", 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175173+0000", 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175173+0000", 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175251+0000", 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8112e-05 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175259+0000", 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175264+0000", 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9350000000000002e-06 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176572+0000", 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013078020000000001 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176595+0000", 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3076999999999999e-05 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120822 5.6 5:6e748613:::benchmark_data_smithi069_31227_object120821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.175991+0000", 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00098318600000000004, 2024-04-26T12:15:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001561186, 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120822 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175991+0000", 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175991+0000", 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.175986+0000", 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999943 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176100+0000", 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011461899999999999 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176112+0000", 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1888e-05 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176129+0000", 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7288000000000001e-05 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176174+0000", 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4394999999999998e-05 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176318+0000", 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014456500000000001 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120824 5.a 5.734a01ba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.176141+0000", 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00083357600000000004, 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014669259999999999, 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120824 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176141+0000", 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176141+0000", 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176140+0000", 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176184+0000", 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3130000000000002e-05 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176196+0000", 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2700999999999999e-05 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176203+0000", 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1570000000000003e-06 2024-04-26T12:15:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120826 5.3 5.e5378613 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.176232+0000", 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00074254200000000001, 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014219460000000001, 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120826 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176232+0000", 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176232+0000", 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176231+0000", 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176292+0000", 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0381999999999999e-05 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176302+0000", 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.041e-05 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176309+0000", 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3509999999999998e-06 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120827 5.c 5:3a7d04d3:::benchmark_data_smithi069_31227_object120826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.176346+0000", 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00062821100000000005, 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013578970000000001, 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120827 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176346+0000", 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176346+0000", 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176346+0000", 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176404+0000", 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7939000000000002e-05 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176413+0000", 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7229999999999999e-06 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176420+0000", 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176467+0000", 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6913999999999998e-05 2024-04-26T12:15:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176601+0000", 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013398300000000001 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:120825 5.e e33/16 5:7c7530c6:::benchmark_data_smithi069_31227_object120824:head v 33'7604, mlcod=33'7601)", 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.176646+0000", 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00032818000000000002, 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011139870000000001, 2024-04-26T12:15:45.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176646+0000", 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176646+0000", 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176646+0000", 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176714+0000", 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8277999999999999e-05 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176724+0000", 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0242e-05 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176730+0000", 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.964e-06 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176860+0000", 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129123 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.176879+0000", 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.965e-05 2024-04-26T12:15:45.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:45.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:45.241 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:45.241 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 15 2024-04-26T12:15:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:45.242 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:45.241+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:45.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:45.284 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:45.342 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:45.341+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:45.394 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:45.395 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:45.406 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:45.406 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:45.406 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:45.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:45.425 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:45.425 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:45.428 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:45.428 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:45.443 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:45.442+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:45.544 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:45.543+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:45.567 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:45.567 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:45.580 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:45.645 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:45.644+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:45.724 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:45.725 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:45.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:45.745 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:45.744+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:45.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 41 16 122291 122275 186.38 159.562 0.00605726 0.00536306 2024-04-26T12:15:45.846 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:45.844+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:45.875 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:45.875 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:45.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:45.946 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:45.945+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.047 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.046+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.074 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:46.075 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:46.086 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:46.149 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.147+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.243 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:46.243 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:46.250 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.248+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:46.349 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.348+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.450 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:46.450 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:46.451 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:46.449+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:46.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:46.552 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.550+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.652 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.651+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.657 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:46.657 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:46.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:46.753 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.752+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 42 16 124816 124800 185.7 157.812 0.0031569 0.00538253 2024-04-26T12:15:46.780 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:15:46.818 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:46.819 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:46.832 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:46.855 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.854+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.956 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:46.955+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:46.978 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:46.979 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:46.990 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:47.057 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:47.056+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:47.129 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:47.129 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:47.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:47.157 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:47.156+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:47.258 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:47.257+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:47.301 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:47.301 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:47.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:47.358 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:47.357+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:47.429 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:47.460 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:47.459+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:47.474 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:47.474 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:47.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:47.551 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:47.551 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:47.552 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:47.561 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:47.559+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:47.570 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:47.570 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:47.573 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:47.574 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:47.661 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:47.660+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:47.685 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.475825282999999, 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.980492207000001, 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.937762261, 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.448985242999999, 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.448255533000001, 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.295137369999999, 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.291708949, 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.215448017, 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75408 5.a 5:570f2d27:::benchmark_data_smithi069_31227_object75407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.215315171, 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016922647999999998, 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75408 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466939+0000", 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466931+0000", 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999919 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467001+0000", 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9888999999999994e-05 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467007+0000", 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.467011+0000", 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470909+0000", 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038977780000000002 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471024+0000", 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114811 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.471144+0000", 2024-04-26T12:15:47.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120734 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.479027+0000", 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078820850000000005 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483737+0000", 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047105910000000001 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483819+0000", 2024-04-26T12:15:47.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2284e-05 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483862+0000", 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2227000000000001e-05 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.184911476, 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.487721804, 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:47.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.463565177, 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:47.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:94068 5.4 e29/16 5:212207bf:::benchmark_data_smithi069_31227_object94067:head v 29'5879, mlcod=29'5877)", 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.033776008, 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017212221999999999, 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:47.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648531+0000", 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3179e-05 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648538+0000", 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9160000000000004e-06 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648542+0000", 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4479999999999996e-06 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648592+0000", 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0154000000000001e-05 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648611+0000", 2024-04-26T12:15:47.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8216999999999999e-05 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665631+0000", 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017019875 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665690+0000", 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789e-05 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.755 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94173 5.a 5:54be2579:::benchmark_data_smithi069_31227_object94172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.991254190999999, 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017270364, 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94173 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.756 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.690999+0000", 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691028+0000", 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8328999999999999e-05 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691035+0000", 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691041+0000", 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.695986+0000", 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049451989999999999 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696166+0000", 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017971799999999999 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696321+0000", 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154876 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.704730+0000", 2024-04-26T12:15:47.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084090209999999992 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708169+0000", 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003439302 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708234+0000", 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5157e-05 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708270+0000", 2024-04-26T12:15:47.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6322000000000002e-05 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.049199711, 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:47.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:47.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.767 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.644942254, 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:47.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:47.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6447866209999997, 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:47.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:47.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:47.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:47.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.3889460640000006, 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:109479 5.c 5:336c4c30:::benchmark_data_smithi069_31227_object109478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9618396819999999, 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017565104000000002, 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 109479 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720444+0000", 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0579e-05 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720452+0000", 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2350000000000002e-06 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720458+0000", 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722824+0000", 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023669279999999999 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722970+0000", 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014601499999999999 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737857+0000", 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014886203000000001 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737903+0000", 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6346e-05 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737980+0000", 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6524000000000001e-05 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120667 5.2 5:4e342c21:::benchmark_data_smithi069_31227_object120666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.567811431, 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017658512000000001, 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:47.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120667 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:47.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114442+0000", 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114484+0000", 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2038e-05 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114492+0000", 2024-04-26T12:15:47.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4039999999999998e-06 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114497+0000", 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3959999999999997e-06 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.115455+0000", 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00095814800000000003 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.115567+0000", 2024-04-26T12:15:47.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011231299999999999 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.131991+0000", 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016424028 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.132031+0000", 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9156999999999998e-05 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.132101+0000", 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:47.795 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:47.796 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 43 16 127422 127406 185.169 162.875 0.00279814 0.00539795 2024-04-26T12:15:47.796 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:47.795+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:47.798 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:47.798 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:15:47.897 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:47.896+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:47.948 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:47.948 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:127940 5.4 5:27e4d2cf:::benchmark_data_smithi069_31227_object127939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:47.943042+0000", 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0044809209999999997, 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045024970000000003, 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 127940 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.949 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.943042+0000", 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.943042+0000", 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.943041+0000", 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.943072+0000", 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0970000000000003e-05 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.943083+0000", 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1327e-05 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.943089+0000", 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3169999999999998e-06 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.945890+0000", 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028010560000000001 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.945976+0000", 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5871000000000005e-05 2024-04-26T12:15:47.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.946077+0000", 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010022900000000001 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:127944 5.b 5:dcd69288:::benchmark_data_smithi069_31227_object127943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:47.945977+0000", 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0015455779999999999, 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016281990000000001, 2024-04-26T12:15:47.953 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 127944 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.945977+0000", 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.945977+0000", 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.945976+0000", 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.946086+0000", 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011034 2024-04-26T12:15:47.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.946093+0000", 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.917e-06 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.946098+0000", 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6940000000000003e-06 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.946138+0000", 2024-04-26T12:15:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9768000000000003e-05 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.946262+0000", 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012472300000000001 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.946406+0000", 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014341000000000001 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:127950 5.b 5.7b4b5a6b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:47.947028+0000", 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00049464099999999998, 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00062103500000000003, 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 127950 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.958 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947028+0000", 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947028+0000", 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947027+0000", 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947104+0000", 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7047999999999998e-05 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947112+0000", 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2740000000000002e-06 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947116+0000", 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:127951 5.b 5.59bdc76b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:47.947438+0000", 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4646000000000002e-05, 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023834099999999999, 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:47.961 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 127951 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947438+0000", 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:47.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947438+0000", 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947437+0000", 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947492+0000", 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4119999999999997e-05 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947499+0000", 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0990000000000001e-06 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947502+0000", 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7009999999999998e-06 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:127932 5.4 5:2356c9d9:::benchmark_data_smithi069_31227_object127931:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:47.964 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:47.939956+0000", 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0075664809999999999, 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077515559999999997, 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 127932 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.939956+0000", 2024-04-26T12:15:47.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.939956+0000", 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.939955+0000", 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.939991+0000", 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5741999999999998e-05 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940000+0000", 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2879999999999993e-06 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940006+0000", 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.941974+0000", 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019681780000000001 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.942114+0000", 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014042300000000001 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.942251+0000", 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013652099999999999 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947263+0000", 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050123349999999997 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:127933 5.4 5:2eca5955:::benchmark_data_smithi069_31227_object127932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:47.940181+0000", 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0073417339999999999, 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075938059999999998, 2024-04-26T12:15:47.969 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 127933 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940181+0000", 2024-04-26T12:15:47.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940181+0000", 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940180+0000", 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940783+0000", 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00060265799999999995 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940792+0000", 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8780000000000004e-06 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.940797+0000", 2024-04-26T12:15:47.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6169999999999998e-06 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.944024+0000", 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032268050000000001 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.944142+0000", 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118205 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.944279+0000", 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013690999999999999 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:47.947270+0000", 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029905869999999998 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:47.974 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 6 2024-04-26T12:15:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:47.976 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:47.998 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:47.997+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:48.100 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:48.098+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:48.121 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:48.121 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:48.121 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:48.121 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:48.121 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:48.133 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:48.200 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:48.199+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:48.274 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:48.274 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:48.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:48.274 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:48.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.274 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.213103814, 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:48.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:48.280 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.971164855000001, 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.281 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:48.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:48.286 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.970660366000001, 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.287 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:48.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.292 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.179668723999999, 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:48.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:48.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.827457878000001, 2024-04-26T12:15:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.637411354999999, 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.636296186999999, 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.636023603, 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.634757046000001, 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.634549598, 2024-04-26T12:15:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.634124114, 2024-04-26T12:15:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:48.336 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.633853174, 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.632779175, 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.9152765360000004, 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.9150401450000007, 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.353 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:48.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.0431565539999994, 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.359 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:15:48.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:15:48.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:48.365 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.1638224450000001, 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:48.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:15:48.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.1626568229999998, 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:48.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:15:48.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.9722669230000003, 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:15:48.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:15:48.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.382 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3833375430000001, 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.383 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:15:48.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:15:48.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.388 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:48.389 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:48.389 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:48.390 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:48.388+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:48.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:48.491 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:48.490+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:48.545 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:48.545 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:129533 5.c 5:39ca5b46:::benchmark_data_smithi069_31227_object129532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:48.542817+0000", 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0017354499999999999, 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001761131, 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129533 2024-04-26T12:15:48.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542817+0000", 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542817+0000", 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542816+0000", 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542871+0000", 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5081000000000003e-05 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542880+0000", 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6659999999999997e-06 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542887+0000", 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6710000000000002e-06 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542937+0000", 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0099000000000003e-05 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543079+0000", 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014177499999999999 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:129530 5.8 e34/16 5:127e5466:::benchmark_data_smithi069_31227_object129529:head v 34'8103, mlcod=34'8101)", 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:48.542849+0000", 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001703761, 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017948630000000001, 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542849+0000", 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542849+0000", 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542849+0000", 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542936+0000", 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7589000000000005e-05 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542954+0000", 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7842999999999998e-05 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542960+0000", 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7370000000000003e-06 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.542994+0000", 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4347000000000002e-05 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543013+0000", 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.914e-05 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:129532 5.4 e34/16 5:230bba2d:::benchmark_data_smithi069_31227_object129531:head v 34'7997, mlcod=34'7994)", 2024-04-26T12:15:48.553 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:48.543025+0000", 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001527352, 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001675277, 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543025+0000", 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543025+0000", 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543025+0000", 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543083+0000", 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8245000000000002e-05 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543103+0000", 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9372e-05 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543113+0000", 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0723000000000001e-05 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543151+0000", 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7608000000000003e-05 2024-04-26T12:15:48.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543167+0000", 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5851000000000001e-05 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:129531 5.b e34/16 5:d51abbed:::benchmark_data_smithi069_31227_object129530:head v 34'8125, mlcod=34'8123)", 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:48.543130+0000", 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001422745, 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016283999999999999, 2024-04-26T12:15:48.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543130+0000", 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543130+0000", 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543130+0000", 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543159+0000", 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9651000000000001e-05 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543167+0000", 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6369999999999999e-06 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543172+0000", 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0119999999999996e-06 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543214+0000", 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2086999999999999e-05 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543232+0000", 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7901999999999999e-05 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.560 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.561 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:129535 5.1 5:8a9b69de:::benchmark_data_smithi069_31227_object129534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:48.543489+0000", 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0010633610000000001, 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001330665, 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129535 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543489+0000", 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543489+0000", 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543489+0000", 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543539+0000", 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0315000000000002e-05 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543549+0000", 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0223e-05 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543556+0000", 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5989999999999998e-06 2024-04-26T12:15:48.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543601+0000", 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5056999999999999e-05 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.543764+0000", 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016333600000000001 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:129540 5.e e34/16 5:72ae7998:::benchmark_data_smithi069_31227_object129539:head v 34'8135, mlcod=34'8133)", 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:48.544348+0000", 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00020497500000000001, 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000536584, 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544348+0000", 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544348+0000", 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544347+0000", 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544396+0000", 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8622000000000003e-05 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544408+0000", 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544414+0000", 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544449+0000", 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5366e-05 2024-04-26T12:15:48.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:48.544468+0000", 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8501000000000001e-05 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 6 2024-04-26T12:15:48.569 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:48.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:48.611 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:48.610+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:48.692 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:48.691+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:48.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 44 16 130083 130067 184.74 166.312 0.00295586 0.00541037 2024-04-26T12:15:48.760 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:48.760 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:48.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:48.817 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:48.816+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:48.894 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:48.892+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.728267500000001, 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.232934424, 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:48.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.950 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65769 5.2 5:408f7b5d:::benchmark_data_smithi069_31227_object65768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.190204477999998, 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017147604, 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65769 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744492+0000", 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744491+0000", 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744566+0000", 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5288000000000002e-05 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744579+0000", 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2347000000000001e-05 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.744587+0000", 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3110000000000006e-06 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748384+0000", 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037971609999999999 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.748512+0000", 2024-04-26T12:15:48.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127945 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761514+0000", 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013001841 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761561+0000", 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7644e-05 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.761639+0000", 2024-04-26T12:15:48.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7997000000000006e-05 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.701427460000001, 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.70069775, 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.961 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.547579587000001, 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.544151165999999, 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.467890233999999, 2024-04-26T12:15:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.437353692999999, 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.740164020999998, 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85143 5.7 5:e1130fef:::benchmark_data_smithi069_31227_object85142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.716007394000002, 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017027885999999999, 2024-04-26T12:15:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85143 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218689+0000", 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218721+0000", 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2601999999999997e-05 2024-04-26T12:15:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218729+0000", 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.218734+0000", 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.226935+0000", 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082011069999999991 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.227051+0000", 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115907 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235589+0000", 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085384009999999993 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235650+0000", 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0885999999999999e-05 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.235717+0000", 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6897999999999995e-05 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:94068 5.4 e29/16 5:212207bf:::benchmark_data_smithi069_31227_object94067:head v 29'5879, mlcod=29'5877)", 2024-04-26T12:15:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.286218225000001, 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017212221999999999, 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648478+0000", 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648531+0000", 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3179e-05 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648538+0000", 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9160000000000004e-06 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648542+0000", 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4479999999999996e-06 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648592+0000", 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0154000000000001e-05 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.648611+0000", 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8216999999999999e-05 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665631+0000", 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017019875 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.665690+0000", 2024-04-26T12:15:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789e-05 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94173 5.a 5:54be2579:::benchmark_data_smithi069_31227_object94172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.243696408, 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017270364, 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94173 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.690999+0000", 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691028+0000", 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8328999999999999e-05 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691035+0000", 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691041+0000", 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.695986+0000", 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049451989999999999 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696166+0000", 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017971799999999999 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696321+0000", 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154876 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.704730+0000", 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084090209999999992 2024-04-26T12:15:49.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708169+0000", 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003439302 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708234+0000", 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5157e-05 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708270+0000", 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6322000000000002e-05 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.301641928, 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:49.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8973844710000005, 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:49.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:49.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8972288380000002, 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:49.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:49.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:49.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6413882809999993, 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:49.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:109479 5.c 5:336c4c30:::benchmark_data_smithi069_31227_object109478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.2142818989999995, 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017565104000000002, 2024-04-26T12:15:49.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 109479 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720444+0000", 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0579e-05 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720452+0000", 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2350000000000002e-06 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720458+0000", 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722824+0000", 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023669279999999999 2024-04-26T12:15:49.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722970+0000", 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014601499999999999 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737857+0000", 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014886203000000001 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737903+0000", 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6346e-05 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737980+0000", 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6524000000000001e-05 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120667 5.2 5:4e342c21:::benchmark_data_smithi069_31227_object120666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:49.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.820253648, 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017658512000000001, 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120667 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:49.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114442+0000", 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114484+0000", 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2038e-05 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114492+0000", 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4039999999999998e-06 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114497+0000", 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3959999999999997e-06 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.115455+0000", 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00095814800000000003 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.115567+0000", 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011231299999999999 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.131991+0000", 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016424028 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.132031+0000", 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9156999999999998e-05 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.132101+0000", 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:126923 5.2 5:4b17c5f4:::benchmark_data_smithi069_31227_object126922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:49.040 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.373481857, 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017813088000000001, 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 126923 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:49.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561214+0000", 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561274+0000", 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0720999999999997e-05 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561283+0000", 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561289+0000", 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2419999999999997e-06 2024-04-26T12:15:49.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.564354+0000", 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030649039999999998 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.564499+0000", 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014457599999999999 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:49.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.578880+0000", 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014381575000000001 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.578938+0000", 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7225999999999997e-05 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.579028+0000", 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0032999999999997e-05 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:49.046 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:49.046 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:49.047 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:49.045+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:49.047 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:49.148 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.147+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131218 5.f 5:fc4c26cf:::benchmark_data_smithi069_31227_object131217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.187504+0000", 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035284219999999998, 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035487880000000002, 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.193 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131218 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187504+0000", 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187504+0000", 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187503+0000", 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187585+0000", 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2347000000000003e-05 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187594+0000", 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1309999999999995e-06 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187600+0000", 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.981e-06 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187649+0000", 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8411000000000001e-05 2024-04-26T12:15:49.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187739+0000", 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9902999999999996e-05 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131219 5.0 5.e6f13970 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.187612+0000", 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003419877, 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034808949999999999, 2024-04-26T12:15:49.197 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131219 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187612+0000", 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187612+0000", 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187611+0000", 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187652+0000", 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0102999999999999e-05 2024-04-26T12:15:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187661+0000", 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1549999999999996e-06 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187666+0000", 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5149999999999997e-06 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131220 5.b 5:db249370:::benchmark_data_smithi069_31227_object131219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.187672+0000", 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033597660000000001, 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034526909999999999, 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131220 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187672+0000", 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187672+0000", 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187672+0000", 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187705+0000", 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3688e-05 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187712+0000", 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.063e-06 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187718+0000", 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3709999999999999e-06 2024-04-26T12:15:49.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187759+0000", 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1554000000000002e-05 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187891+0000", 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013168899999999999 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.188042+0000", 2024-04-26T12:15:49.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015113999999999999 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:131213 5.8 e34/16)", 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.188047+0000", 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0029847010000000002, 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031130049999999999, 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.188047+0000", 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.188047+0000", 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.188047+0000", 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.188051+0000", 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.782e-06 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.188059+0000", 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7849999999999997e-06 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.188066+0000", 2024-04-26T12:15:49.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7020000000000004e-06 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:131217 5.0 e34/16)", 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.189977+0000", 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010554480000000001, 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012077139999999999, 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.189977+0000", 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.189977+0000", 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.189976+0000", 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.189980+0000", 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.189987+0000", 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1960000000000002e-06 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.189992+0000", 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3279999999999999e-06 2024-04-26T12:15:49.210 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:131220 5.b e34/16)", 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.190496+0000", 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00053577300000000002, 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000710529, 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190496+0000", 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190496+0000", 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190496+0000", 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190498+0000", 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.548e-06 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190505+0000", 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3319999999999997e-06 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190510+0000", 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7489999999999998e-06 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131224 5.b 5.9ae18eeb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.190469+0000", 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00056273, 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00076134399999999995, 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.214 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131224 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190469+0000", 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190469+0000", 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190468+0000", 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190572+0000", 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104285 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190583+0000", 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0778000000000001e-05 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.190589+0000", 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9120000000000003e-06 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131203 5.0 5:02a2f08f:::benchmark_data_smithi069_31227_object131202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.180888+0000", 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010143928, 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010373187000000001, 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.217 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131203 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180888+0000", 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180888+0000", 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180888+0000", 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180924+0000", 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5960000000000001e-05 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180932+0000", 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5380000000000002e-06 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180939+0000", 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6710000000000002e-06 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180994+0000", 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5498000000000003e-05 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181114+0000", 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011936 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181302+0000", 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000188782 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185789+0000", 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044870170000000003 2024-04-26T12:15:49.221 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131204 5.9 5:927d4ae7:::benchmark_data_smithi069_31227_object131203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.180949+0000", 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010083211999999999, 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010365032999999999, 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131204 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180949+0000", 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180949+0000", 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180948+0000", 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180989+0000", 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0852000000000001e-05 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.180997+0000", 2024-04-26T12:15:49.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1829999999999994e-06 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181004+0000", 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8120000000000002e-06 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183496+0000", 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024914939999999999 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183618+0000", 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000122027 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131205 5.0 5:073ef57f:::benchmark_data_smithi069_31227_object131204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.181171+0000", 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0098610899999999994, 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010185968, 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:49.226 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131205 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181171+0000", 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181171+0000", 2024-04-26T12:15:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181170+0000", 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181269+0000", 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9162999999999999e-05 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181281+0000", 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1848000000000001e-05 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.181288+0000", 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183288+0000", 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019994100000000001 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183360+0000", 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2533999999999994e-05 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183442+0000", 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1841000000000005e-05 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187515+0000", 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040730009999999997 2024-04-26T12:15:49.230 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131208 5.f 5:f71a0269:::benchmark_data_smithi069_31227_object131207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.183063+0000", 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0079694499999999995, 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083773179999999999, 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.231 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131208 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183063+0000", 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183063+0000", 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183061+0000", 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183136+0000", 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4819000000000003e-05 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183148+0000", 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183155+0000", 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2949999999999996e-06 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183204+0000", 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8950999999999999e-05 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183355+0000", 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015080200000000001 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.191431+0000", 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080758870000000003 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131209 5.b 5:d751e7e1:::benchmark_data_smithi069_31227_object131208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.183317+0000", 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0077153170000000002, 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0082018709999999995, 2024-04-26T12:15:49.235 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131209 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183317+0000", 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183317+0000", 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183316+0000", 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183447+0000", 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013064700000000001 2024-04-26T12:15:49.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183458+0000", 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1627999999999999e-05 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183465+0000", 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183512+0000", 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6615e-05 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183621+0000", 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010956800000000001 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183749+0000", 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012776399999999999 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.186738+0000", 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002989345 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131212 5.9 5:99f579cf:::benchmark_data_smithi069_31227_object131211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.183665+0000", 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0073674969999999998, 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079341010000000007, 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.240 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131212 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183665+0000", 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183665+0000", 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183664+0000", 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183771+0000", 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010726900000000001 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183781+0000", 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8009999999999998e-06 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.183787+0000", 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4960000000000001e-06 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185631+0000", 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018438020000000001 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185751+0000", 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119395 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131213 5.8 5:1b3bae1a:::benchmark_data_smithi069_31227_object131212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.184391+0000", 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0066408379999999996, 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072717169999999996, 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.244 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131213 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184391+0000", 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184391+0000", 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184390+0000", 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184454+0000", 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.368e-05 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184465+0000", 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1355000000000001e-05 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184472+0000", 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.153e-06 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185557+0000", 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010842989999999999 2024-04-26T12:15:49.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185672+0000", 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011555799999999999 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185820+0000", 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000147224 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.191487+0000", 2024-04-26T12:15:49.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056670540000000004 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131214 5.9 5:99e5511e:::benchmark_data_smithi069_31227_object131213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.184480+0000", 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0065520409999999998, 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072661890000000002, 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.249 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131214 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184480+0000", 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184480+0000", 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184479+0000", 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184521+0000", 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2119000000000001e-05 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184530+0000", 2024-04-26T12:15:49.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5269999999999998e-06 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184536+0000", 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9630000000000003e-06 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187608+0000", 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003072478 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187747+0000", 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013843500000000001 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131215 5.9 5:9c9d2bdb:::benchmark_data_smithi069_31227_object131214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.184713+0000", 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0063190649999999996, 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071036129999999999, 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:49.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131215 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184713+0000", 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184713+0000", 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184712+0000", 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184830+0000", 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011738100000000001 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184841+0000", 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1094000000000001e-05 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.184925+0000", 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4825000000000002e-05 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.191420+0000", 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064941720000000003 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.191588+0000", 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000168622 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:131217 5.0 5:0fa2b103:::benchmark_data_smithi069_31227_object131216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:49.185878+0000", 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0051543379999999996, 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060087530000000004, 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.257 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 131217 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185878+0000", 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185878+0000", 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185877+0000", 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185910+0000", 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3238999999999998e-05 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185919+0000", 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4129999999999995e-06 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.185926+0000", 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7410000000000003e-06 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187545+0000", 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016192229999999999 2024-04-26T12:15:49.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187670+0000", 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012453 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.187781+0000", 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011056999999999999 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:49.191576+0000", 2024-04-26T12:15:49.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037952789999999999 2024-04-26T12:15:49.262 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.262 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.262 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.262 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.262 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:49.262 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 17 2024-04-26T12:15:49.262 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:49.263 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:49.264 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.262+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:49.364 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.363+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:49.407 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:49.407 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:49.407 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:49.407 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:49.407 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:49.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:49.465 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.464+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:49.566 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:49.564+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:49.567 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:49.567 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:49.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:49.567 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:49.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.567 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:49.567 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.506695881999999, 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:49.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:49.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:49.573 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.264756923, 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:49.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:49.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.264252433999999, 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:49.579 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:49.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:49.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.473260792000001, 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.585 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:49.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:49.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.121049945999999, 2024-04-26T12:15:49.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:49.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:49.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.931003423, 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:49.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.929888255, 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.602 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.929615671000001, 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.607 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:49.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:49.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.612 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.928349114, 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:49.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.928141666, 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.927716181999999, 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.927445241999999, 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.926371243, 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.208868603999999, 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 10.208632213, 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.336748622, 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:15:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:15:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4574145129999998, 2024-04-26T12:15:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:15:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:15:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.4562488909999995, 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:15:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:15:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.265858991, 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:15:49.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:15:49.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:15:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.6769296110000003, 2024-04-26T12:15:49.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:15:49.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:49.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:49.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:49.683 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:49.683 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:49.685 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.683+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:49.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:49.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 45 16 132743 132727 184.329 166.25 0.00667835 0.00542262 2024-04-26T12:15:49.785 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.784+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:49.799 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:15:49.808 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:49.809 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:49.809 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:49.829 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:49.829 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:49.833 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:49.833 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:49.846 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:49.846 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:49.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:49.903 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.901+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:49.988 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:49.986+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:50.061 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:50.061 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:50.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:50.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-26T12:15:50.088 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:50.087+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:50.190 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:50.189+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:50.269 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:50.269 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:50.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:50.291 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:50.290+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:50.392 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:50.391+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:50.427 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:50.427 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:50.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:50.493 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:50.492+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:50.595 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:50.592+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:50.630 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:50.630 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:50.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:50.698 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:50.693+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:50.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 46 16 135330 135314 183.836 161.688 0.00732052 0.00543679 2024-04-26T12:15:50.776 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:15:50.786 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:50.786 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:50.796 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:50.795+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:50.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:50.896 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:50.895+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:50.952 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:50.952 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:50.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:50.997 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:50.996+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.098 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:51.096+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:51.124 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:51.124 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:51.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:51.225 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:51.222+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:51.299 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:51.298+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.338 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:51.338 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:51.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:51.400 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:51.399+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.501 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:51.500+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.502 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:51.502 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:51.515 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:51.602 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:51.601+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.698 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:51.698 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:51.703 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:51.702+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.711 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:51.754 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 47 16 137900 137884 183.342 160.625 0.0061434 0.00545186 2024-04-26T12:15:51.804 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:51.802+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.834 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:51.895 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:51.895 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:51.904 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:51.903+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:51.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:51.959 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:51.959 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:51.959 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:51.978 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:51.978 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:51.981 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:51.982 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:52.006 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:52.005+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:52.066 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138691 5.c 5:36d79bb5:::benchmark_data_smithi069_31227_object138690:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.061579+0000", 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0028113840000000001, 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002832822, 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138691 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061579+0000", 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061579+0000", 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061579+0000", 2024-04-26T12:15:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061607+0000", 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061614+0000", 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5780000000000001e-06 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061619+0000", 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061645+0000", 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6398999999999999e-05 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061754+0000", 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108365 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:138687 5.0 e35/16 5:03af7e9b:::benchmark_data_smithi069_31227_object138686:head v 35'8706, mlcod=35'8703)", 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.061663+0000", 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027274589999999998, 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027899869999999998, 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061663+0000", 2024-04-26T12:15:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061663+0000", 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061663+0000", 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061699+0000", 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6025999999999997e-05 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061707+0000", 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3010000000000007e-06 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061712+0000", 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1189999999999996e-06 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061761+0000", 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8653999999999999e-05 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061778+0000", 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7499e-05 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:138680 5.a e35/16)", 2024-04-26T12:15:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.062997+0000", 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001393376, 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014853399999999999, 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.062997+0000", 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.062997+0000", 2024-04-26T12:15:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.062997+0000", 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063001+0000", 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6110000000000004e-06 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063015+0000", 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3178e-05 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063022+0000", 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138693 5.1 5:8a81c54a:::benchmark_data_smithi069_31227_object138692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.063295+0000", 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0010961110000000001, 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012150349999999999, 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138693 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063295+0000", 2024-04-26T12:15:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063295+0000", 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063294+0000", 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063347+0000", 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3260000000000002e-05 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063362+0000", 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5207e-05 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063369+0000", 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.562e-06 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063404+0000", 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5386999999999998e-05 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063531+0000", 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012700999999999999 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:138692 5.4 e35/16 5:2fa12992:::benchmark_data_smithi069_31227_object138691:head v 35'8569, mlcod=35'8567)", 2024-04-26T12:15:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.063551+0000", 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00083942800000000003, 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099271199999999998, 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063551+0000", 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063551+0000", 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063551+0000", 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063592+0000", 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1569000000000001e-05 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063604+0000", 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1714e-05 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063611+0000", 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6769999999999998e-06 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063644+0000", 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3325999999999999e-05 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063663+0000", 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8805e-05 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138667 5.a 5:593490bf:::benchmark_data_smithi069_31227_object138666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.051725+0000", 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.012665651, 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012850779, 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138667 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.051725+0000", 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.051725+0000", 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.051724+0000", 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.051788+0000", 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3800999999999994e-05 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.051797+0000", 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7059999999999993e-06 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.051805+0000", 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8639999999999996e-06 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.055163+0000", 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033582849999999999 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.055274+0000", 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111045 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.055709+0000", 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043451999999999998 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.060972+0000", 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052630790000000004 2024-04-26T12:15:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138670 5.2 5:41a94899:::benchmark_data_smithi069_31227_object138669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.052423+0000", 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011968048, 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012194515, 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138670 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.052423+0000", 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.052423+0000", 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.052422+0000", 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.052483+0000", 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0874e-05 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.052495+0000", 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503e-05 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.052502+0000", 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057831+0000", 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005329304 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057962+0000", 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013033399999999999 2024-04-26T12:15:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138678 5.a 5:54d29459:::benchmark_data_smithi069_31227_object138677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.056946+0000", 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0074443779999999998, 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077070990000000002, 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138678 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056946+0000", 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056946+0000", 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056946+0000", 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056979+0000", 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3176999999999998e-05 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056988+0000", 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7919999999999998e-06 2024-04-26T12:15:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056994+0000", 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2770000000000002e-06 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.058284+0000", 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001289718 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.058465+0000", 2024-04-26T12:15:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018090900000000001 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.058589+0000", 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012417999999999999 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:138675 5.8 e35/16 5:1e5e0400:::benchmark_data_smithi069_31227_object138674:head v 35'8699, mlcod=35'8697)", 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.056914+0000", 2024-04-26T12:15:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0074765400000000003, 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077751280000000001, 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056914+0000", 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056914+0000", 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056914+0000", 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056983+0000", 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9036999999999996e-05 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056992+0000", 2024-04-26T12:15:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1500000000000005e-06 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.056998+0000", 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6169999999999998e-06 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057056+0000", 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8618e-05 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057084+0000", 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8283e-05 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:138676 5.0 e35/16 5:0ab998ac:::benchmark_data_smithi069_31227_object138675:head v 35'8705, mlcod=35'8703)", 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.057247+0000", 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0071437610000000002, 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007471699, 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057247+0000", 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057247+0000", 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057247+0000", 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057348+0000", 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101116 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057365+0000", 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7597000000000001e-05 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057372+0000", 2024-04-26T12:15:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3249999999999996e-06 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057403+0000", 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1402999999999997e-05 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057420+0000", 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6752000000000002e-05 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138680 5.a 5:5410b119:::benchmark_data_smithi069_31227_object138679:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.057608+0000", 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0067830420000000004, 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071421169999999999, 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138680 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057608+0000", 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057608+0000", 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057607+0000", 2024-04-26T12:15:52.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057675+0000", 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8332999999999998e-05 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057686+0000", 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0426e-05 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057693+0000", 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9120000000000001e-06 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.060995+0000", 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033022580000000002 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061119+0000", 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012426200000000001 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061273+0000", 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015406400000000001 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138681 5.a 5:527e93e5:::benchmark_data_smithi069_31227_object138680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.057864+0000", 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065264099999999999, 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069226729999999998, 2024-04-26T12:15:52.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138681 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057864+0000", 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057864+0000", 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057864+0000", 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057932+0000", 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8298000000000002e-05 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057961+0000", 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9255e-05 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057969+0000", 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9480000000000008e-06 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063416+0000", 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054471090000000003 2024-04-26T12:15:52.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063590+0000", 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017414500000000001 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.063729+0000", 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013810299999999999 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138682 5.1 5:814eed88:::benchmark_data_smithi069_31227_object138681:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.057981+0000", 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0064098130000000003, 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068430699999999997, 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138682 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057981+0000", 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057981+0000", 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.057980+0000", 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.058039+0000", 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8831e-05 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.058048+0000", 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8570000000000001e-06 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.058067+0000", 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8706e-05 2024-04-26T12:15:52.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.060996+0000", 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002929142 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061122+0000", 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012614700000000001 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:138683 5.8 e35/16 5:1bcef7d1:::benchmark_data_smithi069_31227_object138682:head v 35'8700, mlcod=35'8697)", 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.059168+0000", 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0052225290000000001, 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005688154, 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059168+0000", 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059168+0000", 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059168+0000", 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059219+0000", 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0785000000000003e-05 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059228+0000", 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059236+0000", 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8339999999999999e-06 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059832+0000", 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059630100000000004 2024-04-26T12:15:52.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.059853+0000", 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0703000000000002e-05 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138689 5.6 5:619af12d:::benchmark_data_smithi069_31227_object138688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.061254+0000", 2024-04-26T12:15:52.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0031371720000000001, 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036369620000000001, 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138689 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061254+0000", 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061254+0000", 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061253+0000", 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061354+0000", 2024-04-26T12:15:52.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010128099999999999 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061369+0000", 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4769999999999999e-05 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061376+0000", 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7489999999999998e-06 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061416+0000", 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9560000000000001e-05 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061517+0000", 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101328 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:138678 5.a e35/16)", 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.061378+0000", 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003012439, 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035707199999999999, 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061378+0000", 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061378+0000", 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061377+0000", 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999981 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061381+0000", 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061393+0000", 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1619e-05 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061399+0000", 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8200000000000002e-06 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138690 5.5 5:aae43825:::benchmark_data_smithi069_31227_object138689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.061487+0000", 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029036550000000002, 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035110559999999998, 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138690 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061487+0000", 2024-04-26T12:15:52.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061487+0000", 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061486+0000", 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061550+0000", 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3387999999999997e-05 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061559+0000", 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6439999999999995e-06 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061567+0000", 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2849999999999997e-06 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061619+0000", 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2018000000000002e-05 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.061758+0000", 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013938199999999999 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.136 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:52.136 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 17 2024-04-26T12:15:52.136 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:52.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:52.138 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:52.136+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:52.238 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:52.237+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:52.338 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:52.338 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:52.339 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:52.338+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:52.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:52.440 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:52.439+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.296600857999998, 2024-04-26T12:15:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.801267782, 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.269760818000002, 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.269031108, 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.115912945000002, 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.112484523999999, 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75407 5.2 5:4ec4cbba:::benchmark_data_smithi069_31227_object75406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.036223591999999, 2024-04-26T12:15:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017240391000000001, 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75407 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466806+0000", 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466805+0000", 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466913+0000", 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010787500000000001 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466922+0000", 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0710000000000001e-06 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.466927+0000", 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4959999999999998e-06 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470825+0000", 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003898005 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.470964+0000", 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013950400000000001 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483873+0000", 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012908194 2024-04-26T12:15:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.483970+0000", 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7410000000000004e-05 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.484047+0000", 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6527999999999996e-05 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75479 5.c 5:361c7f28:::benchmark_data_smithi069_31227_object75478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.005687050999999, 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017598695000000001, 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75479 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497343+0000", 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497342+0000", 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497411+0000", 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497420+0000", 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.497427+0000", 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-04-26T12:15:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505125+0000", 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076986550000000004 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.505244+0000", 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011893800000000001 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514772+0000", 2024-04-26T12:15:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095281040000000008 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514863+0000", 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939000000000005e-05 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.514941+0000", 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959000000000004e-05 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.308497378999999, 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:94173 5.a 5:54be2579:::benchmark_data_smithi069_31227_object94172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.812029765999998, 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017270364, 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 94173 2024-04-26T12:15:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691000+0000", 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.690999+0000", 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691028+0000", 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8328999999999999e-05 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691035+0000", 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.691041+0000", 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.695986+0000", 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049451989999999999 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696166+0000", 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017971799999999999 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.696321+0000", 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154876 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.704730+0000", 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084090209999999992 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708169+0000", 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003439302 2024-04-26T12:15:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708234+0000", 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5157e-05 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:34.708270+0000", 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6322000000000002e-05 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.869975286000001, 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.465717829000001, 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.465562196, 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.209721639, 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:109479 5.c 5:336c4c30:::benchmark_data_smithi069_31227_object109478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.782615257, 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017565104000000002, 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 109479 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720414+0000", 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720444+0000", 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0579e-05 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720452+0000", 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2350000000000002e-06 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.720458+0000", 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722824+0000", 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023669279999999999 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.722970+0000", 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014601499999999999 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737857+0000", 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014886203000000001 2024-04-26T12:15:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737903+0000", 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6346e-05 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:40.737980+0000", 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6524000000000001e-05 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:120667 5.2 5:4e342c21:::benchmark_data_smithi069_31227_object120666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.3885870059999998, 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017658512000000001, 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 120667 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114443+0000", 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114442+0000", 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114484+0000", 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2038e-05 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114492+0000", 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4039999999999998e-06 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.114497+0000", 2024-04-26T12:15:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3959999999999997e-06 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.115455+0000", 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00095814800000000003 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.115567+0000", 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011231299999999999 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.131991+0000", 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016424028 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.132031+0000", 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9156999999999998e-05 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:45.132101+0000", 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:126923 5.2 5:4b17c5f4:::benchmark_data_smithi069_31227_object126922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9418152150000001, 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017813088000000001, 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 126923 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561214+0000", 2024-04-26T12:15:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561274+0000", 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0720999999999997e-05 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561283+0000", 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561289+0000", 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2419999999999997e-06 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.564354+0000", 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030649039999999998 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.564499+0000", 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014457599999999999 2024-04-26T12:15:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.578880+0000", 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014381575000000001 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.578938+0000", 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7225999999999997e-05 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.579028+0000", 2024-04-26T12:15:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0032999999999997e-05 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:138710 5.a 5:5c8fbeb8:::benchmark_data_smithi069_31227_object138709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.068970+0000", 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.43405979, 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017621408000000002, 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138710 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.068970+0000", 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.068970+0000", 2024-04-26T12:15:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.068969+0000", 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.069077+0000", 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010770899999999999 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.069087+0000", 2024-04-26T12:15:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0429e-05 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.069094+0000", 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5939999999999999e-06 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.077491+0000", 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083976139999999994 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.077645+0000", 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015384900000000001 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.077781+0000", 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013610200000000001 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.082680+0000", 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048982119999999999 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.086503+0000", 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038228889999999999 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.086550+0000", 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7902000000000003e-05 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.086591+0000", 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0914000000000002e-05 2024-04-26T12:15:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.14361529000000001, 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:15:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:15:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139464 5.6 5:65933418:::benchmark_data_smithi069_31227_object139463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.14138663500000001, 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018033270000000001, 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139464 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361642+0000", 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361698+0000", 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6433e-05 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361709+0000", 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0506000000000001e-05 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361724+0000", 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4843e-05 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371143+0000", 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094190100000000002 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371293+0000", 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150669 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379558+0000", 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082649969999999996 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379620+0000", 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1698000000000005e-05 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379676+0000", 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6168000000000002e-05 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:52.614 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:52.615 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:52.613+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:52.715 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:52.714+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:52.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 48 16 140511 140495 182.922 163.188 0.00636366 0.00546445 2024-04-26T12:15:52.758 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:52.758 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:52.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.758 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140491 5.8 5:17bb8498:::benchmark_data_smithi069_31227_object140490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.758 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.748887+0000", 2024-04-26T12:15:52.758 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0079360109999999998, 2024-04-26T12:15:52.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0079673469999999996, 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140491 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.748887+0000", 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.748887+0000", 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.748886+0000", 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.748998+0000", 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112454 2024-04-26T12:15:52.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749007+0000", 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7250000000000003e-06 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749027+0000", 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0129999999999999e-05 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749067+0000", 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9617999999999999e-05 2024-04-26T12:15:52.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749197+0000", 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000130479 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749324+0000", 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126155 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140493 5.8 5:152545be:::benchmark_data_smithi069_31227_object140492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.749047+0000", 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0077752860000000002, 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0078831539999999999, 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140493 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.763 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749047+0000", 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749047+0000", 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749047+0000", 2024-04-26T12:15:52.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749088+0000", 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1829000000000002e-05 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749099+0000", 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0532e-05 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.749105+0000", 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8080000000000001e-06 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751358+0000", 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022529709999999999 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751488+0000", 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012997599999999999 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751646+0000", 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015869699999999999 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140499 5.8 5:1b094e7c:::benchmark_data_smithi069_31227_object140498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.751273+0000", 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055497139999999999, 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057349339999999997, 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.767 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140499 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751273+0000", 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751273+0000", 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751272+0000", 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751337+0000", 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5602e-05 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751347+0000", 2024-04-26T12:15:52.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7380000000000006e-06 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.751354+0000", 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5679999999999996e-06 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753144+0000", 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017900399999999999 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753219+0000", 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4853999999999999e-05 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753295+0000", 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6014999999999996e-05 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140502 5.0 5:067f2b3b:::benchmark_data_smithi069_31227_object140501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.752500+0000", 2024-04-26T12:15:52.771 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0043227630000000003, 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045797449999999996, 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140502 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.752500+0000", 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.752500+0000", 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.752499+0000", 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.752559+0000", 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9984e-05 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.752568+0000", 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0790000000000007e-06 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.752573+0000", 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0250000000000002e-06 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753139+0000", 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00056608199999999998 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753259+0000", 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011964399999999999 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753408+0000", 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014900499999999999 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.775 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140505 5.b 5:d3b61da6:::benchmark_data_smithi069_31227_object140504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.753960+0000", 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028630090000000001, 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031952019999999999, 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140505 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.776 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753960+0000", 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753960+0000", 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.753959+0000", 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754070+0000", 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111303 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754083+0000", 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2982999999999999e-05 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754090+0000", 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0299999999999996e-06 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754123+0000", 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2894e-05 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754222+0000", 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9139000000000001e-05 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754313+0000", 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1382e-05 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140507 5.0 5:050f6dd2:::benchmark_data_smithi069_31227_object140506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.754102+0000", 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002720727, 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031246339999999998, 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.780 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140507 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754102+0000", 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754102+0000", 2024-04-26T12:15:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754101+0000", 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754135+0000", 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3674000000000003e-05 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754142+0000", 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2089999999999999e-06 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754148+0000", 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9179999999999999e-06 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755508+0000", 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001359526 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755615+0000", 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107508 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755738+0000", 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012312799999999999 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140508 5.d 5:be904a31:::benchmark_data_smithi069_31227_object140507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.784 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.754175+0000", 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0026479429999999998, 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030930139999999998, 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140508 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754175+0000", 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754175+0000", 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754174+0000", 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754254+0000", 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0372999999999998e-05 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754262+0000", 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8350000000000004e-06 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754268+0000", 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5500000000000002e-06 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754305+0000", 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7626000000000002e-05 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754417+0000", 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011123 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140509 5.8 5:128a23a3:::benchmark_data_smithi069_31227_object140508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.788 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.754311+0000", 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025116729999999999, 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030082870000000001, 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140509 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754311+0000", 2024-04-26T12:15:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754311+0000", 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754310+0000", 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754413+0000", 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010289999999999999 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754421+0000", 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0749999999999998e-06 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754426+0000", 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0390000000000004e-06 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755492+0000", 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010661049999999999 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755567+0000", 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5005000000000004e-05 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755648+0000", 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0395999999999994e-05 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.792 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:140510 5.a e35/16 5:5d36ca9f:::benchmark_data_smithi069_31227_object140509:head v 35'8697, mlcod=35'8695)", 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.754820+0000", 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020027579999999999, 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025365549999999998, 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754820+0000", 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754820+0000", 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754819+0000", 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754891+0000", 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1562000000000004e-05 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754898+0000", 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.985e-06 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754901+0000", 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4120000000000001e-06 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:52.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754935+0000", 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3701000000000001e-05 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.754948+0000", 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3366e-05 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140512 5.8 5.5069a7f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.755020+0000", 2024-04-26T12:15:52.796 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018025879999999999, 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023844339999999999, 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140512 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755020+0000", 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755020+0000", 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755019+0000", 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755095+0000", 2024-04-26T12:15:52.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6150999999999996e-05 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755106+0000", 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0564000000000001e-05 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.755112+0000", 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3430000000000001e-06 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:140514 5.0 5.7b42e400 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:52.756329+0000", 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00049369400000000003, 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001126295, 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 140514 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.756329+0000", 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.756329+0000", 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.756328+0000", 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.756433+0000", 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010563799999999999 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.756445+0000", 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2126999999999999e-05 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:52.756453+0000", 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3669999999999999e-06 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.802 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:52.803 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.803 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:52.803 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:52.803 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-26T12:15:52.803 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:52.803 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:15:52.804 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:52.816 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:52.815+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:52.917 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:52.915+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:52.953 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:52.953 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:52.954 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:52.954 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:52.954 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:52.965 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:53.050 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:53.049+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:53.118 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:53.117+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:53.158 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.094434933999999, 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.852495975, 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.851991485999999, 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.060999844000001, 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.708788997999999, 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.518742475, 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.517627307000001, 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.517354723, 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.516088165999999, 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.515880717999998, 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:53.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:53.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:53.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:53.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:53.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.515455234000001, 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:53.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:53.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.515184294000001, 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:53.227 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:53.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.232 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.514110295000002, 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:53.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.796607656000001, 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:53.239 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:53.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:53.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.245 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.796371264999999, 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.246 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:53.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:53.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.924487674, 2024-04-26T12:15:53.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:53.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:15:53.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.258 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.045153565, 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:15:53.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:15:53.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.043987942999999, 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.265 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:15:53.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:15:53.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:53.271 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.8535980429999999, 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:15:53.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.277 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.2646686630000001, 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:53.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:15:53.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:15:53.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:53.284 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:53.284 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:53.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:53.286 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:53.283+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:53.387 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:53.385+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:142315 5.b e35/16 5:d1e41168:::benchmark_data_smithi069_31227_object142314:head v 35'8931, mlcod=35'8929)", 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.437274+0000", 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0032687200000000001, 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032851540000000002, 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:53.442 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437274+0000", 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437274+0000", 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437273+0000", 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437299+0000", 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5122000000000001e-05 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437309+0000", 2024-04-26T12:15:53.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0531e-05 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437315+0000", 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437359+0000", 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4317999999999998e-05 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437376+0000", 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6427999999999999e-05 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142318 5.c 5:39d97512:::benchmark_data_smithi069_31227_object142317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.437265+0000", 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0032774710000000001, 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033347770000000001, 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142318 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437265+0000", 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437265+0000", 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437264+0000", 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437341+0000", 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6916999999999996e-05 2024-04-26T12:15:53.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437351+0000", 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4860000000000003e-06 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437358+0000", 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8199999999999999e-06 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437398+0000", 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0818999999999997e-05 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.437800+0000", 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040182400000000001 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142324 5.6 5:68e73f20:::benchmark_data_smithi069_31227_object142323:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.438634+0000", 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019091030000000001, 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020082979999999999, 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142324 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438634+0000", 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438634+0000", 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438633+0000", 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438695+0000", 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2149000000000004e-05 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438706+0000", 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1151e-05 2024-04-26T12:15:53.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438712+0000", 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3110000000000002e-06 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438757+0000", 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5043000000000002e-05 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.438880+0000", 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012236699999999999 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:142313 5.4 e35/16 5:2872db59:::benchmark_data_smithi069_31227_object142312:head v 35'8770, mlcod=35'8767)", 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.439034+0000", 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001508403, 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001657228, 2024-04-26T12:15:53.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439034+0000", 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439034+0000", 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439034+0000", 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439095+0000", 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1666000000000002e-05 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439103+0000", 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0139999999999998e-06 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439109+0000", 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3759999999999999e-06 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439168+0000", 2024-04-26T12:15:53.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9580000000000002e-05 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439186+0000", 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7642000000000002e-05 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:142323 5.e e35/16 5:74f6abd0:::benchmark_data_smithi069_31227_object142322:head v 35'8929, mlcod=35'8927)", 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.439135+0000", 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014075730000000001, 2024-04-26T12:15:53.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015977809999999999, 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439135+0000", 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439135+0000", 2024-04-26T12:15:53.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439135+0000", 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439219+0000", 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3926999999999998e-05 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439228+0000", 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8619999999999992e-06 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439232+0000", 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439398+0000", 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016553100000000001 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439418+0000", 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0455999999999999e-05 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:142317 5.b e35/16 5:d22564b6:::benchmark_data_smithi069_31227_object142316:head v 35'8932, mlcod=35'8929)", 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.439522+0000", 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0010208719999999999, 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012476430000000001, 2024-04-26T12:15:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439522+0000", 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439522+0000", 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439521+0000", 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439574+0000", 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2972e-05 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439585+0000", 2024-04-26T12:15:53.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0475000000000001e-05 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439590+0000", 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.677e-06 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439681+0000", 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0340999999999994e-05 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.439697+0000", 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6480000000000001e-05 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142328 5.6 5.dee6f116 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.440656+0000", 2024-04-26T12:15:53.467 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.999887, 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014373500000000001, 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142328 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.440656+0000", 2024-04-26T12:15:53.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.440656+0000", 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.440655+0000", 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.440766+0000", 2024-04-26T12:15:53.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110684 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.440777+0000", 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0913999999999999e-05 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.440783+0000", 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:142312 5.4 e35/16 5:2deb1595:::benchmark_data_smithi069_31227_object142311:head v 35'8769, mlcod=35'8767)", 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.436712+0000", 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038306389999999998, 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041161360000000003, 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436712+0000", 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436712+0000", 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436711+0000", 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436786+0000", 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4622999999999993e-05 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436802+0000", 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.649e-05 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436809+0000", 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436861+0000", 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1891999999999997e-05 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.436879+0000", 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8275e-05 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 8 2024-04-26T12:15:53.474 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:53.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:53.516 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:53.515+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:53.588 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:53.586+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:53.665 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:53.665 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:53.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:53.721 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:53.720+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:53.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 49 16 143119 143103 182.515 163 0.0066053 0.00547644 2024-04-26T12:15:53.784 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:15:53.789 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:53.787+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:53.880 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.670955886000002, 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.17562281, 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.644115845999998, 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:53.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.643386136, 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:53.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:53.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.490267973000002, 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:53.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:53.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.486839551999999, 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:53.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:53.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.682852406999999, 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:53.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.244330313999999, 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:53.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:53.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:53.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.840072856999999, 2024-04-26T12:15:53.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:53.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:53.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.839917224000001, 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:53.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.584076667, 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.938 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:53.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:126923 5.2 5:4b17c5f4:::benchmark_data_smithi069_31227_object126922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:53.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.3161702430000002, 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017813088000000001, 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 126923 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561215+0000", 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561214+0000", 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561274+0000", 2024-04-26T12:15:53.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0720999999999997e-05 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561283+0000", 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.561289+0000", 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2419999999999997e-06 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.564354+0000", 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030649039999999998 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.564499+0000", 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014457599999999999 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.578880+0000", 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014381575000000001 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.578938+0000", 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7225999999999997e-05 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:47.579028+0000", 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0032999999999997e-05 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5179703180000002, 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139464 5.6 5:65933418:::benchmark_data_smithi069_31227_object139463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.954 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.515741663, 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018033270000000001, 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139464 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361642+0000", 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361698+0000", 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6433e-05 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361709+0000", 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0506000000000001e-05 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361724+0000", 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4843e-05 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371143+0000", 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094190100000000002 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371293+0000", 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150669 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379558+0000", 2024-04-26T12:15:53.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082649969999999996 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379620+0000", 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1698000000000005e-05 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379676+0000", 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6168000000000002e-05 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52200228000000004, 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:15:53.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52164971900000001, 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:15:53.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.51785880900000003, 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:15:53.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:15:53.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:15:53.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:15:53.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:15:53.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:15:53.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:15:53.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.51046178099999995, 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:15:53.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.50595248599999998, 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:15:53.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:15:53.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:53.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.50319045799999995, 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:53.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:53.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:15:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:53.994 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:53.995 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:53.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:53.997 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:53.994+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:54.097 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:54.095+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:54.119 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:54.119 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:54.119 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:54.139 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:54.139 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:54.142 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:54.142 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:54.143 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:54.144 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:54.156 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:54.198 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:54.197+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:54.299 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:54.299 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:54.299 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:54.298+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:54.312 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:54.401 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:54.398+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:54.459 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:54.460 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:54.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:54.514 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:54.513+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:54.603 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:54.601+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:54.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:54.704 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:54.703+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:54.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 50 16 145738 145722 182.138 163.688 0.00996856 0.00548791 2024-04-26T12:15:54.801 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:54.802 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:54.805 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:54.804+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:54.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:54.906 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:54.905+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:55.007 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:55.006+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:55.007 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:55.008 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:55.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:55.108 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:55.106+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:55.165 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:55.166 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:55.179 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:55.209 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:55.207+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:55.310 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:55.309+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:55.323 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:55.323 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:55.335 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:55.411 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:55.410+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:55.479 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:55.479 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:55.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:55.537 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:55.536+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:55.613 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:55.611+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:55.645 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:55.645 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:55.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:55.714 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:55.713+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:55.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 51 16 148340 148324 181.755 162.625 0.0037736 0.00549918 2024-04-26T12:15:55.797 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:15:55.814 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:55.813+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:55.862 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:55.862 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:55.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:55.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-26T12:15:55.915 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:55.914+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.016 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:56.015+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.030 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:56.030 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:56.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:56.117 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:56.116+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.144 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:15:56.191 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:56.191 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:56.205 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:56.218 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:56.216+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:56.267 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:56.268 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:56.268 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:56.286 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:56.287 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:56.289 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:56.290 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:56.319 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:56.318+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.388 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:56.389 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:56.389 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:56.389 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:56.389 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:56.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:56.441 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:56.440+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.520 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:56.519+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.592 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:56.592 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:56.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:56.592 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:56.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.530929780999998, 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.593 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:56.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:56.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:56.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.288990822000002, 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:56.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:56.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.288486333000002, 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.605 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:56.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:56.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.497494691, 2024-04-26T12:15:56.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:56.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:56.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.145283845000002, 2024-04-26T12:15:56.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:56.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:56.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.623 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.955237321999999, 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:56.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.954122154, 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:56.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.953849569999999, 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.952583013000002, 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.640 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:56.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.952375565000001, 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.645 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:56.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:56.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.951950081, 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:56.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.951679141, 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:56.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:56.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:56.660 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.950605142000001, 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:56.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:56.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:56.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.666 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.233102503000001, 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:56.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.672 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.232866112, 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:56.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:56.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.678 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.360982521, 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:15:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.684 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.481648412, 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.685 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:15:56.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.48048279, 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.691 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:15:56.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:15:56.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.29009289, 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.698 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:15:56.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:15:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.701163510000001, 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:56.709 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:56.711 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:56.709+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:56.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 52 16 150969 150953 181.42 164.312 0.0083301 0.00550978 2024-04-26T12:15:56.795 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:15:56.811 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:56.810+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:56.870 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:151253 5.8 e37/16 5:1fe493a1:::benchmark_data_smithi069_31227_object151252:head v 37'9526, mlcod=37'9524)", 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.863543+0000", 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0051260409999999996, 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051478110000000004, 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863543+0000", 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863543+0000", 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863543+0000", 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863613+0000", 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0555999999999993e-05 2024-04-26T12:15:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863625+0000", 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863631+0000", 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9460000000000003e-06 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863674+0000", 2024-04-26T12:15:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3232999999999998e-05 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863691+0000", 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7354e-05 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:151258 5.2 5:4c72b476:::benchmark_data_smithi069_31227_object151257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.863826+0000", 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0048437150000000002, 2024-04-26T12:15:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049289909999999998, 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 151258 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863826+0000", 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863826+0000", 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863825+0000", 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863889+0000", 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4140999999999995e-05 2024-04-26T12:15:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863898+0000", 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9409999999999996e-06 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.863904+0000", 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7060000000000001e-06 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866554+0000", 2024-04-26T12:15:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026506799999999999 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866684+0000", 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012986599999999999 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:151255 5.8 e37/16 5:11488def:::benchmark_data_smithi069_31227_object151254:head v 37'9527, mlcod=37'9524)", 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.865977+0000", 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0026927800000000001, 2024-04-26T12:15:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002840745, 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.865977+0000", 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.865977+0000", 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.865976+0000", 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866021+0000", 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4783999999999997e-05 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866031+0000", 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0249e-05 2024-04-26T12:15:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866037+0000", 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866081+0000", 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3482000000000001e-05 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866102+0000", 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1685999999999999e-05 2024-04-26T12:15:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:151263 5.a 5:52ef62f8:::benchmark_data_smithi069_31227_object151262:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.866448+0000", 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002221467, 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024249480000000001, 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 151263 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866448+0000", 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866448+0000", 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866447+0000", 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866501+0000", 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4116999999999997e-05 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866512+0000", 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.096e-05 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866520+0000", 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8709999999999997e-06 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866579+0000", 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9735999999999999e-05 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866743+0000", 2024-04-26T12:15:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016317999999999999 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866879+0000", 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013585499999999999 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:151264 5.c 5:3a535285:::benchmark_data_smithi069_31227_object151263:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.866574+0000", 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0020950320000000001, 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023663989999999999, 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 151264 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866574+0000", 2024-04-26T12:15:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866574+0000", 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866574+0000", 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866644+0000", 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0599000000000006e-05 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866653+0000", 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7940000000000008e-06 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866659+0000", 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5250000000000002e-06 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866696+0000", 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6368999999999997e-05 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866778+0000", 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1714999999999999e-05 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:151262 5.e e37/16 5:793bfb39:::benchmark_data_smithi069_31227_object151261:head v 37'9487, mlcod=37'9484)", 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.866896+0000", 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0017728349999999999, 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002109133, 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866896+0000", 2024-04-26T12:15:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866896+0000", 2024-04-26T12:15:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866896+0000", 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866975+0000", 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9392000000000002e-05 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866984+0000", 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8939999999999999e-06 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.866991+0000", 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3879999999999997e-06 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867041+0000", 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0481e-05 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867057+0000", 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6050999999999999e-05 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:151268 5.6 5:6bb8d9a6:::benchmark_data_smithi069_31227_object151267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.867155+0000", 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0015139210000000001, 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001904804, 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 151268 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867155+0000", 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867155+0000", 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867154+0000", 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867292+0000", 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013720799999999999 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867306+0000", 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3967e-05 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867313+0000", 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867361+0000", 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7991000000000002e-05 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867481+0000", 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011994600000000001 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:151265 5.4 e37/16 5:28639d67:::benchmark_data_smithi069_31227_object151264:head v 37'9320, mlcod=37'9318)", 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.867215+0000", 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001454344, 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019036120000000001, 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867215+0000", 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867215+0000", 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867214+0000", 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867302+0000", 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7501000000000001e-05 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867310+0000", 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2390000000000002e-06 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867316+0000", 2024-04-26T12:15:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4219999999999999e-06 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867385+0000", 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9443999999999994e-05 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.867401+0000", 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5678000000000001e-05 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:151267 5.0 e37/16 5:0c277a69:::benchmark_data_smithi069_31227_object151266:head v 37'9478, mlcod=37'9476)", 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.868069+0000", 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00060041499999999998, 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001100408, 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868069+0000", 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868069+0000", 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868068+0000", 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868110+0000", 2024-04-26T12:15:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1479e-05 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868120+0000", 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0618999999999999e-05 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868126+0000", 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1700000000000002e-06 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868161+0000", 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4758999999999997e-05 2024-04-26T12:15:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868180+0000", 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8598999999999999e-05 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:151266 5.e e37/16)", 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.868660+0000", 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9430000000000006e-06, 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055593699999999995, 2024-04-26T12:15:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868660+0000", 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868660+0000", 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868660+0000", 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868713+0000", 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3037000000000001e-05 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868721+0000", 2024-04-26T12:15:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4290000000000001e-06 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.868726+0000", 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2209999999999999e-06 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:151249 5.2 5:4573888a:::benchmark_data_smithi069_31227_object151248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.862169+0000", 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065005310000000004, 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007096209, 2024-04-26T12:15:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 151249 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862169+0000", 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862169+0000", 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862168+0000", 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862255+0000", 2024-04-26T12:15:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6887999999999999e-05 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862265+0000", 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862270+0000", 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.31e-06 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862305+0000", 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5111999999999999e-05 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862438+0000", 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013258899999999999 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:151251 5.2 5:45948783:::benchmark_data_smithi069_31227_object151250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.862823+0000", 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0058463969999999997, 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065027490000000004, 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 151251 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862823+0000", 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862823+0000", 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862822+0000", 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862881+0000", 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8498999999999997e-05 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862889+0000", 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.862895+0000", 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0449999999999997e-06 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.864468+0000", 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015735199999999999 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.864604+0000", 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135754 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 12 2024-04-26T12:15:56.918 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:56.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:56.919 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:56.917+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.020 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.018+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.111 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:15:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:15:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:15:57.111 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:57.120 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.119+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:57.221 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.220+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.110469404, 2024-04-26T12:15:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:15:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.615136327999998, 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:15:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:15:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:15:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.083629364, 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:15:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:15:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.082899653999998, 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:15:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:15:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.929781491, 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:15:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:15:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.926353070000001, 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:15:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.122365925, 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:15:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:15:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.683843832000001, 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:15:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.279586375000001, 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.279430741999999, 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:15:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:15:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.023590185, 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:15:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:15:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9574838359999998, 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139464 5.6 5:65933418:::benchmark_data_smithi069_31227_object139463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9552551810000001, 2024-04-26T12:15:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018033270000000001, 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139464 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361642+0000", 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361698+0000", 2024-04-26T12:15:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6433e-05 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361709+0000", 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0506000000000001e-05 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361724+0000", 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4843e-05 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371143+0000", 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094190100000000002 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371293+0000", 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150669 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379558+0000", 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082649969999999996 2024-04-26T12:15:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379620+0000", 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1698000000000005e-05 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379676+0000", 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6168000000000002e-05 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9615157979999998, 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:15:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9611632370000001, 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:15:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9573723269999999, 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:15:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:15:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:15:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9499752990000001, 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:15:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:15:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:15:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.945466004, 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:15:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:15:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:15:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9427039759999998, 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:15:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:15:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:15:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:149752 5.a 5:59e73ebb:::benchmark_data_smithi069_31227_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0208462810000001, 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018927920000000001, 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 149752 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296051+0000", 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296491+0000", 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000439813 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296502+0000", 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-04-26T12:15:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296508+0000", 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296552+0000", 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3480999999999999e-05 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296683+0000", 2024-04-26T12:15:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013126899999999999 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296823+0000", 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139782 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.300824+0000", 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040012720000000002 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314902+0000", 2024-04-26T12:15:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01407796 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314941+0000", 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8773000000000003e-05 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314980+0000", 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:57.427 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:57.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:57.429 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.426+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.529 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.528+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:153118 5.d 5:b7912047:::benchmark_data_smithi069_31227_object153117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.573600+0000", 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042113940000000002, 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042378540000000001, 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.579 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153118 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573600+0000", 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573600+0000", 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573600+0000", 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573702+0000", 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102377 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573709+0000", 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.64e-06 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573714+0000", 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5850000000000001e-06 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573749+0000", 2024-04-26T12:15:57.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5515999999999997e-05 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573831+0000", 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2099000000000001e-05 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:153120 5.d 5:bceeb653:::benchmark_data_smithi069_31227_object153119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.573763+0000", 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040486630000000001, 2024-04-26T12:15:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004154296, 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153120 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573763+0000", 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573763+0000", 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573762+0000", 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573812+0000", 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9508000000000001e-05 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573823+0000", 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1021e-05 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.573831+0000", 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2709999999999992e-06 2024-04-26T12:15:57.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576075+0000", 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022442270000000001 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576207+0000", 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000131431 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.587 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:153117 5.a e37/16 5:55d4603e:::benchmark_data_smithi069_31227_object153116:head v 37'9481, mlcod=37'9479)", 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.574095+0000", 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037173760000000001, 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038983469999999999, 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574095+0000", 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574095+0000", 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574094+0000", 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574163+0000", 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8646999999999995e-05 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574171+0000", 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5580000000000001e-06 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574176+0000", 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0730000000000004e-06 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574216+0000", 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9631000000000001e-05 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574235+0000", 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8808e-05 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:153122 5.f 5:f9e5f439:::benchmark_data_smithi069_31227_object153121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.574150+0000", 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0036614519999999999, 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039069220000000002, 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153122 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574150+0000", 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574150+0000", 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574150+0000", 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574697+0000", 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00054773199999999999 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574708+0000", 2024-04-26T12:15:57.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0132999999999999e-05 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574715+0000", 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.289e-06 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.575698+0000", 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00098265900000000009 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.575812+0000", 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114468 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:153125 5.4 5:2f2977da:::benchmark_data_smithi069_31227_object153124:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.574726+0000", 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003085389, 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033932300000000001, 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.595 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153125 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574726+0000", 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574726+0000", 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574726+0000", 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574752+0000", 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6624000000000001e-05 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574760+0000", 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.537e-06 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574766+0000", 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5389999999999998e-06 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574828+0000", 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2737999999999995e-05 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.575009+0000", 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018033599999999999 2024-04-26T12:15:57.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.575178+0000", 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016917000000000001 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578121+0000", 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029427989999999998 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:153127 5.d 5:bc268b8c:::benchmark_data_smithi069_31227_object153126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.574971+0000", 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002840436, 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031917270000000001, 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153127 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574971+0000", 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574971+0000", 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.574971+0000", 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.575096+0000", 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012513300000000001 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.575105+0000", 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2210000000000003e-06 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.575112+0000", 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5390000000000004e-06 2024-04-26T12:15:57.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578073+0000", 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002961085 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:153119 5.a e37/16 5:5abbdc89:::benchmark_data_smithi069_31227_object153118:head v 37'9482, mlcod=37'9479)", 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.576339+0000", 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014723889999999999, 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018634739999999999, 2024-04-26T12:15:57.603 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576339+0000", 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576339+0000", 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576339+0000", 2024-04-26T12:15:57.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576372+0000", 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3324999999999997e-05 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576381+0000", 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2979999999999997e-06 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576387+0000", 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:15:57.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576431+0000", 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3850000000000002e-05 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.576450+0000", 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8759000000000001e-05 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:153131 5.b 5:d3bd0ce4:::benchmark_data_smithi069_31227_object153130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.577565+0000", 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00024732999999999998, 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00068262599999999998, 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153131 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.607 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577565+0000", 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577565+0000", 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577563+0000", 2024-04-26T12:15:57.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577624+0000", 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1261999999999997e-05 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577634+0000", 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0037000000000001e-05 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577641+0000", 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6250000000000001e-06 2024-04-26T12:15:57.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577695+0000", 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3538999999999997e-05 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577817+0000", 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000122698 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:57.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.577935+0000", 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011722699999999999 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:153134 5.d 5.80ff731d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:57.578120+0000", 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.999692, 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164647, 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 153134 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578120+0000", 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578120+0000", 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578119+0000", 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578158+0000", 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.892e-05 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578165+0000", 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6139999999999997e-06 2024-04-26T12:15:57.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:57.578170+0000", 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6860000000000003e-06 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-26T12:15:57.614 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:57.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:57.659 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:57.658+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:57.730 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.729+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 53 16 153625 153609 181.128 166 0.00433086 0.00551852 2024-04-26T12:15:57.767 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:57.767 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:15:57.767 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:15:57.767 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:15:57.767 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:57.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:57.831 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.830+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.932 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:57.931+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:57.969 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:15:57.969 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:15:57.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:15:57.969 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:15:57.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.908776187000001, 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:15:57.975 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.666837227999999, 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.976 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:15:57.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:15:57.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 34.666332738999998, 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.982 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:15:57.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:15:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 31.875341097, 2024-04-26T12:15:57.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:15:57.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.523130251000001, 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:57.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:15:57.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:15:57.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:57.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.333083727999998, 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:58.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.005 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.006 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:58.006 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:58.006 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.33196856, 2024-04-26T12:15:58.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:15:58.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.011 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.331695975999999, 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:15:58.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.330429419000001, 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:15:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:15:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.330221971, 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:15:58.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.329796486999999, 2024-04-26T12:15:58.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:15:58.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:15:58.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.329525546999999, 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:15:58.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:15:58.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.328451548, 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.039 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:58.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:15:58.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:15:58.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:15:58.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:15:58.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:15:58.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:15:58.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.610948909000001, 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:15:58.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:15:58.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:15:58.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.054 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.610712518, 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.055 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:15:58.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:15:58.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.738828927, 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.061 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:15:58.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:15:58.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:58.067 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.859494818000002, 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:15:58.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:15:58.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:15:58.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:15:58.073 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.858329196, 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:15:58.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.077 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:15:58.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 14.667939296, 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.083 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:58.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:15:58.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:15:58.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:15:58.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.090 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 13.079009916, 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:15:58.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:15:58.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:15:58.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:15:58.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:15:58.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:15:58.097 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:15:58.099 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:58.097+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:58.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:58.199 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:58.198+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:58.260 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154931 5.5 5:a3138fd0:::benchmark_data_smithi069_31227_object154930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.249721+0000", 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0086706040000000002, 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086990769999999995, 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154931 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.249721+0000", 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.249721+0000", 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.249721+0000", 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.249752+0000", 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1062999999999997e-05 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.249761+0000", 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0960000000000007e-06 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.249767+0000", 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3949999999999998e-06 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.250661+0000", 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089371899999999996 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.250791+0000", 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012979699999999999 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154936 5.5 5:a7eaff56:::benchmark_data_smithi069_31227_object154935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.252478+0000", 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0059141999999999997, 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060214810000000004, 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154936 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252478+0000", 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252478+0000", 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252477+0000", 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252565+0000", 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8319000000000006e-05 2024-04-26T12:15:58.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252573+0000", 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252578+0000", 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252683+0000", 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010558200000000001 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.252794+0000", 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110896 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154938 5.5 5:a2bae64c:::benchmark_data_smithi069_31227_object154937:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.253224+0000", 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0051682339999999998, 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053472440000000001, 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154938 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253224+0000", 2024-04-26T12:15:58.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253224+0000", 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253223+0000", 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253282+0000", 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8717e-05 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253291+0000", 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.302e-06 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253296+0000", 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5059999999999997e-06 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254710+0000", 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014138849999999999 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254841+0000", 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013150600000000001 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154939 5.5 5:a04281d3:::benchmark_data_smithi069_31227_object154938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.253328+0000", 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0050645760000000003, 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053119609999999996, 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154939 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253328+0000", 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253328+0000", 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253327+0000", 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253399+0000", 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2031000000000002e-05 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253404+0000", 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0300000000000001e-06 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.253408+0000", 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4039999999999999e-06 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256846+0000", 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034385000000000002 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256969+0000", 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012277300000000001 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154942 5.5 5.c0872e45 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.254411+0000", 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003980964, 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004287384, 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154942 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254411+0000", 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254411+0000", 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254410+0000", 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254438+0000", 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7461999999999999e-05 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254449+0000", 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1202e-05 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254456+0000", 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0870000000000001e-06 2024-04-26T12:15:58.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154946 5.1 5:84e3f164:::benchmark_data_smithi069_31227_object154945:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.254712+0000", 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0036795819999999998, 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040368519999999996, 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154946 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254712+0000", 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254712+0000", 2024-04-26T12:15:58.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254712+0000", 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254824+0000", 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112722 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254834+0000", 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1549999999999996e-06 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.254840+0000", 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8050000000000001e-06 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255873+0000", 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001033062 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255998+0000", 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012442400000000001 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:154945 5.4 e37/16 5:2f621f90:::benchmark_data_smithi069_31227_object154944:head v 37'9550, mlcod=37'9548)", 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.255161+0000", 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0032309999999999999, 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036453670000000001, 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.288 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255161+0000", 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255161+0000", 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255160+0000", 2024-04-26T12:15:58.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255221+0000", 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0912000000000002e-05 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255231+0000", 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6059999999999992e-06 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255237+0000", 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255290+0000", 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3378999999999998e-05 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255308+0000", 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7649999999999999e-05 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154947 5.a 5:568b91d1:::benchmark_data_smithi069_31227_object154946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.255278+0000", 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0031142869999999999, 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035852789999999998, 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154947 2024-04-26T12:15:58.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255278+0000", 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255278+0000", 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255277+0000", 2024-04-26T12:15:58.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255383+0000", 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105672 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255392+0000", 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3889999999999994e-06 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255398+0000", 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2820000000000002e-06 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255581+0000", 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018306299999999999 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255737+0000", 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015534300000000001 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.255888+0000", 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015072800000000001 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154948 5.3 5:c1c53eef:::benchmark_data_smithi069_31227_object154947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.256070+0000", 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002322321, 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028585080000000001, 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154948 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256070+0000", 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256070+0000", 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256069+0000", 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256158+0000", 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8945999999999998e-05 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256170+0000", 2024-04-26T12:15:58.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1846e-05 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256176+0000", 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256216+0000", 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0185000000000002e-05 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256355+0000", 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139054 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154951 5.5 5.deb77315 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.256916+0000", 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001476057, 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020769120000000002, 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154951 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256916+0000", 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256916+0000", 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.256915+0000", 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257021+0000", 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105621 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257031+0000", 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7340000000000003e-06 2024-04-26T12:15:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257038+0000", 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9759999999999998e-06 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:154950 5.4 e37/16 5:292b326f:::benchmark_data_smithi069_31227_object154949:head v 37'9551, mlcod=37'9548)", 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.257291+0000", 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011012730000000001, 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001751346, 2024-04-26T12:15:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257291+0000", 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257291+0000", 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257290+0000", 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257344+0000", 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3903000000000002e-05 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257357+0000", 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2680000000000001e-05 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257363+0000", 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2149999999999998e-06 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257702+0000", 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000339403 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257720+0000", 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8274000000000002e-05 2024-04-26T12:15:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154952 5.a 5:5f3bcfe6:::benchmark_data_smithi069_31227_object154951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.257975+0000", 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00041754800000000001, 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011217779999999999, 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154952 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257975+0000", 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257975+0000", 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.257974+0000", 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258037+0000", 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258055+0000", 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7192000000000001e-05 2024-04-26T12:15:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258070+0000", 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5707000000000001e-05 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258129+0000", 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8183000000000002e-05 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258249+0000", 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012092200000000001 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258378+0000", 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128169 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154953 5.6 5:6de8dc9d:::benchmark_data_smithi069_31227_object154952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.258082+0000", 2024-04-26T12:15:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000309859, 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010791119999999999, 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154953 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258082+0000", 2024-04-26T12:15:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258082+0000", 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258082+0000", 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258111+0000", 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8878e-05 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258118+0000", 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829999999999997e-06 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258123+0000", 2024-04-26T12:15:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5269999999999998e-06 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258167+0000", 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000001e-05 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258283+0000", 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116135 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:154955 5.7 5:e1509fef:::benchmark_data_smithi069_31227_object154954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:58.258244+0000", 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00014762, 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097872699999999998, 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154955 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258244+0000", 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258244+0000", 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258244+0000", 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:15:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258302+0000", 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7978e-05 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258313+0000", 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0858e-05 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:15:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258319+0000", 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0839999999999997e-06 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258356+0000", 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7697000000000002e-05 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:58.258489+0000", 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013296299999999999 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:15:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:15:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:15:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 14 2024-04-26T12:15:58.320 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:15:58.320 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:15:58.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:58.322 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:58.320+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:58.422 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:58.421+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:58.442 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:15:58.442 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:15:58.443 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:15:58.460 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:15:58.460 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:15:58.463 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:15:58.463 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:15:58.522 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:58.523 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:58.523 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:58.521+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:58.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:58.624 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:58.622+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:58.724 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:58.723+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:58.733 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:58.733 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:58.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:58.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 54 16 156234 156218 180.794 163.062 0.0045856 0.00552876 2024-04-26T12:15:58.810 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:15:58.825 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:58.824+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:58.898 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:58.898 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:58.910 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:58.953 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:58.952+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:59.027 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:59.025+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:59.055 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:59.055 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:59.069 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:15:59.153 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:59.152+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:59.229 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:59.227+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:59.258 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:59.258 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:59.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:15:59.329 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:59.328+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:59.425 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:59.425 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:59.430 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:59.429+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:59.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:15:59.531 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:59.530+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:59.596 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:59.596 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:59.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:15:59.633 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:59.632+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:15:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:59.732 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:59.733 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:59.732+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:59.745 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:15:59.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 55 16 158560 158544 180.149 145.375 0.00708239 0.00554858 2024-04-26T12:15:59.799 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:15:59.835 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:15:59.833+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:15:59.895 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:15:59.895 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:15:59.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:15:59.950 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:15:59.949+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:00.037 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:00.035+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:00.054 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:00.054 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:00.065 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:00.138 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:00.136+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:00.240 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:00.237+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:00.257 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:00.257 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:00.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:00.341 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:00.338+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:00.429 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:00.429 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:00.440 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:00.439+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:00.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:00.464 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:00.542 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:00.540+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:00.586 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:00.625 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:00.626 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:00.626 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:00.626 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:00.638 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:00.638 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:00.643 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:00.641+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:00.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:00.743 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:00.742+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:00.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 56 16 161165 161149 179.839 162.812 0.00978846 0.00555799 2024-04-26T12:16:00.844 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:00.843+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:00.849 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.639974920999997, 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:16:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:65658 5.a 5:564da651:::benchmark_data_smithi069_31227_object65657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.144641845000002, 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017930952999999999, 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65658 2024-04-26T12:16:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701762+0000", 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701761+0000", 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701826+0000", 2024-04-26T12:16:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5067999999999994e-05 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701836+0000", 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.701842+0000", 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702854+0000", 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010118620000000001 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.702971+0000", 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117071 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.703101+0000", 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013059200000000001 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.708817+0000", 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057155549999999998 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719621+0000", 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010804015 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719661+0000", 2024-04-26T12:16:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9916000000000002e-05 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:23.719693+0000", 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1989999999999997e-05 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.613134881000001, 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:16:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.612405170999999, 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75218 5.a 5:57d22369:::benchmark_data_smithi069_31227_object75217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.459287007999997, 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017851921999999999, 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75218 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387117+0000", 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387116+0000", 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387143+0000", 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6423000000000001e-05 2024-04-26T12:16:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387149+0000", 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0519999999999998e-06 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.387152+0000", 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4529999999999998e-06 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394196+0000", 2024-04-26T12:16:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070435710000000002 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394307+0000", 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111203 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.394476+0000", 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016894300000000001 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.400658+0000", 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006181827 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404857+0000", 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004199141 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404930+0000", 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3281999999999994e-05 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.404969+0000", 2024-04-26T12:16:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-05 2024-04-26T12:16:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.455858587000002, 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:16:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.651871442000001, 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:16:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:16:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:16:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:16:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:16:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.213349349000001, 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.809091892000001, 2024-04-26T12:16:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:16:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:16:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:16:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:16:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:16:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:16:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:16:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.808936258999999, 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.553095702, 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:16:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:16:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:16:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:16:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:16:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:16:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4869893530000002, 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139464 5.6 5:65933418:::benchmark_data_smithi069_31227_object139463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4847606980000005, 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018033270000000001, 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139464 2024-04-26T12:16:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361642+0000", 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361698+0000", 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6433e-05 2024-04-26T12:16:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361709+0000", 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0506000000000001e-05 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361724+0000", 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4843e-05 2024-04-26T12:16:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371143+0000", 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094190100000000002 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371293+0000", 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150669 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379558+0000", 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082649969999999996 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379620+0000", 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1698000000000005e-05 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379676+0000", 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6168000000000002e-05 2024-04-26T12:16:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4910213150000002, 2024-04-26T12:16:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:00.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:00.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:00.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:00.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:00.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:00.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4906687539999997, 2024-04-26T12:16:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:00.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4868778440000003, 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:00.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4794808159999997, 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:00.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4749715209999996, 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:16:00.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4722094930000003, 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:16:00.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:16:00.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:149752 5.a 5:59e73ebb:::benchmark_data_smithi069_31227_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5503517980000003, 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018927920000000001, 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 149752 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296051+0000", 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296491+0000", 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000439813 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296502+0000", 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:00.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296508+0000", 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296552+0000", 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3480999999999999e-05 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296683+0000", 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013126899999999999 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296823+0000", 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139782 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.300824+0000", 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040012720000000002 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314902+0000", 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01407796 2024-04-26T12:16:00.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314941+0000", 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8773000000000003e-05 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314980+0000", 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:00.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:00.980 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:00.981 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:00.981 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:00.979+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:01.081 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:01.080+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:01.132 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:01.132 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:01.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162156 5.e 5:73681b03:::benchmark_data_smithi069_31227_object162155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.122394+0000", 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0080961009999999996, 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0081226660000000006, 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162156 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.133 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122394+0000", 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122394+0000", 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122393+0000", 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122501+0000", 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010793099999999999 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122521+0000", 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0336999999999999e-05 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122528+0000", 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8009999999999998e-06 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122589+0000", 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1199999999999997e-05 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122714+0000", 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012492300000000001 2024-04-26T12:16:01.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.122847+0000", 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013216899999999999 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162164 5.8 5:10520ef8:::benchmark_data_smithi069_31227_object162163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.125110+0000", 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0053808989999999998, 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054831690000000004, 2024-04-26T12:16:01.137 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162164 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125110+0000", 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125110+0000", 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125109+0000", 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125197+0000", 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7793999999999993e-05 2024-04-26T12:16:01.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125208+0000", 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0614e-05 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125214+0000", 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125277+0000", 2024-04-26T12:16:01.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2476000000000003e-05 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125394+0000", 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116929 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125541+0000", 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014726499999999999 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128369+0000", 2024-04-26T12:16:01.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028281970000000002 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162166 5.0 5:091ddc1c:::benchmark_data_smithi069_31227_object162165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.125250+0000", 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052406019999999996, 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054162009999999998, 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.142 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162166 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125250+0000", 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125250+0000", 2024-04-26T12:16:01.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125249+0000", 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125294+0000", 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4529e-05 2024-04-26T12:16:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125303+0000", 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5779999999999999e-06 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125308+0000", 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125341+0000", 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3151000000000002e-05 2024-04-26T12:16:01.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125482+0000", 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000140736 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125612+0000", 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013029599999999999 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128375+0000", 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027624559999999999 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162167 5.e 5:71628733:::benchmark_data_smithi069_31227_object162166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.125316+0000", 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0051748940000000002, 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054247030000000003, 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162167 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125316+0000", 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125316+0000", 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125315+0000", 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125376+0000", 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1215000000000003e-05 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125384+0000", 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125390+0000", 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6099999999999997e-06 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125438+0000", 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8430000000000002e-05 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125562+0000", 2024-04-26T12:16:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012410700000000001 2024-04-26T12:16:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.125705+0000", 2024-04-26T12:16:01.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000142447 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162171 5.e 5:764d2813:::benchmark_data_smithi069_31227_object162170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.127119+0000", 2024-04-26T12:16:01.153 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033710390000000002, 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036870800000000001, 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162171 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127119+0000", 2024-04-26T12:16:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127119+0000", 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127118+0000", 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127192+0000", 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3647999999999997e-05 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127206+0000", 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4362000000000001e-05 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127213+0000", 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2859999999999996e-06 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127712+0000", 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00049920800000000001 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127824+0000", 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011210899999999999 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.127969+0000", 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014489900000000001 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.157 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162173 5.e 5:7b0e20e1:::benchmark_data_smithi069_31227_object162172:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.128124+0000", 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002366571, 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027483870000000001, 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162173 2024-04-26T12:16:01.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128124+0000", 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128124+0000", 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128123+0000", 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128152+0000", 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9407000000000002e-05 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128164+0000", 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1809e-05 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128170+0000", 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129835+0000", 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016649379999999999 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129978+0000", 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014264099999999999 2024-04-26T12:16:01.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130130+0000", 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015187800000000001 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162175 5.4 5:2e93625f:::benchmark_data_smithi069_31227_object162174:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.128869+0000", 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016216469999999999, 2024-04-26T12:16:01.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020723159999999998, 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162175 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128869+0000", 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128869+0000", 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128868+0000", 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128921+0000", 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2837999999999998e-05 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128932+0000", 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1613999999999999e-05 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128940+0000", 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1679999999999998e-06 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.128985+0000", 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5435000000000001e-05 2024-04-26T12:16:01.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129101+0000", 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116098 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129225+0000", 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000123817 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162176 5.8 5:1d877ddc:::benchmark_data_smithi069_31227_object162175:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.129002+0000", 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001488907, 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020141540000000002, 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162176 2024-04-26T12:16:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129002+0000", 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129002+0000", 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129001+0000", 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129066+0000", 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5530000000000004e-05 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129075+0000", 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5629999999999992e-06 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129081+0000", 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.699e-06 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129140+0000", 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9206000000000002e-05 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129271+0000", 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013076 2024-04-26T12:16:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129406+0000", 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013566300000000001 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:162164 5.8 e38/16)", 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.129098+0000", 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001392045, 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019788679999999999, 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129098+0000", 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129098+0000", 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129098+0000", 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129101+0000", 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9299999999999999e-06 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129107+0000", 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129112+0000", 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1799999999999998e-06 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162177 5.e 5.438437ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.129344+0000", 2024-04-26T12:16:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0011460680000000001, 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017758299999999999, 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162177 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129344+0000", 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129344+0000", 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129344+0000", 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129384+0000", 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0297999999999999e-05 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129393+0000", 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9900000000000003e-06 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129399+0000", 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5300000000000004e-06 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:162166 5.0 e38/16)", 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.129430+0000", 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010608919999999999, 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0017365499999999999, 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129430+0000", 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129430+0000", 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129429+0000", 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129432+0000", 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129439+0000", 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5209999999999999e-06 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.129443+0000", 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162180 5.8 5.5eadf898 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.180 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.130361+0000", 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00012911699999999999, 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00084596400000000005, 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162180 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130361+0000", 2024-04-26T12:16:01.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130361+0000", 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130360+0000", 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130470+0000", 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109238 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130487+0000", 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6969e-05 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130494+0000", 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0219999999999999e-06 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.183 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:162182 5.9 5:931c0aae:::benchmark_data_smithi069_31227_object162181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:01.130708+0000", 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.999783, 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00055744799999999999, 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.184 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 162182 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130708+0000", 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130708+0000", 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130707+0000", 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130796+0000", 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9011000000000005e-05 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130804+0000", 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3219999999999993e-06 2024-04-26T12:16:01.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130810+0000", 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130839+0000", 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9592000000000001e-05 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:01.130919+0000", 2024-04-26T12:16:01.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9365999999999999e-05 2024-04-26T12:16:01.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.188 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.188 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.188 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:01.188 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 13 2024-04-26T12:16:01.188 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:01.190 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:01.190 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:01.188+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:01.290 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:01.289+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:01.374 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:01.375 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:01.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:01.391 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:01.389+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:01.491 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:01.490+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:01.539 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:01.540 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:01.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:01.540 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:01.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.540 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:01.541 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:01.541 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.477521572999997, 2024-04-26T12:16:01.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:16:01.541 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.541 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.541 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.542 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.542 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:16:01.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.542 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.542 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:01.543 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.543 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.543 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:01.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.544 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.544 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:16:01.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:16:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:16:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:16:01.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:16:01.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:16:01.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:16:01.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.550 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.235582614000002, 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:01.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:16:01.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.235078125000001, 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:16:01.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:16:01.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:16:01.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:16:01.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.564 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.444086483, 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:16:01.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:16:01.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.091875637000001, 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:16:01.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:16:01.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.901829114000002, 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:01.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.900713946, 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.581 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:01.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.900441361999999, 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:01.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:01.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.899174805000001, 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.592 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:01.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.898967357, 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.597 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:01.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.898541872999999, 2024-04-26T12:16:01.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:01.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:01.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:01.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.898270932999999, 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:01.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:01.612 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.897196934, 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:01.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:01.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:01.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:01.618 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.179694295000001, 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:16:01.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:16:01.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.179457904, 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:16:01.624 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:16:01.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.307574313, 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:01.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:16:01.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.428240204000002, 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:16:01.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:16:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.427074581999999, 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:16:01.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:16:01.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:01.647 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 18.236684682, 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:01.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:16:01.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:16:01.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.647755302, 2024-04-26T12:16:01.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:16:01.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:16:01.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:01.659 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:01.660 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:01.659+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:01.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:01.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 57 16 163847 163831 179.625 167.625 0.0122046 0.00556473 2024-04-26T12:16:01.761 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:01.759+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:01.813 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:16:01.820 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:163983 5.8 e38/16 5:11933894:::benchmark_data_smithi069_31227_object163982:head v 38'10307, mlcod=38'10305)", 2024-04-26T12:16:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.811214+0000", 2024-04-26T12:16:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.006875211, 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068981720000000002, 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811214+0000", 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811214+0000", 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811210+0000", 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999962 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811263+0000", 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3124999999999997e-05 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811274+0000", 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0555e-05 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811281+0000", 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7399999999999998e-06 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811333+0000", 2024-04-26T12:16:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2281000000000003e-05 2024-04-26T12:16:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811353+0000", 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0142000000000001e-05 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:163992 5.7 5:e1912fb8:::benchmark_data_smithi069_31227_object163991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.811828+0000", 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0062610310000000002, 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063566810000000003, 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 163992 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811828+0000", 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811828+0000", 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811827+0000", 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811883+0000", 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5609999999999998e-05 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811896+0000", 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.811903+0000", 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0489999999999998e-06 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813558+0000", 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016558600000000001 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813691+0000", 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013226199999999999 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:163984 5.8 e38/16 5:1d57a92b:::benchmark_data_smithi069_31227_object163983:head v 38'10308, mlcod=38'10305)", 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.813597+0000", 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0044924049999999997, 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046705790000000002, 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813597+0000", 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813597+0000", 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813596+0000", 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813643+0000", 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6860999999999997e-05 2024-04-26T12:16:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813653+0000", 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0156999999999999e-05 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.813658+0000", 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814203+0000", 2024-04-26T12:16:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000544806 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814221+0000", 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7663999999999999e-05 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:163988 5.e e38/16 5:7728d13c:::benchmark_data_smithi069_31227_object163987:head v 38'10292, mlcod=38'10287)", 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.814281+0000", 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038076519999999999, 2024-04-26T12:16:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040441080000000003, 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814281+0000", 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814281+0000", 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814281+0000", 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814342+0000", 2024-04-26T12:16:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0763000000000001e-05 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814354+0000", 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2320000000000001e-05 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814360+0000", 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9819999999999996e-06 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815835+0000", 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00147565 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815851+0000", 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937e-05 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:163997 5.7 5:e9262b87:::benchmark_data_smithi069_31227_object163996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.814992+0000", 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0030971530000000001, 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034017959999999999, 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 163997 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814992+0000", 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814992+0000", 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.814991+0000", 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815034+0000", 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2454999999999999e-05 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815043+0000", 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.969e-06 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815048+0000", 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3249999999999998e-06 2024-04-26T12:16:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815794+0000", 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074591000000000002 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815918+0000", 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123743 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:163986 5.8 e38/16 5:1646b5c4:::benchmark_data_smithi069_31227_object163985:head v 38'10309, mlcod=38'10305)", 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.815765+0000", 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0023238009999999999, 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026937110000000001, 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815765+0000", 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815765+0000", 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815765+0000", 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815816+0000", 2024-04-26T12:16:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1780999999999998e-05 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815826+0000", 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6700000000000006e-06 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815843+0000", 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6575e-05 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816535+0000", 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069275200000000004 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816555+0000", 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9437999999999999e-05 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:163987 5.0 e38/16 5:0afcc713:::benchmark_data_smithi069_31227_object163986:head v 38'10268, mlcod=38'10266)", 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.815851+0000", 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002237602, 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002666514, 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815851+0000", 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815851+0000", 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815851+0000", 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815890+0000", 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815897+0000", 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9689999999999997e-06 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815902+0000", 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9529999999999998e-06 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816513+0000", 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061160700000000001 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816531+0000", 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7050000000000001e-05 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164000 5.7 5:e7f0c6e8:::benchmark_data_smithi069_31227_object163999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.815985+0000", 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0021037709999999999, 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026050700000000001, 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164000 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815985+0000", 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815985+0000", 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.815985+0000", 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816035+0000", 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0473000000000003e-05 2024-04-26T12:16:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816044+0000", 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3039999999999994e-06 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816051+0000", 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5560000000000004e-06 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.817879+0000", 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018279800000000001 2024-04-26T12:16:01.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818025+0000", 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014657799999999999 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164002 5.1 5:83a7bfcf:::benchmark_data_smithi069_31227_object164001:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.816286+0000", 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0018026889999999999, 2024-04-26T12:16:01.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023774830000000001, 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164002 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816286+0000", 2024-04-26T12:16:01.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816286+0000", 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816286+0000", 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816339+0000", 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3358e-05 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816347+0000", 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.542e-06 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816351+0000", 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3789999999999999e-06 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816380+0000", 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8688e-05 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.816493+0000", 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011325800000000001 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164003 5.6 5:668cd03c:::benchmark_data_smithi069_31227_object164002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.818114+0000", 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999747, 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061586799999999999, 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:01.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164003 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818114+0000", 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818114+0000", 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:01.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818114+0000", 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818160+0000", 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6476e-05 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818171+0000", 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0543000000000001e-05 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818177+0000", 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4389999999999997e-06 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818230+0000", 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2743e-05 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.818370+0000", 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013975599999999999 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.861 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:01.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:01.862 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:01.862 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 10 2024-04-26T12:16:01.862 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:01.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-26T12:16:01.863 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:01.862+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:01.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:01.964 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:01.963+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:02.061 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:02.062 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:02.065 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:02.064+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:02.075 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:02.166 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:02.165+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:02.267 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:02.266+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.062298513000002, 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:16:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.035458472999998, 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:16:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:16:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:16:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:16:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:16:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:16:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:16:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.034728762999997, 2024-04-26T12:16:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.878182179, 2024-04-26T12:16:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:16:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.074195033999999, 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:16:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.635672940999999, 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.231415483999999, 2024-04-26T12:16:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:16:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:16:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:16:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:16:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:16:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:16:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.231259851000001, 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.975419294000002, 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:16:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:16:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.9093129449999999, 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139464 5.6 5:65933418:::benchmark_data_smithi069_31227_object139463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.9070842900000002, 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018033270000000001, 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139464 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361642+0000", 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361698+0000", 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6433e-05 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361709+0000", 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0506000000000001e-05 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361724+0000", 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4843e-05 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371143+0000", 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094190100000000002 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371293+0000", 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150669 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379558+0000", 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082649969999999996 2024-04-26T12:16:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379620+0000", 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1698000000000005e-05 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379676+0000", 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6168000000000002e-05 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9133449070000008, 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9129923459999993, 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.909201436, 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9018044080000003, 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.8972951130000002, 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:16:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.8945330849999991, 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:16:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:149752 5.a 5:59e73ebb:::benchmark_data_smithi069_31227_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.97267539, 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018927920000000001, 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 149752 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296051+0000", 2024-04-26T12:16:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296491+0000", 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000439813 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296502+0000", 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296508+0000", 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:16:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296552+0000", 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3480999999999999e-05 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296683+0000", 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013126899999999999 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296823+0000", 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139782 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.300824+0000", 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040012720000000002 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314902+0000", 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01407796 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314941+0000", 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8773000000000003e-05 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314980+0000", 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:162791 5.2 5:4fb88c73:::benchmark_data_smithi069_31227_object162790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.91328122099999998, 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017947762999999999, 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162791 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355482+0000", 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5976000000000002e-05 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355491+0000", 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2040000000000003e-06 2024-04-26T12:16:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355496+0000", 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.364579+0000", 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009082896 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.364706+0000", 2024-04-26T12:16:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126735 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373279+0000", 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085727760000000007 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373323+0000", 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4233000000000002e-05 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373394+0000", 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0926000000000005e-05 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164265 5.2 5:429fc2e1:::benchmark_data_smithi069_31227_object164264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.357488062, 2024-04-26T12:16:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018708573999999999, 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164265 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911333+0000", 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4102000000000001e-05 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911339+0000", 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911343+0000", 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1799999999999998e-06 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919312+0000", 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079682869999999992 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919441+0000", 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012956999999999999 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929814+0000", 2024-04-26T12:16:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010372476 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929870+0000", 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6647000000000002e-05 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929948+0000", 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7612000000000002e-05 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:02.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:02.393 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:02.394 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:02.392+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:02.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:02.495 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:02.494+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165894 5.8 5:120cf6b2:::benchmark_data_smithi069_31227_object165893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.542022+0000", 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00019038799999999999, 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020796200000000001, 2024-04-26T12:16:02.544 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165894 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542022+0000", 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542022+0000", 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542021+0000", 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542086+0000", 2024-04-26T12:16:02.546 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4369999999999995e-05 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542091+0000", 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0130000000000001e-06 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542094+0000", 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3419999999999999e-06 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.547 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542126+0000", 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2347e-05 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542214+0000", 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7196999999999999e-05 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:165888 5.e e38/16)", 2024-04-26T12:16:02.548 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.542180+0000", 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1990999999999999e-05, 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1291000000000004e-05, 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542180+0000", 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542180+0000", 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542179+0000", 2024-04-26T12:16:02.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542184+0000", 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542195+0000", 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0438999999999999e-05 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542201+0000", 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2430000000000002e-06 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165870 5.8 5:1ea714c1:::benchmark_data_smithi069_31227_object165869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.530092+0000", 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.012120306000000001, 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012210285, 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.552 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165870 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530092+0000", 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530092+0000", 2024-04-26T12:16:02.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530091+0000", 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530152+0000", 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0798000000000003e-05 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530163+0000", 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0706e-05 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530169+0000", 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8279999999999997e-06 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534014+0000", 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038445060000000001 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534121+0000", 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106941 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534255+0000", 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134587 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538867+0000", 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046118490000000003 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165871 5.0 5:0cf8c917:::benchmark_data_smithi069_31227_object165870:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.530197+0000", 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.012014990999999999, 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.012148028, 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.557 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165871 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530197+0000", 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530197+0000", 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530196+0000", 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530235+0000", 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8109999999999999e-05 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530243+0000", 2024-04-26T12:16:02.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.619e-06 2024-04-26T12:16:02.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.530263+0000", 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9947999999999999e-05 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534065+0000", 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038014870000000001 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534185+0000", 2024-04-26T12:16:02.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120207 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534321+0000", 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000135852 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537452+0000", 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031318499999999998 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165876 5.b 5:dde3b2c9:::benchmark_data_smithi069_31227_object165875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.533490+0000", 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0087219629999999992, 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089007029999999994, 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165876 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.564 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533490+0000", 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533490+0000", 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533489+0000", 2024-04-26T12:16:02.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533564+0000", 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4980000000000004e-05 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533574+0000", 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2e-06 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533580+0000", 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.472e-06 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.535853+0000", 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022728370000000002 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536020+0000", 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000167491 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536150+0000", 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012952100000000001 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.541812+0000", 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056620680000000001 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.568 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165877 5.8 5:140172c1:::benchmark_data_smithi069_31227_object165876:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.533588+0000", 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0086240050000000006, 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088447960000000003, 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165877 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533588+0000", 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533588+0000", 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533587+0000", 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533624+0000", 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6136000000000001e-05 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533631+0000", 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533648+0000", 2024-04-26T12:16:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7448999999999998e-05 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536419+0000", 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027705920000000001 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536549+0000", 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013043700000000001 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536694+0000", 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014503300000000001 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.540138+0000", 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034436800000000002 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165878 5.b 5:d36f8199:::benchmark_data_smithi069_31227_object165877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.573 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.533676+0000", 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0085358989999999996, 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087975099999999997, 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165878 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533676+0000", 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533676+0000", 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533676+0000", 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533717+0000", 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1043e-05 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533726+0000", 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.645e-06 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533732+0000", 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3070000000000002e-06 2024-04-26T12:16:02.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538915+0000", 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051838429999999996 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539045+0000", 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012961799999999999 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539181+0000", 2024-04-26T12:16:02.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000135955 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.541924+0000", 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027426099999999999 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165879 5.e 5:73a43f47:::benchmark_data_smithi069_31227_object165878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.533803+0000", 2024-04-26T12:16:02.578 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0084086479999999995, 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087134710000000004, 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165879 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533803+0000", 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533803+0000", 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533803+0000", 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533865+0000", 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2198000000000003e-05 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533876+0000", 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0684e-05 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.533882+0000", 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7340000000000002e-06 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.535327+0000", 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014451150000000001 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.535569+0000", 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000241835 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.535778+0000", 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020829600000000001 2024-04-26T12:16:02.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.541794+0000", 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060167140000000003 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165881 5.f 5:fb864336:::benchmark_data_smithi069_31227_object165880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.534062+0000", 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0081500949999999996, 2024-04-26T12:16:02.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.008496544, 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165881 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534062+0000", 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534062+0000", 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534061+0000", 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534120+0000", 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9218999999999997e-05 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534130+0000", 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0990000000000005e-06 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534136+0000", 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5089999999999999e-06 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534182+0000", 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5735000000000002e-05 2024-04-26T12:16:02.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.534308+0000", 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012631599999999999 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165885 5.4 5:275472cb:::benchmark_data_smithi069_31227_object165884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.536678+0000", 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055341940000000001, 2024-04-26T12:16:02.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059157009999999998, 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165885 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536678+0000", 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536678+0000", 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536677+0000", 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536813+0000", 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136255 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536828+0000", 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5089000000000001e-05 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536836+0000", 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1079999999999993e-06 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536878+0000", 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1363999999999999e-05 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.536954+0000", 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6516999999999999e-05 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537039+0000", 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5257e-05 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.541861+0000", 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048212769999999997 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165888 5.e 5:78fbb359:::benchmark_data_smithi069_31227_object165887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.537599+0000", 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046127800000000004, 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050354659999999997, 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165888 2024-04-26T12:16:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537599+0000", 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537599+0000", 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537598+0000", 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537647+0000", 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8677000000000002e-05 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537669+0000", 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.234e-05 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.537675+0000", 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.835e-06 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538961+0000", 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012857680000000001 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539074+0000", 2024-04-26T12:16:02.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011314799999999999 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539192+0000", 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117695 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165889 5.d 5:bceccd2e:::benchmark_data_smithi069_31227_object165888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.538659+0000", 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035528420000000001, 2024-04-26T12:16:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040133189999999996, 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165889 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538659+0000", 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538659+0000", 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538659+0000", 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538732+0000", 2024-04-26T12:16:02.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3807000000000007e-05 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538742+0000", 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2289999999999992e-06 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538746+0000", 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538788+0000", 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1832000000000002e-05 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.538905+0000", 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117496 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165890 5.4 5:28e641bb:::benchmark_data_smithi069_31227_object165889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.539327+0000", 2024-04-26T12:16:02.601 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028848749999999999, 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00338018, 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165890 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539327+0000", 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539327+0000", 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539327+0000", 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539403+0000", 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6126999999999998e-05 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539411+0000", 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4980000000000006e-06 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539416+0000", 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6190000000000002e-06 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539442+0000", 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6040000000000001e-05 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539535+0000", 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3169000000000002e-05 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.539613+0000", 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8361000000000004e-05 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542268+0000", 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002654698 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:165893 5.e 5:787a83ab:::benchmark_data_smithi069_31227_object165892:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:02.541914+0000", 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00029839599999999998, 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00083772399999999998, 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 165893 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.541914+0000", 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.541914+0000", 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.541913+0000", 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542002+0000", 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9920999999999995e-05 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542011+0000", 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8699999999999998e-06 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542016+0000", 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3409999999999996e-06 2024-04-26T12:16:02.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542039+0000", 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.374e-05 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542125+0000", 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5146000000000001e-05 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:02.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:02.542209+0000", 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4288000000000003e-05 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 14 2024-04-26T12:16:02.611 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:02.612 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:02.611+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:02.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:02.627 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:02.713 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:02.712+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:02.751 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:02.755 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 58 16 166471 166455 179.355 164 0.0110062 0.0055731 2024-04-26T12:16:02.762 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:02.762 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:02.762 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:02.762 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:02.763 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:02.770 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:02.773 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:02.774 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:02.776 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:02.807 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:16:02.814 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:02.812+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:02.915 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:02.913+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:02.967 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:02.967 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:02.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:03.025 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:03.024+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:03.117 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:03.115+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:03.138 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:03.138 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:03.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:03.236 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:03.235+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:03.318 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:03.317+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:03.345 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:03.345 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:03.359 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:03.419 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:03.418+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:03.520 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:03.519+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:03.557 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:03.557 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:03.571 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:03.622 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:03.621+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:03.720 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:03.720 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:03.723 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:03.722+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:03.733 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:03.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout: 59 16 169067 169051 179.065 162.25 0.0116932 0.00558209 2024-04-26T12:16:03.824 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:03.823+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:03.920 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:03.921 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:03.925 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:03.924+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:03.932 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:04.026 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:04.024+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:04.113 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:04.114 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:04.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:04.127 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:04.125+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:04.228 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:04.227+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:04.281 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:04.281 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:04.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:04.329 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:04.326+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:04.430 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:04.429+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:04.493 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:04.493 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:04.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:04.531 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:04.529+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:04.632 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:04.631+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:04.709 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:04.709 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:04.723 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Total time run: 60.0045 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Total writes made: 171654 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Write size: 65536 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Object size: 65536 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Bandwidth (MB/sec): 178.793 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Stddev Bandwidth: 50.138 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Max bandwidth (MB/sec): 372.75 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Min bandwidth (MB/sec): 30.8125 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Average IOPS: 2860 2024-04-26T12:16:04.756 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Stddev IOPS: 802.208 2024-04-26T12:16:04.757 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Max IOPS: 5964 2024-04-26T12:16:04.757 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Min IOPS: 493 2024-04-26T12:16:04.757 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Average Latency(s): 0.00559082 2024-04-26T12:16:04.757 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Stddev Latency(s): 0.0101858 2024-04-26T12:16:04.757 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Max latency(s): 1.01397 2024-04-26T12:16:04.757 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Min latency(s): 0.000918112 2024-04-26T12:16:04.761 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Cleaning up (deleting benchmark objects) 2024-04-26T12:16:04.767 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:04.765+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:04.774 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:04.821 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:16:04.834 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:04.832+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:04.863 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:04.863 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:04.876 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:04.913 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:04.913 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:04.913 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:04.932 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:04.932 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:04.935 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:04.935 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:04.962 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:04.960+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:05.036 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:05.033+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:05.066 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:05.066 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:05.066 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:05.067 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:05.067 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:05.077 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:05.137 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:05.136+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:05.238 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:05.235+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:05.258 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:05.258 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.197757572, 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:16:05.259 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:16:05.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:16:05.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:16:05.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.266 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.955818612999998, 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.267 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:16:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.269 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:16:05.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:16:05.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:16:05.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:16:05.275 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.955314123999997, 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.276 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:16:05.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:16:05.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:16:05.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:16:05.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.283 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 39.164322482000003, 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:16:05.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:16:05.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.812111636000001, 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.291 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:16:05.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:16:05.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.622065113000001, 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:05.298 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:05.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:05.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:05.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.620949945, 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:05.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:05.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.620677360999998, 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:05.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:05.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:05.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:05.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:05.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.619410804000001, 2024-04-26T12:16:05.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.318 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:05.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.619203356, 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:05.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.329 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.618777871999999, 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.330 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:05.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:05.335 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.618506931999999, 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:05.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:05.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:05.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.617432933, 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.342 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:05.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.349 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.899930294000001, 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.899693902999999, 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:16:05.357 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:16:05.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:16:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:16:05.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.364 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.027810312, 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:16:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:16:05.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.148476203000001, 2024-04-26T12:16:05.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:05.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:16:05.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:16:05.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:05.378 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.147310580999999, 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:16:05.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:16:05.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:16:05.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.956920681, 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.386 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:16:05.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:16:05.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:16:05.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:16:05.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.367991301, 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:05.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:05.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:16:05.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:16:05.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:16:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:05.400 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:05.400 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:05.402 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:05.399+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:05.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:05.502 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:05.501+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:05.551 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:174070 5.2 5:4aa767af:::benchmark_data_smithi069_31227_object2413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:05.548064+0000", 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022522409999999999, 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002271131, 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 174070 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548064+0000", 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548064+0000", 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548063+0000", 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548068+0000", 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548077+0000", 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7299999999999994e-06 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548083+0000", 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:16:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548722+0000", 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00063867500000000001 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.548860+0000", 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013821300000000001 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:174072 5.1 5:828a78f0:::benchmark_data_smithi069_31227_object2415:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:05.549584+0000", 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00073275100000000002, 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079276800000000001, 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 174072 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549584+0000", 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549584+0000", 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549583+0000", 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549588+0000", 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1989999999999997e-06 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549599+0000", 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1069e-05 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549606+0000", 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9829999999999999e-06 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549670+0000", 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4165999999999995e-05 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549851+0000", 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018118 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:174077 5.1 5.38f39a61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:05.549818+0000", 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00049866799999999996, 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059199899999999995, 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 174077 2024-04-26T12:16:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549818+0000", 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549818+0000", 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549817+0000", 2024-04-26T12:16:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549822+0000", 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549834+0000", 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2466000000000001e-05 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549841+0000", 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:174073 5.e e39/16 5:713ac6bb:::benchmark_data_smithi069_31227_object2416:head v 39'10899, mlcod=39'10896)", 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:05.549909+0000", 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00040745799999999997, 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053322299999999999, 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549909+0000", 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549909+0000", 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549908+0000", 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549916+0000", 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6450000000000005e-06 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549925+0000", 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6719999999999993e-06 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549931+0000", 2024-04-26T12:16:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1290000000000001e-06 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549965+0000", 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3912999999999999e-05 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.549981+0000", 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6231000000000001e-05 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:174081 5.2 5.153fe6d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:05.550287+0000", 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.8904999999999999e-05, 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018833500000000001, 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 174081 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.550287+0000", 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.550287+0000", 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.550287+0000", 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.550292+0000", 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2689999999999999e-06 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.550304+0000", 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2128e-05 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.550311+0000", 2024-04-26T12:16:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:174060 5.2 5:41bfd093:::benchmark_data_smithi069_31227_object2403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:05.545411+0000", 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0049049649999999998, 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050949070000000001, 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 174060 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545411+0000", 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545411+0000", 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545411+0000", 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545413+0000", 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545418+0000", 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8119999999999998e-06 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545422+0000", 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1060000000000002e-06 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545464+0000", 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2271000000000002e-05 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545581+0000", 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117376 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:174061 5.2 5:40c210cc:::benchmark_data_smithi069_31227_object2404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:05.545692+0000", 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0046239920000000004, 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048472810000000002, 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 174061 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545692+0000", 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545692+0000", 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545691+0000", 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545696+0000", 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7979999999999996e-06 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545706+0000", 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8730000000000002e-06 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.545713+0000", 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6080000000000001e-06 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.547086+0000", 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013728410000000001 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:05.547218+0000", 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013197099999999999 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 7 2024-04-26T12:16:05.577 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:05.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:05.620 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:05.619+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:05.704 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:05.703+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:05.768 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:05.768 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:05.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:05.818 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:16:05.822 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:05.821+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:05.908 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:05.905+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:05.981 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.771997960999997, 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:16:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:16:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.745157921000001, 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:16:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.744428210999999, 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.587881627000002, 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:16:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:16:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.783894482000001, 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:16:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.345372389000001, 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.941114932000001, 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:16:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:16:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.940959298999999, 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.685118742, 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:16:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.619012393, 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139464 5.6 5:65933418:::benchmark_data_smithi069_31227_object139463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.616783738000001, 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018033270000000001, 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139464 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361642+0000", 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361698+0000", 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6433e-05 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361709+0000", 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0506000000000001e-05 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361724+0000", 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4843e-05 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371143+0000", 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094190100000000002 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371293+0000", 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150669 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379558+0000", 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082649969999999996 2024-04-26T12:16:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379620+0000", 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1698000000000005e-05 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379676+0000", 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6168000000000002e-05 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.623044354999999, 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.622691794, 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:06.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:06.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.618900884, 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:06.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.611503856000001, 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:06.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.606994561, 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:16:06.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.604232532999999, 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:149752 5.a 5:59e73ebb:::benchmark_data_smithi069_31227_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6823748379999994, 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018927920000000001, 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 149752 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296051+0000", 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296491+0000", 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000439813 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296502+0000", 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296508+0000", 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296552+0000", 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3480999999999999e-05 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296683+0000", 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013126899999999999 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296823+0000", 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139782 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.300824+0000", 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040012720000000002 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314902+0000", 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01407796 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314941+0000", 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8773000000000003e-05 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314980+0000", 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:162791 5.2 5:4fb88c73:::benchmark_data_smithi069_31227_object162790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6229806690000004, 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017947762999999999, 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162791 2024-04-26T12:16:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355482+0000", 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5976000000000002e-05 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355491+0000", 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2040000000000003e-06 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355496+0000", 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.364579+0000", 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009082896 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.364706+0000", 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126735 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373279+0000", 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085727760000000007 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373323+0000", 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4233000000000002e-05 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373394+0000", 2024-04-26T12:16:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0926000000000005e-05 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164265 5.2 5:429fc2e1:::benchmark_data_smithi069_31227_object164264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0671875100000001, 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018708573999999999, 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164265 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911333+0000", 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4102000000000001e-05 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911339+0000", 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:16:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911343+0000", 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1799999999999998e-06 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919312+0000", 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079682869999999992 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919441+0000", 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012956999999999999 2024-04-26T12:16:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929814+0000", 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010372476 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929870+0000", 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6647000000000002e-05 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929948+0000", 2024-04-26T12:16:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7612000000000002e-05 2024-04-26T12:16:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.086 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:06.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:06.088 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:06.086+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:06.188 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:06.187+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:06.228 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:176072 5.f 5:f03e2c3f:::benchmark_data_smithi069_31227_object4415:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.223101+0000", 2024-04-26T12:16:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037204460000000001, 2024-04-26T12:16:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037375350000000002, 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 176072 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223101+0000", 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223101+0000", 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223100+0000", 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223106+0000", 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1429999999999997e-06 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223116+0000", 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0173000000000001e-05 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223122+0000", 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8660000000000002e-06 2024-04-26T12:16:06.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223162+0000", 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0281000000000003e-05 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.223392+0000", 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00023040499999999999 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:176078 5.0 5:02e9159b:::benchmark_data_smithi069_31227_object4421:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.224338+0000", 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024836620000000002, 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025443079999999999, 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 176078 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224338+0000", 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224338+0000", 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224337+0000", 2024-04-26T12:16:06.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224341+0000", 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8310000000000003e-06 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224351+0000", 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3850000000000008e-06 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224357+0000", 2024-04-26T12:16:06.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3149999999999997e-06 2024-04-26T12:16:06.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224396+0000", 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8720999999999997e-05 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224593+0000", 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019740400000000001 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224694+0000", 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100596 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:176079 5.0 5:0ee55a1e:::benchmark_data_smithi069_31227_object4422:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.224580+0000", 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022413620000000002, 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023415789999999999, 2024-04-26T12:16:06.238 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 176079 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224580+0000", 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224580+0000", 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224580+0000", 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224584+0000", 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2579999999999997e-06 2024-04-26T12:16:06.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224592+0000", 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1040000000000007e-06 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.224598+0000", 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0700000000000003e-06 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226588+0000", 2024-04-26T12:16:06.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019894819999999999 2024-04-26T12:16:06.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226760+0000", 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017238600000000001 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226861+0000", 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101494 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:176086 5.4 5:26ae4cff:::benchmark_data_smithi069_31227_object4429:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.225646+0000", 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0011759050000000001, 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013352100000000001, 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.244 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 176086 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225646+0000", 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225646+0000", 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225645+0000", 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225649+0000", 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7639999999999999e-06 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225656+0000", 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4499999999999998e-06 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225662+0000", 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4330000000000003e-06 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225695+0000", 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2716000000000003e-05 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225829+0000", 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013486300000000001 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225891+0000", 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1326000000000002e-05 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:176087 5.f 5:fd53f11b:::benchmark_data_smithi069_31227_object4430:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.225669+0000", 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001152761, 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013867440000000001, 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:06.249 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 176087 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225669+0000", 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225669+0000", 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225669+0000", 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225671+0000", 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1749999999999999e-06 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225676+0000", 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6729999999999997e-06 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225682+0000", 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1479999999999997e-06 2024-04-26T12:16:06.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225728+0000", 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6075000000000002e-05 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225881+0000", 2024-04-26T12:16:06.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015368599999999999 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:176088 5.0 5.a89656a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.225690+0000", 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0011314540000000001, 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001435459, 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.254 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 176088 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225690+0000", 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225690+0000", 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225690+0000", 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225692+0000", 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3240000000000001e-06 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225698+0000", 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4450000000000004e-06 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.225702+0000", 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:176090 5.9 5:9880ad29:::benchmark_data_smithi069_31227_object4433:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.226596+0000", 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000226133, 2024-04-26T12:16:06.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00058030500000000004, 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 176090 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226596+0000", 2024-04-26T12:16:06.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226596+0000", 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226595+0000", 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226600+0000", 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.135e-06 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226610+0000", 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6439999999999995e-06 2024-04-26T12:16:06.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226616+0000", 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.268e-06 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226658+0000", 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2678e-05 2024-04-26T12:16:06.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226829+0000", 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017050100000000001 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:176078 5.0 e40/16)", 2024-04-26T12:16:06.263 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:06.226972+0000", 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9998493, 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00026026700000000001, 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226972+0000", 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226972+0000", 2024-04-26T12:16:06.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226972+0000", 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226975+0000", 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5719999999999999e-06 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226988+0000", 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2391e-05 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:06.226995+0000", 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.267 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:06.268 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 8 2024-04-26T12:16:06.268 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:06.269 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:06.290 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:06.288+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:06.391 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:06.389+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:06.452 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:06.452 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:06.452 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:06.465 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:06.506 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:06.505+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:06.594 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:06.593+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.588300238999999, 2024-04-26T12:16:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:06.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:16:06.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.346361279999996, 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:16:06.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:16:06.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:16:06.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:16:06.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.345856791000003, 2024-04-26T12:16:06.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:16:06.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:16:06.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 40.554865149000001, 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:16:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:16:06.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:16:06.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.673 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.202654302999999, 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:16:06.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.01260778, 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:06.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:06.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:06.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.011492612000001, 2024-04-26T12:16:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:06.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:06.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.011220028, 2024-04-26T12:16:06.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:06.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.009953470999999, 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:06.695 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:06.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.700 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.009746023000002, 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:06.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:06.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.009320539000001, 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:06.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.009049599000001, 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.711 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:06.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.715 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.007975600000002, 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:06.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.721 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.290472960999999, 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.722 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:16:06.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:16:06.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 27.290236570000001, 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:16:06.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:16:06.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:16:06.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.418352979000002, 2024-04-26T12:16:06.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:16:06.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:16:06.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.739 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.53901887, 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:16:06.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:16:06.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.537853248000001, 2024-04-26T12:16:06.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:16:06.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:16:06.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:16:06.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 23.347463348000002, 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.751 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:16:06.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 21.758533967999998, 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:06.757 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:16:06.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:16:06.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:16:06.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:06.763 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:06.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:06.765 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:06.762+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:06.865 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:06.863+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:06.920 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:06.920 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:178180 5.e e40/16 5:70473a63:::benchmark_data_smithi069_31227_object6523:head v 40'11179, mlcod=40'11177)", 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.915225+0000", 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040787050000000002, 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040947370000000002, 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.915225+0000", 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.915225+0000", 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.915225+0000", 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.915229+0000", 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5290000000000002e-06 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.915238+0000", 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6740000000000003e-06 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.915243+0000", 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8960000000000002e-06 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916439+0000", 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011966050000000001 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916467+0000", 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7112000000000001e-05 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:178184 5.c 5:3676a701:::benchmark_data_smithi069_31227_object6527:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.924 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.916611+0000", 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0026926060000000002, 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002746096, 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 178184 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916611+0000", 2024-04-26T12:16:06.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916611+0000", 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916610+0000", 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916615+0000", 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916625+0000", 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8719999999999997e-06 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916632+0000", 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916670+0000", 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8676e-05 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916844+0000", 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017414399999999999 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:178186 5.2 5:4031a0e8:::benchmark_data_smithi069_31227_object6529:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.928 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.916777+0000", 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0025272290000000002, 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002617557, 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 178186 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916777+0000", 2024-04-26T12:16:06.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916777+0000", 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916776+0000", 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916780+0000", 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4220000000000002e-06 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916788+0000", 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7279999999999995e-06 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916794+0000", 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.161e-06 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916842+0000", 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7565999999999998e-05 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.916938+0000", 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5710000000000004e-05 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:178183 5.e e40/16 5:7e0bfe38:::benchmark_data_smithi069_31227_object6526:head v 40'11180, mlcod=40'11177)", 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.917208+0000", 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0020963850000000001, 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002219777, 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917208+0000", 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917208+0000", 2024-04-26T12:16:06.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917203+0000", 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999957 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917213+0000", 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917225+0000", 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2099999999999999e-05 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917232+0000", 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918772+0000", 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001539908 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918783+0000", 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1554e-05 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:178188 5.7 5:e4511d6f:::benchmark_data_smithi069_31227_object6531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.917430+0000", 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001873441, 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002028246, 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 178188 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917430+0000", 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917430+0000", 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917430+0000", 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917434+0000", 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.69e-06 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917445+0000", 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0609e-05 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917453+0000", 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:16:06.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917502+0000", 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8625000000000003e-05 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917660+0000", 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015818000000000001 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:178190 5.6 5:61477b32:::benchmark_data_smithi069_31227_object6533:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.917658+0000", 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001645655, 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001834748, 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 178190 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917658+0000", 2024-04-26T12:16:06.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917658+0000", 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917657+0000", 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917662+0000", 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917676+0000", 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3587999999999999e-05 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.917684+0000", 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1890000000000007e-06 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918764+0000", 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010803919999999999 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918906+0000", 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142106 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:178192 5.6 5.a9f6736 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.918848+0000", 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00045591700000000002, 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067629099999999998, 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 178192 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918848+0000", 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918848+0000", 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918847+0000", 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918852+0000", 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918863+0000", 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1522000000000001e-05 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918871+0000", 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4869999999999996e-06 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:178193 5.1 5:8c9384cc:::benchmark_data_smithi069_31227_object6536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.918917+0000", 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00038661000000000001, 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00063458199999999996, 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 178193 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918917+0000", 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918917+0000", 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918917+0000", 2024-04-26T12:16:06.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918921+0000", 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.985e-06 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918930+0000", 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0089999999999996e-06 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918935+0000", 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6250000000000004e-06 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.918983+0000", 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7966999999999997e-05 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.919127+0000", 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014402800000000001 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:178187 5.e e40/16)", 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:06.919081+0000", 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000222938, 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050323499999999999, 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.919081+0000", 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.919081+0000", 2024-04-26T12:16:06.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.919080+0000", 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.919086+0000", 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.84e-06 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.919096+0000", 2024-04-26T12:16:06.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:06.919101+0000", 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 9 2024-04-26T12:16:06.954 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:06.955 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:06.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:07.000 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:06.999+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:07.069 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:07.065+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:07.076 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:07.077 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:07.077 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:07.095 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:07.098 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:07.099 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:07.109 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:07.109 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:07.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:07.207 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:07.205+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:07.269 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:07.268+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:07.316 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:07.317 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:07.330 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:07.371 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:07.370+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:07.472 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:07.470+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:07.473 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:07.473 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:07.486 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:07.571 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:07.570+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:07.624 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:07.625 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:07.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:07.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-26T12:16:07.679 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:07.678+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:07.773 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:07.772+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:07.820 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:07.820 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:07.831 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:16:07.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:07.874 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:07.873+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:07.975 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:07.974+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:07.984 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:07.985 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:07.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:08.076 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:08.074+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:08.146 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:08.146 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:08.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:08.200 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:08.199+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:08.281 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:08.276+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:08.348 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:08.349 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:08.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:08.402 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:08.401+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:08.479 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:08.477+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:08.502 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:08.502 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:08.514 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:08.580 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:08.578+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:08.681 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:08.679+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:08.698 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:08.698 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:08.711 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:08.782 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:08.780+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:08.831 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:16:08.854 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:08.854 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:08.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:08.909 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:08.908+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:08.983 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:08.982+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:09.023 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:09.023 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:09.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:09.084 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:09.082+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:09.100 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:09.185 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:09.184+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:09.189 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:09.189 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:09.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:09.223 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:09.223 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:09.224 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:09.241 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:09.241 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:09.244 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:09.244 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:09.286 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:09.284+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:09.362 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.151771169, 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:16:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.124931128999997, 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:16:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.124201419000002, 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.967654834999998, 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:16:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:16:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.163667689999997, 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:16:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:16:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.725145597000001, 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.320888140000001, 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.320732506999999, 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.06489195, 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:16:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:16:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.998785601000002, 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139464 5.6 5:65933418:::benchmark_data_smithi069_31227_object139463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.996556945999998, 2024-04-26T12:16:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018033270000000001, 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139464 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361643+0000", 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361642+0000", 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361698+0000", 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6433e-05 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361709+0000", 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0506000000000001e-05 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.361724+0000", 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4843e-05 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371143+0000", 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094190100000000002 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.371293+0000", 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150669 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379558+0000", 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082649969999999996 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379620+0000", 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1698000000000005e-05 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379676+0000", 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6168000000000002e-05 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.002817563000001, 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.002465002000001, 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.998674092, 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.991277064, 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.986767769, 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:16:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.984005741000001, 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:16:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:16:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:149752 5.a 5:59e73ebb:::benchmark_data_smithi069_31227_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:16:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.062148046000001, 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018927920000000001, 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 149752 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296051+0000", 2024-04-26T12:16:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296491+0000", 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000439813 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296502+0000", 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296508+0000", 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296552+0000", 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3480999999999999e-05 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296683+0000", 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013126899999999999 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296823+0000", 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139782 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.300824+0000", 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040012720000000002 2024-04-26T12:16:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314902+0000", 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01407796 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314941+0000", 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8773000000000003e-05 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314980+0000", 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:162791 5.2 5:4fb88c73:::benchmark_data_smithi069_31227_object162790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.002753877, 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017947762999999999, 2024-04-26T12:16:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162791 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355446+0000", 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355482+0000", 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5976000000000002e-05 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355491+0000", 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2040000000000003e-06 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.355496+0000", 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.364579+0000", 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009082896 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.364706+0000", 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126735 2024-04-26T12:16:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373279+0000", 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085727760000000007 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373323+0000", 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4233000000000002e-05 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.373394+0000", 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0926000000000005e-05 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164265 5.2 5:429fc2e1:::benchmark_data_smithi069_31227_object164264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4469607179999997, 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018708573999999999, 2024-04-26T12:16:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164265 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911333+0000", 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4102000000000001e-05 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911339+0000", 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911343+0000", 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1799999999999998e-06 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919312+0000", 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079682869999999992 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919441+0000", 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012956999999999999 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929814+0000", 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010372476 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929870+0000", 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6647000000000002e-05 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929948+0000", 2024-04-26T12:16:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7612000000000002e-05 2024-04-26T12:16:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:09.491 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:09.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:09.493 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:09.491+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:09.593 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:09.591+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:09.636 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:09.636 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:09.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.636 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186153 5.0 5:0e9b9966:::benchmark_data_smithi069_31227_object14496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.636 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.625829+0000", 2024-04-26T12:16:09.636 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0086741160000000008, 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0086965900000000006, 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186153 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625829+0000", 2024-04-26T12:16:09.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625829+0000", 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625828+0000", 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625833+0000", 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0379999999999999e-06 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625846+0000", 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2731000000000001e-05 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625853+0000", 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7200000000000006e-06 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.626460+0000", 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00060652700000000004 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.626588+0000", 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012859500000000001 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.626682+0000", 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4026999999999999e-05 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632220+0000", 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055372640000000001 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634490+0000", 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022706409999999999 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634516+0000", 2024-04-26T12:16:09.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5976999999999999e-05 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186155 5.0 5:0ff5cb9d:::benchmark_data_smithi069_31227_object14498:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.625870+0000", 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0086326119999999996, 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0087291810000000008, 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186155 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625870+0000", 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625870+0000", 2024-04-26T12:16:09.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625870+0000", 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625873+0000", 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0479999999999999e-06 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625881+0000", 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8520000000000004e-06 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.625886+0000", 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8270000000000003e-06 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.628120+0000", 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002233718 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.628288+0000", 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000168231 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.628395+0000", 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107018 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634074+0000", 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056786290000000001 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.646 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186159 5.0 5:02cfc2d0:::benchmark_data_smithi069_31227_object14502:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.627445+0000", 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0070579279999999998, 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072242529999999999, 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186159 2024-04-26T12:16:09.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.627445+0000", 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.627445+0000", 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.627444+0000", 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.627449+0000", 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.627459+0000", 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0358e-05 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.627466+0000", 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2980000000000003e-06 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.629732+0000", 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022657580000000001 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.629881+0000", 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014920800000000001 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630002+0000", 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120345 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634079+0000", 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040774799999999996 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.651 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186167 5.8 5:186f5ea9:::benchmark_data_smithi069_31227_object14510:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.630075+0000", 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0044276690000000004, 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0046745980000000003, 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186167 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630075+0000", 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630075+0000", 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630075+0000", 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630077+0000", 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6620000000000001e-06 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630085+0000", 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8129999999999996e-06 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630089+0000", 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8399999999999997e-06 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630132+0000", 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2969000000000001e-05 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630314+0000", 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018231500000000001 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.630426+0000", 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112098 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634084+0000", 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036575449999999999 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186172 5.8 5:122e98fc:::benchmark_data_smithi069_31227_object14515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.632700+0000", 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001803008, 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020998119999999999, 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.656 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186172 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632700+0000", 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632700+0000", 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632699+0000", 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632704+0000", 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2780000000000001e-06 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632718+0000", 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3689999999999999e-05 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632726+0000", 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6379999999999993e-06 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632753+0000", 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6228999999999999e-05 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632868+0000", 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000115302 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.632927+0000", 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9244999999999999e-05 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186175 5.e 5:7b7a9942:::benchmark_data_smithi069_31227_object14518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.660 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.633519+0000", 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00098413600000000004, 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001352191, 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186175 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633519+0000", 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633519+0000", 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633518+0000", 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633522+0000", 2024-04-26T12:16:09.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2980000000000002e-06 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633532+0000", 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633538+0000", 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2820000000000002e-06 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633577+0000", 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8460000000000001e-05 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633734+0000", 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000157195 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633843+0000", 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108625 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186177 5.9 5:9f1b2295:::benchmark_data_smithi069_31227_object14520:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.633835+0000", 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00066752399999999996, 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001106554, 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186177 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633835+0000", 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633835+0000", 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633835+0000", 2024-04-26T12:16:09.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633839+0000", 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.963e-06 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633846+0000", 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7999999999999999e-06 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633851+0000", 2024-04-26T12:16:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5630000000000002e-06 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.633881+0000", 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0363999999999999e-05 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634002+0000", 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012081100000000001 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186178 5.8 5:1eb3b3d0:::benchmark_data_smithi069_31227_object14521:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.634764+0000", 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997382, 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025158100000000002, 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186178 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.669 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634764+0000", 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634764+0000", 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634764+0000", 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634768+0000", 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.882e-06 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634778+0000", 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8630000000000003e-06 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634785+0000", 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7340000000000002e-06 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634819+0000", 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3569000000000003e-05 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634989+0000", 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017048599999999999 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186182 5.f 5:f98fddd7:::benchmark_data_smithi069_31227_object14525:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.634798+0000", 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997044, 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000284436, 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186182 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634798+0000", 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634798+0000", 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634798+0000", 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634801+0000", 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634806+0000", 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634812+0000", 2024-04-26T12:16:09.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6049999999999997e-06 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634857+0000", 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5015999999999997e-05 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.635016+0000", 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015933000000000001 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:186183 5.d 5:b5018980:::benchmark_data_smithi069_31227_object14526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:09.634899+0000", 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996033, 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000249979, 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 186183 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634899+0000", 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634899+0000", 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634899+0000", 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:09.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634902+0000", 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.858e-06 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634907+0000", 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4450000000000004e-06 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634911+0000", 2024-04-26T12:16:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7179999999999998e-06 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.634947+0000", 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6301999999999999e-05 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:09.635064+0000", 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000116413 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:09.680 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:09.681 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-26T12:16:09.681 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:09.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:09.693 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:09.692+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:09.793 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:09.792+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:09.867 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:09.867 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:09.868 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:09.868 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:09.868 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:09.880 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:09.895 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:09.894+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:09.996 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:09.995+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:10.068 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:10.068 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:10.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:10.068 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:10.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.068 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:63976 5.e 5:7fa751f2:::benchmark_data_smithi069_31227_object63975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:10.068 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.006671191000002, 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.024661969999999998, 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 63976 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058067+0000", 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058066+0000", 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058129+0000", 2024-04-26T12:16:10.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2883000000000001e-05 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058138+0000", 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.058144+0000", 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064156+0000", 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006011677 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064283+0000", 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126923 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.064419+0000", 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013676899999999999 2024-04-26T12:16:10.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.067101+0000", 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00268147 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082675+0000", 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.015574476 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082708+0000", 2024-04-26T12:16:10.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2526e-05 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.082728+0000", 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0718999999999999e-05 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64625 5.8 5:1e2b6aac:::benchmark_data_smithi069_31227_object64624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:10.074 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.764732232, 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021846383, 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64625 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:10.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300005+0000", 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300004+0000", 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300055+0000", 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0528999999999997e-05 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300068+0000", 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3417999999999999e-05 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300076+0000", 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308635+0000", 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085590490000000009 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308780+0000", 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014467700000000001 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.308894+0000", 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011386 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.314006+0000", 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051120519999999997 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321754+0000", 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077479209999999996 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321806+0000", 2024-04-26T12:16:10.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2774e-05 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321852+0000", 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5537000000000001e-05 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:64627 5.8 5:13c984fb:::benchmark_data_smithi069_31227_object64626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.764227742999999, 2024-04-26T12:16:10.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021550086999999999, 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 64627 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300510+0000", 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300509+0000", 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300547+0000", 2024-04-26T12:16:10.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7719000000000003e-05 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300555+0000", 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.300561+0000", 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.356e-06 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311476+0000", 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010915262 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311583+0000", 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107397 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.311728+0000", 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144924 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.316153+0000", 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044253460000000001 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.321977+0000", 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058230809999999999 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322021+0000", 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4184999999999998e-05 2024-04-26T12:16:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:23.322060+0000", 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9332999999999998e-05 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:71827 5.4 5:2db95889:::benchmark_data_smithi069_31227_object71826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.973236100999998, 2024-04-26T12:16:10.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021385831000000001, 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 71827 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091502+0000", 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091501+0000", 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091599+0000", 2024-04-26T12:16:10.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8006999999999999e-05 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091610+0000", 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1412e-05 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.091616+0000", 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.100909+0000", 2024-04-26T12:16:10.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0092931509999999995 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101018+0000", 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108362 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.101160+0000", 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014187299999999999 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.109685+0000", 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0085253789999999996 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112820+0000", 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003135114 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112854+0000", 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3599999999999997e-05 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:26.112887+0000", 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3618000000000002e-05 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:98770 5.8 5:1c30eb3d:::benchmark_data_smithi069_31227_object98769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.621025254999999, 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022664845999999999, 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 98770 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:10.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443712+0000", 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443774+0000", 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2335000000000005e-05 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443784+0000", 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.443792+0000", 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454068+0000", 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010276064999999999 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454177+0000", 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108899 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.454299+0000", 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012283699999999999 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.461573+0000", 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072733839999999999 2024-04-26T12:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466297+0000", 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047242849999999999 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466341+0000", 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3726000000000001e-05 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.466377+0000", 2024-04-26T12:16:10.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6434999999999999e-05 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.430978732, 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:10.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:10.102 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.429863564000001, 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:10.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:10.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:10.107 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.42959098, 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:10.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.428324422999999, 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.113 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:10.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.428116975000002, 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:10.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.427691490999997, 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:10.123 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:10.128 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.427420550999997, 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:10.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.133 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.426346551999998, 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:10.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105991 5.0 5:02d80208:::benchmark_data_smithi069_31227_object105990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.708843912999999, 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022389572, 2024-04-26T12:16:10.139 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105991 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355894+0000", 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355893+0000", 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355953+0000", 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0078000000000003e-05 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355961+0000", 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2370000000000003e-06 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.355969+0000", 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5569999999999996e-06 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363419+0000", 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0074492730000000002 2024-04-26T12:16:10.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363536+0000", 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011758 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.363676+0000", 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014035600000000001 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375242+0000", 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011565082000000001 2024-04-26T12:16:10.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378193+0000", 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029513510000000001 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378248+0000", 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5078999999999999e-05 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378283+0000", 2024-04-26T12:16:10.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5371999999999999e-05 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:105994 5.0 5:0d15a386:::benchmark_data_smithi069_31227_object105993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.708607522000001, 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.02222112, 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 105994 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356130+0000", 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356204+0000", 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4663e-05 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356209+0000", 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9989999999999999e-06 2024-04-26T12:16:10.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.356212+0000", 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1049999999999999e-06 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365242+0000", 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0090300239999999993 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365318+0000", 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5359999999999997e-05 2024-04-26T12:16:10.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.365395+0000", 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7306999999999997e-05 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.375273+0000", 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0098776760000000002 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378290+0000", 2024-04-26T12:16:10.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030177020000000001 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378322+0000", 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1968000000000003e-05 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:39.378351+0000", 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8839999999999998e-05 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.150 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:108255 5.0 5:07bb5459:::benchmark_data_smithi069_31227_object108254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.836723931000002, 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023154932999999999, 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 108255 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.151 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228014+0000", 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228013+0000", 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228049+0000", 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5571999999999998e-05 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228055+0000", 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:16:10.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.228058+0000", 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.275e-06 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239202+0000", 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011144305 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239307+0000", 2024-04-26T12:16:10.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105105 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.239432+0000", 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124129 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.246580+0000", 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0071486079999999999 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251109+0000", 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004529211 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251147+0000", 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7654000000000002e-05 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:40.251169+0000", 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1665999999999999e-05 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110503 5.0 5:0a05c2b6:::benchmark_data_smithi069_31227_object110502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.957389822, 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022486879000000001, 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110503 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107348+0000", 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107347+0000", 2024-04-26T12:16:10.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107478+0000", 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013123400000000001 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107490+0000", 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1574e-05 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.107497+0000", 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3010000000000001e-06 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113044+0000", 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055466120000000002 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113162+0000", 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117948 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.113311+0000", 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014944099999999999 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122210+0000", 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088989410000000005 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129759+0000", 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075489249999999997 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129801+0000", 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2299999999999998e-05 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129835+0000", 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3342e-05 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.162 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:110509 5.0 5:0205e577:::benchmark_data_smithi069_31227_object110508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.956224200000001, 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.021420771000000002, 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 110509 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108514+0000", 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108513+0000", 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108539+0000", 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108547+0000", 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1300000000000001e-06 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.108552+0000", 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115643+0000", 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070904100000000001 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115738+0000", 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5730999999999995e-05 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.115836+0000", 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7541999999999995e-05 2024-04-26T12:16:10.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.122243+0000", 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0064070079999999996 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129842+0000", 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075995439999999997 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129900+0000", 2024-04-26T12:16:10.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7052000000000002e-05 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:41.129934+0000", 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4774000000000003e-05 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:116030 5.8 5:1ae448cb:::benchmark_data_smithi069_31227_object116029:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 26.765834300000002, 2024-04-26T12:16:10.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.023488364000000001, 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 116030 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298903+0000", 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298902+0000", 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298954+0000", 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1492000000000001e-05 2024-04-26T12:16:10.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298970+0000", 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.298978+0000", 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307896+0000", 2024-04-26T12:16:10.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0089187269999999996 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.307985+0000", 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8867000000000001e-05 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.308073+0000", 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7565000000000006e-05 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.310914+0000", 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028412789999999999 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322300+0000", 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011385539 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322352+0000", 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:43.322392+0000", 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489000000000001e-05 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:120089 5.4 5:24ad6691:::benchmark_data_smithi069_31227_object120088:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.176904919999998, 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.022279215000000002, 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.174 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 120089 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887833+0000", 2024-04-26T12:16:10.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887832+0000", 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887896+0000", 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4496e-05 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887905+0000", 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3310000000000004e-06 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.887910+0000", 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896714+0000", 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0088039099999999999 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896836+0000", 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012216199999999999 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.896982+0000", 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145401 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.900504+0000", 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035221580000000001 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910037+0000", 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0095330699999999994 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910077+0000", 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0587999999999998e-05 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:44.910112+0000", 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4632000000000003e-05 2024-04-26T12:16:10.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.180 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.180 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:10.181 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:10.180+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:10.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:10.282 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:10.281+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:10.334 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:188334 5.4 e41/16 5:25efda13:::benchmark_data_smithi069_31227_object16677:head v 41'11614, mlcod=41'11612)", 2024-04-26T12:16:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.330054+0000", 2024-04-26T12:16:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0024541540000000001, 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024761150000000001, 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330054+0000", 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330054+0000", 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330053+0000", 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330059+0000", 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2580000000000001e-06 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330069+0000", 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.414e-06 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330074+0000", 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330122+0000", 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7465e-05 2024-04-26T12:16:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330145+0000", 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2894000000000001e-05 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188337 5.c 5:33101c54:::benchmark_data_smithi069_31227_object16680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.330974+0000", 2024-04-26T12:16:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001533502, 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001625285, 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188337 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330974+0000", 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330974+0000", 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330974+0000", 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330979+0000", 2024-04-26T12:16:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.507e-06 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330990+0000", 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.057e-05 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330996+0000", 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3799999999999999e-06 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331975+0000", 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0009789079999999999 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.332553+0000", 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057813199999999997 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188338 5.2 5:4b01cf63:::benchmark_data_smithi069_31227_object16681:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.331116+0000", 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001391911, 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001556518, 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188338 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331116+0000", 2024-04-26T12:16:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331116+0000", 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331115+0000", 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331119+0000", 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331127+0000", 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9149999999999996e-06 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331132+0000", 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4729999999999999e-06 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331178+0000", 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5791000000000003e-05 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331362+0000", 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183888 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:188335 5.e e41/16 5:728f58cd:::benchmark_data_smithi069_31227_object16678:head v 41'11815, mlcod=41'11812)", 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.331385+0000", 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001122463, 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013557409999999999, 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331385+0000", 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331385+0000", 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331385+0000", 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331391+0000", 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331400+0000", 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4879999999999996e-06 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331406+0000", 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6640000000000003e-06 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331461+0000", 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5578999999999998e-05 2024-04-26T12:16:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331478+0000", 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6731e-05 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:188339 5.8 e41/16 5:136e8357:::benchmark_data_smithi069_31227_object16682:head v 41'11866, mlcod=41'11864)", 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.331502+0000", 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001006208, 2024-04-26T12:16:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012829860000000001, 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331502+0000", 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331502+0000", 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331501+0000", 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331505+0000", 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1160000000000001e-06 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331513+0000", 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4000000000000003e-06 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331517+0000", 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8110000000000002e-06 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331679+0000", 2024-04-26T12:16:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016168700000000001 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.331701+0000", 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1776e-05 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:188322 5.e e41/16 5:7d392599:::benchmark_data_smithi069_31227_object16665:head v 41'11814, mlcod=41'11812)", 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.326248+0000", 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0062594820000000002, 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065665369999999999, 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326248+0000", 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326248+0000", 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326248+0000", 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326254+0000", 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9009999999999999e-06 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326263+0000", 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1759999999999999e-06 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326269+0000", 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326619+0000", 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035066999999999997 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326645+0000", 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5357000000000001e-05 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188325 5.6 5:6048848e:::benchmark_data_smithi069_31227_object16668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.326609+0000", 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0058991190000000004, 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006236826, 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188325 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326609+0000", 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326609+0000", 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326608+0000", 2024-04-26T12:16:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326613+0000", 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.566e-06 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326622+0000", 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4499999999999993e-06 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.326628+0000", 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328258+0000", 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016295649999999999 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328440+0000", 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018274 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188330 5.3 5:ca12c8da:::benchmark_data_smithi069_31227_object16673:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.328640+0000", 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038674769999999998, 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042675569999999999, 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188330 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328640+0000", 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328640+0000", 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328640+0000", 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328644+0000", 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7489999999999998e-06 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328655+0000", 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0348e-05 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.328668+0000", 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3196e-05 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330818+0000", 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021506540000000001 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.330990+0000", 2024-04-26T12:16:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017175599999999999 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188333 5.c 5:36b1f033:::benchmark_data_smithi069_31227_object16676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.329735+0000", 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027732550000000001, 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032504560000000001, 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188333 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329735+0000", 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329735+0000", 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329734+0000", 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329739+0000", 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7480000000000001e-06 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329748+0000", 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2580000000000001e-06 2024-04-26T12:16:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329754+0000", 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2439999999999998e-06 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329799+0000", 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4608999999999999e-05 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.329977+0000", 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017803400000000001 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 9 2024-04-26T12:16:10.371 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:10.372 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:10.383 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:10.381+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:10.484 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:10.481+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:10.522 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:10.522 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:10.536 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:10.584 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:10.582+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:10.685 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:10.682+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:10.732 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:16:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.522704459000003, 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:16:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:16:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.495864419, 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:16:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.495134708999998, 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.338588125000001, 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:16:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.53460098, 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:16:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.096078886999997, 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.691821430000001, 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:16:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:16:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:16:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.691665796999999, 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.43582524, 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:16:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:16:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.369718891000002, 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.373750853000001, 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.373398292000001, 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.369607382000002, 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.362210353999998, 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.357701059, 2024-04-26T12:16:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.354939031000001, 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:16:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:149752 5.a 5:59e73ebb:::benchmark_data_smithi069_31227_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.433081336000001, 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018927920000000001, 2024-04-26T12:16:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 149752 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296051+0000", 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296491+0000", 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000439813 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296502+0000", 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296508+0000", 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296552+0000", 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3480999999999999e-05 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296683+0000", 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013126899999999999 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296823+0000", 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139782 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.300824+0000", 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040012720000000002 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314902+0000", 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01407796 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314941+0000", 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8773000000000003e-05 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314980+0000", 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164265 5.2 5:429fc2e1:::benchmark_data_smithi069_31227_object164264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.8178940079999997, 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018708573999999999, 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164265 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911333+0000", 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4102000000000001e-05 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911339+0000", 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911343+0000", 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1799999999999998e-06 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919312+0000", 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079682869999999992 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919441+0000", 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012956999999999999 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929814+0000", 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010372476 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929870+0000", 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6647000000000002e-05 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929948+0000", 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7612000000000002e-05 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.246821339, 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.071981656000000005, 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:10.845 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:10.845 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:16:10.846 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:10.844+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:10.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:10.946 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:10.944+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:10.994 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:190305 5.a e41/16 5:5644632a:::benchmark_data_smithi069_31227_object18648:head v 41'11867, mlcod=41'11865)", 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.990503+0000", 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020906420000000002, 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021077090000000001, 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990503+0000", 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990503+0000", 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990503+0000", 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990509+0000", 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9039999999999997e-06 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990517+0000", 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7600000000000002e-06 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990522+0000", 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8720000000000001e-06 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:10.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990565+0000", 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3717999999999997e-05 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990582+0000", 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6775000000000001e-05 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190308 5.0 5:0f210b3b:::benchmark_data_smithi069_31227_object18651:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.991494+0000", 2024-04-26T12:16:10.998 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010999390000000001, 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011764670000000001, 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190308 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991494+0000", 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:10.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991494+0000", 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991493+0000", 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991499+0000", 2024-04-26T12:16:11.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991508+0000", 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6050000000000004e-06 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991515+0000", 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2249999999999997e-06 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991551+0000", 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6464000000000002e-05 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991710+0000", 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000158517 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991815+0000", 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105142 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.002 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190309 5.9 5.b3374c89 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.991524+0000", 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001070594, 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001218107, 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190309 2024-04-26T12:16:11.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991524+0000", 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991524+0000", 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991523+0000", 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:11.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991525+0000", 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2089999999999999e-06 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991531+0000", 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4550000000000003e-06 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991535+0000", 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2640000000000002e-06 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190310 5.e 5:74e40b95:::benchmark_data_smithi069_31227_object18653:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.991594+0000", 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010000160000000001, 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001200013, 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.006 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190310 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991594+0000", 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991594+0000", 2024-04-26T12:16:11.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991594+0000", 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991597+0000", 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2339999999999999e-06 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991604+0000", 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.379e-06 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991609+0000", 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7690000000000004e-06 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991642+0000", 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3124000000000003e-05 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991805+0000", 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000163079 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991904+0000", 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8428e-05 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.010 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190311 5.d 5:ba3a7343:::benchmark_data_smithi069_31227_object18654:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.991776+0000", 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00081800500000000001, 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001092242, 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190311 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991776+0000", 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991776+0000", 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991776+0000", 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991779+0000", 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5420000000000001e-06 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991787+0000", 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4749999999999996e-06 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991791+0000", 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8149999999999996e-06 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991837+0000", 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5439000000000003e-05 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992006+0000", 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016884199999999999 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:190301 5.e e41/16)", 2024-04-26T12:16:11.014 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.992122+0000", 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00047226499999999998, 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00080932400000000005, 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992122+0000", 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992122+0000", 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992121+0000", 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992126+0000", 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1389999999999997e-06 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992134+0000", 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2090000000000005e-06 2024-04-26T12:16:11.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992140+0000", 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9190000000000004e-06 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190312 5.8 5:16f5602e:::benchmark_data_smithi069_31227_object18655:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.992589+0000", 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.2429999999999996e-06, 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039718799999999998, 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.017 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190312 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992589+0000", 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992589+0000", 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992588+0000", 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992593+0000", 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7269999999999998e-06 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992604+0000", 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1654000000000001e-05 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992612+0000", 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6480000000000003e-06 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992675+0000", 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3118000000000001e-05 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992858+0000", 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018261500000000001 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992953+0000", 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4901000000000005e-05 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190288 5.9 5:98e4cd32:::benchmark_data_smithi069_31227_object18631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.021 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.985382+0000", 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0072124609999999999, 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076808930000000003, 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190288 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985382+0000", 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985382+0000", 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985381+0000", 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985385+0000", 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6619999999999998e-06 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985393+0000", 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4740000000000005e-06 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985398+0000", 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7620000000000003e-06 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985437+0000", 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9481999999999999e-05 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.985624+0000", 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018670000000000001 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.025 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190294 5.9 5:908e3286:::benchmark_data_smithi069_31227_object18637:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.987014+0000", 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055799969999999997, 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006119139, 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190294 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987014+0000", 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987014+0000", 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987014+0000", 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987017+0000", 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7280000000000001e-06 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987026+0000", 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4230000000000005e-06 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987032+0000", 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0090000000000004e-06 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987387+0000", 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00035511100000000002 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987683+0000", 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00029627499999999998 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.029 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190295 5.9 5:9d91f6e7:::benchmark_data_smithi069_31227_object18638:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.987345+0000", 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052486379999999999, 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058546989999999997, 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190295 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987345+0000", 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987345+0000", 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987345+0000", 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987349+0000", 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.493e-06 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987360+0000", 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0485e-05 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987501+0000", 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141116 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989555+0000", 2024-04-26T12:16:11.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020539339999999999 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989654+0000", 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9168999999999999e-05 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190296 5.b 5:ddbfc475:::benchmark_data_smithi069_31227_object18639:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.987515+0000", 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0050791719999999999, 2024-04-26T12:16:11.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057390729999999999, 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190296 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987515+0000", 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987515+0000", 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987514+0000", 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987518+0000", 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.092e-06 2024-04-26T12:16:11.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987533+0000", 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4459e-05 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987551+0000", 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7764000000000001e-05 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987624+0000", 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3693000000000001e-05 2024-04-26T12:16:11.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987892+0000", 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00026792599999999998 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988111+0000", 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021853700000000001 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992205+0000", 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040940830000000001 2024-04-26T12:16:11.037 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190297 5.b 5:d5b5d9f7:::benchmark_data_smithi069_31227_object18640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.987677+0000", 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049175180000000001, 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056491450000000004, 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.038 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190297 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987677+0000", 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987677+0000", 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987676+0000", 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987680+0000", 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987689+0000", 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6559999999999998e-06 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.987695+0000", 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990034+0000", 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023384809999999999 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990204+0000", 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016985599999999999 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.990310+0000", 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010590999999999999 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.992950+0000", 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026403109999999998 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.042 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190301 5.e 5:796d4112:::benchmark_data_smithi069_31227_object18644:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.988433+0000", 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0041607279999999998, 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049724310000000002, 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190301 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988433+0000", 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988433+0000", 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988433+0000", 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988438+0000", 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1959999999999999e-06 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988447+0000", 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6629999999999999e-06 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988453+0000", 2024-04-26T12:16:11.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5629999999999997e-06 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988508+0000", 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5047000000000003e-05 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988704+0000", 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019613700000000001 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988812+0000", 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010739 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991258+0000", 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024462590000000001 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190302 5.9 5:92691706:::benchmark_data_smithi069_31227_object18645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.047 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.988599+0000", 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039948290000000001, 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048858529999999999, 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190302 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988599+0000", 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988599+0000", 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988599+0000", 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988603+0000", 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3030000000000001e-06 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988613+0000", 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8649999999999996e-06 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.988619+0000", 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3709999999999996e-06 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991408+0000", 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027886059999999999 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.991516+0000", 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108724 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:190303 5.9 5:9b8d7ae9:::benchmark_data_smithi069_31227_object18646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:11.051 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:10.989328+0000", 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0032659529999999998, 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042214009999999996, 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 190303 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989328+0000", 2024-04-26T12:16:11.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989328+0000", 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989327+0000", 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:11.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989332+0000", 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.989e-06 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989343+0000", 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1068e-05 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.989350+0000", 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3629999999999999e-06 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:11.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:10.993522+0000", 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041722019999999999 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 15 2024-04-26T12:16:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:11.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:11.057 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:11.055+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:11.157 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:11.155+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:11.239 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:11.240 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:11.240 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:11.240 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:11.240 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:11.245 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:11.251 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:11.258 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:11.256+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:11.358 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:11.357+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:11.366 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:11.366 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:11.366 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:11.405 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:11.405 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:11.407 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:11.408 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:11.408 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:11.408 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:11.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:11.459 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:11.458+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:11.560 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:11.559+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:11.580 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:11.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:11.661 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:11.660+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:11.737 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:11.737 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:11.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:11.795 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:11.792+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:11.836 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:16:11.863 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:11.862+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:11.904 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:11.904 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:11.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:11.963 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:11.961+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.062 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:12.062 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:12.064 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:12.062+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.074 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:12.165 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:12.162+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.214 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:12.214 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:12.226 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:12.266 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:12.265+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.367 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:12.366+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.368 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:12.369 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:12.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:12.467 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:12.466+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:12.533 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:12.533 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:12.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:12.590 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:12.589+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.669 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:12.668+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:12.693 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:12.693 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:12.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:12.791 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:12.790+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.870 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:12.869+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:12.901 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:12.902 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:12.915 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:12.971 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:12.970+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:13.059 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:13.059 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:13.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:13.072 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:13.070+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:13.173 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:13.172+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:13.251 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:13.251 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:13.263 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:13.306 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:13.305+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:13.374 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:13.373+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:13.405 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:13.405 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:13.408 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:13.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:13.476 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:13.475+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:13.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2024-04-26T12:16:13.528 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:13.529 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:13.529 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:13.546 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:13.547 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:13.549 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:13.550 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:13.575 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197877 5.3 5:c6742164:::benchmark_data_smithi069_31227_object26220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.566273+0000", 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0066148439999999999, 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066381679999999998, 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197877 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566273+0000", 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566273+0000", 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566272+0000", 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566277+0000", 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566287+0000", 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9210000000000004e-06 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566293+0000", 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3550000000000001e-06 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.567699+0000", 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014059249999999999 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.567828+0000", 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012874699999999999 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572812+0000", 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049838269999999997 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572853+0000", 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1516e-05 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:13.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572918+0000", 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4554000000000006e-05 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197878 5.2 5:414430e2:::benchmark_data_smithi069_31227_object26221:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.566339+0000", 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065484640000000004, 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006669604, 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197878 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566339+0000", 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566339+0000", 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566338+0000", 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566344+0000", 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.074e-06 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566354+0000", 2024-04-26T12:16:13.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0936e-05 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566360+0000", 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.003e-06 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.567894+0000", 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001533944 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.567993+0000", 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8225000000000002e-05 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572950+0000", 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049575069999999999 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573018+0000", 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8147999999999999e-05 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197879 5.2 5:43ddde7c:::benchmark_data_smithi069_31227_object26222:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.566686+0000", 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0062022930000000002, 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006396344, 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197879 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566686+0000", 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566686+0000", 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566685+0000", 2024-04-26T12:16:13.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566689+0000", 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.544e-06 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566699+0000", 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-06 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.566706+0000", 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.348e-06 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569601+0000", 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028950289999999999 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569763+0000", 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000162156 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197883 5.3 5:cb9f5a28:::benchmark_data_smithi069_31227_object26226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.569484+0000", 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0034040139999999999, 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036584339999999999, 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197883 2024-04-26T12:16:13.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569484+0000", 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569484+0000", 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569483+0000", 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569488+0000", 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0209999999999999e-06 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569512+0000", 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3359000000000001e-05 2024-04-26T12:16:13.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569519+0000", 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9859999999999994e-06 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570014+0000", 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049455799999999998 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570185+0000", 2024-04-26T12:16:13.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017095899999999999 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:197881 5.0 e42/16 5:032671b0:::benchmark_data_smithi069_31227_object26224:head v 42'12358, mlcod=42'12356)", 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.569618+0000", 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003269362, 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035815640000000002, 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.594 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569618+0000", 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569618+0000", 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569618+0000", 2024-04-26T12:16:13.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569624+0000", 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7740000000000001e-06 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569632+0000", 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569639+0000", 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.173e-06 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569690+0000", 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1984999999999998e-05 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569707+0000", 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6952999999999998e-05 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197884 5.2 5:46c76a80:::benchmark_data_smithi069_31227_object26227:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.569619+0000", 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003268473, 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036341189999999999, 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197884 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569619+0000", 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569619+0000", 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569619+0000", 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569623+0000", 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2529999999999998e-06 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569634+0000", 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1044e-05 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569641+0000", 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.545e-06 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573116+0000", 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034752369999999999 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197885 5.1 5:88972302:::benchmark_data_smithi069_31227_object26228:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.569650+0000", 2024-04-26T12:16:13.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0032374560000000001, 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036596950000000001, 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197885 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569650+0000", 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569650+0000", 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569650+0000", 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569653+0000", 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6539999999999999e-06 2024-04-26T12:16:13.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569658+0000", 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5720000000000002e-06 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569669+0000", 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1165000000000001e-05 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569746+0000", 2024-04-26T12:16:13.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6711999999999993e-05 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569923+0000", 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000177472 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197886 5.c 5:3e36df6c:::benchmark_data_smithi069_31227_object26229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.569683+0000", 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0032046269999999998, 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036874080000000001, 2024-04-26T12:16:13.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197886 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569683+0000", 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569683+0000", 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569683+0000", 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569686+0000", 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9179999999999998e-06 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569692+0000", 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1800000000000001e-06 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569697+0000", 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569760+0000", 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3816e-05 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570042+0000", 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028159499999999999 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197887 5.c 5:3af2f248:::benchmark_data_smithi069_31227_object26230:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.569778+0000", 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0031099280000000001, 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003652228, 2024-04-26T12:16:13.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197887 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569778+0000", 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569778+0000", 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569777+0000", 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569781+0000", 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9720000000000003e-06 2024-04-26T12:16:13.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569789+0000", 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6890000000000004e-06 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.569795+0000", 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7980000000000002e-06 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572948+0000", 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031535320000000001 2024-04-26T12:16:13.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573076+0000", 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012761700000000001 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197889 5.3 5:c106c0ec:::benchmark_data_smithi069_31227_object26232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.570001+0000", 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0028868650000000002, 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034879220000000001, 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197889 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570001+0000", 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570001+0000", 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570000+0000", 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570004+0000", 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2050000000000004e-06 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570013+0000", 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3639999999999999e-06 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570019+0000", 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9819999999999996e-06 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573366+0000", 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003347245 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197890 5.7 5:ee34cca9:::benchmark_data_smithi069_31227_object26233:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.570557+0000", 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0023308579999999999, 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00298702, 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197890 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570557+0000", 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570557+0000", 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570556+0000", 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570561+0000", 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570571+0000", 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0749e-05 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570577+0000", 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1299999999999998e-06 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570622+0000", 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4311000000000003e-05 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.570775+0000", 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015300700000000001 2024-04-26T12:16:13.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:197891 5.4 e42/16 5:264619fd:::benchmark_data_smithi069_31227_object26234:head v 42'12245, mlcod=42'12243)", 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.571247+0000", 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0016405530000000001, 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023539889999999999, 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571247+0000", 2024-04-26T12:16:13.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571247+0000", 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571247+0000", 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571255+0000", 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5059999999999995e-06 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571264+0000", 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1819999999999995e-06 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571270+0000", 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6280000000000002e-06 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572875+0000", 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001605071 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572891+0000", 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5874000000000001e-05 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:197888 5.8 e42/16 5:1fea1b0f:::benchmark_data_smithi069_31227_object26231:head v 42'12474, mlcod=42'12472)", 2024-04-26T12:16:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.571292+0000", 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0015963220000000001, 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023612210000000002, 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571292+0000", 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571292+0000", 2024-04-26T12:16:13.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571289+0000", 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999976 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571295+0000", 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1800000000000004e-06 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571300+0000", 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7100000000000004e-06 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571304+0000", 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1420000000000003e-06 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571371+0000", 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6136000000000005e-05 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571388+0000", 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7683e-05 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:197882 5.0 e42/16 5:009d391e:::benchmark_data_smithi069_31227_object26225:head v 42'12359, mlcod=42'12356)", 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.571405+0000", 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014828739999999999, 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002299995, 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571405+0000", 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571405+0000", 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571405+0000", 2024-04-26T12:16:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571409+0000", 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571421+0000", 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1724e-05 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571425+0000", 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.78e-06 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572845+0000", 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001419607 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.572863+0000", 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7799e-05 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:197892 5.7 5:e4095d89:::benchmark_data_smithi069_31227_object26235:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.571557+0000", 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001331247, 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002205463, 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:13.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 197892 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571557+0000", 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571557+0000", 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571556+0000", 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571561+0000", 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8250000000000004e-06 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571570+0000", 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7780000000000002e-06 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.571576+0000", 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573241+0000", 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016643059999999999 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573384+0000", 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143156 2024-04-26T12:16:13.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:197893 5.0 e42/16)", 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.573382+0000", 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9995055, 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043501500000000002, 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573382+0000", 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573382+0000", 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573382+0000", 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573390+0000", 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3669999999999997e-06 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573398+0000", 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4030000000000007e-06 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573404+0000", 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7239999999999997e-06 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:197895 5.b e42/16 5:da1fdeb6:::benchmark_data_smithi069_31227_object26238:head v 42'12461, mlcod=42'12459)", 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:13.573423+0000", 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.999465, 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043748700000000002, 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573423+0000", 2024-04-26T12:16:13.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573423+0000", 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573422+0000", 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:13.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573426+0000", 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.822e-06 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573435+0000", 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4009999999999997e-06 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573439+0000", 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:13.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573489+0000", 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0602000000000001e-05 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:13.573506+0000", 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6376999999999999e-05 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 17 2024-04-26T12:16:13.642 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:13.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:13.644 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:13.642+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:13.744 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:13.743+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:13.838 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:13.839 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:13.839 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:13.839 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:13.839 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:13.846 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:13.845+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:13.849 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:16:13.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:13.945 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:13.944+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:14.047 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:53583 5.3 5:cde3a69f:::benchmark_data_smithi069_31227_object53582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.83759654, 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019089782999999999, 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 53583 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206429+0000", 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206428+0000", 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206461+0000", 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2954000000000003e-05 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206471+0000", 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0154e-05 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.206478+0000", 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212678+0000", 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061995169999999999 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.212910+0000", 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231764 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225332+0000", 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012422773999999999 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225423+0000", 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000001e-05 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:19.225519+0000", 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6037000000000002e-05 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72177 5.c 5:33a7d470:::benchmark_data_smithi069_31227_object72176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.810756499999997, 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019080219999999998, 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72177 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233269+0000", 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233268+0000", 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233324+0000", 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5909999999999998e-05 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233332+0000", 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4090000000000003e-06 2024-04-26T12:16:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233339+0000", 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243795+0000", 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010456109 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.243935+0000", 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014016899999999999 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252229+0000", 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082939750000000003 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252283+0000", 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4617000000000002e-05 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.252349+0000", 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5672000000000004e-05 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.810026790000002, 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:75224 5.a 5:53f647c8:::benchmark_data_smithi069_31227_object75223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.653480205999998, 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018701460999999999, 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 75224 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390545+0000", 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390544+0000", 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390596+0000", 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1935000000000003e-05 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390607+0000", 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0831e-05 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.390614+0000", 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396422+0000", 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058080520000000002 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396504+0000", 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.396585+0000", 2024-04-26T12:16:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1352000000000003e-05 2024-04-26T12:16:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.402869+0000", 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062842139999999998 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409156+0000", 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062870230000000001 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409209+0000", 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3127000000000001e-05 2024-04-26T12:16:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:27.409247+0000", 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7379000000000002e-05 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:85083 5.2 5:4fa82350:::benchmark_data_smithi069_31227_object85082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.849493060999997, 2024-04-26T12:16:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464389000000001, 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 85083 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194532+0000", 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194531+0000", 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194563+0000", 2024-04-26T12:16:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1239999999999999e-05 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194573+0000", 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0647e-05 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.194579+0000", 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199153+0000", 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004573995 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.199288+0000", 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134368 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212866+0000", 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013578654000000001 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212912+0000", 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859000000000003e-05 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:31.212997+0000", 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4447e-05 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.410970968000001, 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:14.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.082 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105207 5.6 5:6f10f2dd:::benchmark_data_smithi069_31227_object105206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.006713511000001, 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018496265000000001, 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105207 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037312+0000", 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037311+0000", 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037377+0000", 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6138999999999998e-05 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037385+0000", 2024-04-26T12:16:14.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037389+0000", 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3270000000000002e-06 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.042916+0000", 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055263270000000001 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.043042+0000", 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012667000000000001 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055688+0000", 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012645933 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055738+0000", 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9424e-05 2024-04-26T12:16:14.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.055808+0000", 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310999999999998e-05 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.006557878000002, 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:14.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:14.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:14.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105838 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:14.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.750717321000003, 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018575891000000001, 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105838 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293308+0000", 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293336+0000", 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293343+0000", 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.293348+0000", 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300711+0000", 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073630780000000003 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.300840+0000", 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012915299999999999 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311762+0000", 2024-04-26T12:16:14.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010921604 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311811+0000", 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9829e-05 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.311884+0000", 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2502000000000005e-05 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.684610972000002, 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:14.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.688642934000001, 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:14.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:14.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:14.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.688290373000001, 2024-04-26T12:16:14.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:14.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.684499463000002, 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:14.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.677102434999998, 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:14.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:14.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:14.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142153 5.3 5:cec870a5:::benchmark_data_smithi069_31227_object142152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.67259314, 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617905000000001, 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142153 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371432+0000", 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371431+0000", 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371497+0000", 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5508999999999999e-05 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371507+0000", 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0168e-05 2024-04-26T12:16:14.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.371514+0000", 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374553+0000", 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030394340000000001 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374657+0000", 2024-04-26T12:16:14.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104141 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389904+0000", 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015246414999999999 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.389986+0000", 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2021999999999995e-05 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.390050+0000", 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4634999999999994e-05 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142157 5.3 5:c58c17dc:::benchmark_data_smithi069_31227_object142156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.669831112000001, 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018459414, 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142157 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374194+0000", 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374257+0000", 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3373000000000005e-05 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374267+0000", 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:16:14.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.374273+0000", 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382530+0000", 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082570739999999997 2024-04-26T12:16:14.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.382666+0000", 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135086 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392530+0000", 2024-04-26T12:16:14.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098646240000000007 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392575+0000", 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5272000000000003e-05 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.392654+0000", 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8274000000000003e-05 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:149752 5.a 5:59e73ebb:::benchmark_data_smithi069_31227_object149751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.747973417000001, 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018927920000000001, 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 149752 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.136 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296052+0000", 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296051+0000", 2024-04-26T12:16:14.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296491+0000", 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000439813 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296502+0000", 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296508+0000", 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296552+0000", 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3480999999999999e-05 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296683+0000", 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013126899999999999 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.296823+0000", 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139782 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.300824+0000", 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040012720000000002 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314902+0000", 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01407796 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314941+0000", 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8773000000000003e-05 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:56.314980+0000", 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:164265 5.2 5:429fc2e1:::benchmark_data_smithi069_31227_object164264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.132786089, 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018708573999999999, 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164265 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911239+0000", 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911333+0000", 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4102000000000001e-05 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911339+0000", 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.911343+0000", 2024-04-26T12:16:14.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1799999999999998e-06 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919312+0000", 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079682869999999992 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.919441+0000", 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012956999999999999 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929814+0000", 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010372476 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929870+0000", 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6647000000000002e-05 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:01.929948+0000", 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7612000000000002e-05 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5617134200000002, 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:14.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.3868737370000002, 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:14.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:14.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.157 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:14.158 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:14.045+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:14.159 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:14.159 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:14.157+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:14.259 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:14.258+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200069 5.0 5:0c5c4eab:::benchmark_data_smithi069_31227_object28412:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.295287+0000", 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0051382060000000002, 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051619329999999996, 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.302 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200069 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295287+0000", 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295287+0000", 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295287+0000", 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295289+0000", 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2010000000000002e-06 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295295+0000", 2024-04-26T12:16:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7440000000000004e-06 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295300+0000", 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.694e-06 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295369+0000", 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9264999999999995e-05 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295505+0000", 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013517800000000001 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.295600+0000", 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5422999999999998e-05 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298372+0000", 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027718510000000001 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.306 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200073 5.f 5:f8b397eb:::benchmark_data_smithi069_31227_object28416:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.297069+0000", 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033563270000000001, 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034641490000000001, 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200073 2024-04-26T12:16:14.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297069+0000", 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297069+0000", 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297068+0000", 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297074+0000", 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.772e-06 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297098+0000", 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4087000000000002e-05 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297105+0000", 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9539999999999998e-06 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297143+0000", 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8575999999999998e-05 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297329+0000", 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000185766 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.310 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200075 5.f 5:f3100487:::benchmark_data_smithi069_31227_object28418:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.297813+0000", 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002612475, 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027843239999999999, 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.311 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200075 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297813+0000", 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297813+0000", 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297812+0000", 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297817+0000", 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2310000000000004e-06 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297830+0000", 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2988e-05 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297838+0000", 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6680000000000001e-06 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299368+0000", 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001530102 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299531+0000", 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016359 2024-04-26T12:16:14.314 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200077 5.8 5:16fa026c:::benchmark_data_smithi069_31227_object28420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.297955+0000", 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024700640000000001, 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027061889999999999, 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.315 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200077 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297955+0000", 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297955+0000", 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297954+0000", 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297958+0000", 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.211e-06 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297975+0000", 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6608000000000001e-05 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.297982+0000", 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4119999999999998e-06 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298014+0000", 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2784000000000003e-05 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298132+0000", 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117557 2024-04-26T12:16:14.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298263+0000", 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013110800000000001 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200079 5.f 5.1c62d06f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.298152+0000", 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022728620000000001, 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025755840000000001, 2024-04-26T12:16:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200079 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298152+0000", 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298152+0000", 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298152+0000", 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298155+0000", 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7390000000000001e-06 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298163+0000", 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0099999999999995e-06 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298172+0000", 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.322 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200080 5.d 5:b8b48c04:::benchmark_data_smithi069_31227_object28423:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.298209+0000", 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022165650000000002, 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025706750000000001, 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200080 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298209+0000", 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298209+0000", 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298208+0000", 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298211+0000", 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298219+0000", 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7109999999999995e-06 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298225+0000", 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:16:14.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298260+0000", 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4725999999999999e-05 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298396+0000", 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013616 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200082 5.f 5.be6d93af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.298345+0000", 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020797739999999999, 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002492513, 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200082 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298345+0000", 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298345+0000", 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298345+0000", 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298349+0000", 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9990000000000002e-06 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298358+0000", 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4420000000000004e-06 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.298364+0000", 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2380000000000002e-06 2024-04-26T12:16:14.329 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200086 5.4 5:2ae163c0:::benchmark_data_smithi069_31227_object28429:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.299907+0000", 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00051818399999999998, 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0009843269999999999, 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200086 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299907+0000", 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299907+0000", 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299906+0000", 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299911+0000", 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.809e-06 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299920+0000", 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1370000000000008e-06 2024-04-26T12:16:14.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299927+0000", 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1960000000000002e-06 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.299960+0000", 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3183999999999999e-05 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.300104+0000", 2024-04-26T12:16:14.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000143175 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.300199+0000", 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5822000000000005e-05 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:200058 5.f 5:fadff4d4:::benchmark_data_smithi069_31227_object28401:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.292513+0000", 2024-04-26T12:16:14.334 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0079126130000000006, 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0084461510000000007, 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 200058 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.292513+0000", 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.292513+0000", 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.292512+0000", 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.292517+0000", 2024-04-26T12:16:14.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8189999999999999e-06 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.292526+0000", 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.292532+0000", 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5939999999999999e-06 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.293266+0000", 2024-04-26T12:16:14.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00073408100000000003 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.293401+0000", 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013452099999999999 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-26T12:16:14.338 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:14.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:14.383 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:14.382+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:14.461 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:14.460+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:14.473 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:14.473 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:14.473 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:14.473 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:14.473 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:14.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:14.569 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:14.568+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:14.664 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:14.662+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:14.665 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:14.665 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:14.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.028546284000001, 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:14.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.670 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.027431116000002, 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:14.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.675 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.027158532000001, 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:14.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:14.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.025891975, 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.025684527000003, 2024-04-26T12:16:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.025259042999998, 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.024988102999998, 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.023914103999999, 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3462553119999998, 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191360 5.d 5:b07be038:::benchmark_data_smithi069_31227_object19703:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.320768+0000", 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3415370179999999, 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064377222999999997, 2024-04-26T12:16:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191360 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.320768+0000", 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.320768+0000", 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.320767+0000", 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.320773+0000", 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2440000000000001e-06 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.320783+0000", 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0158e-05 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.320790+0000", 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2570000000000001e-06 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321902+0000", 2024-04-26T12:16:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001111817 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322125+0000", 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000223322 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384932+0000", 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.062807138999999998 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385077+0000", 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014470800000000001 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385145+0000", 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8459000000000003e-05 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191363 5.e 5:79ae819d:::benchmark_data_smithi069_31227_object19706:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.321224+0000", 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3410816900000002, 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063838480000000003, 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191363 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321224+0000", 2024-04-26T12:16:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321224+0000", 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321223+0000", 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321227+0000", 2024-04-26T12:16:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3880000000000002e-06 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321237+0000", 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0176e-05 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321244+0000", 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321287+0000", 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2867999999999997e-05 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321446+0000", 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015917399999999999 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.321545+0000", 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9809999999999995e-05 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325571+0000", 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040257239999999996 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384983+0000", 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059411501999999998 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385028+0000", 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5200000000000001e-05 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385062+0000", 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4128000000000003e-05 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191366 5.b 5:d4f90380:::benchmark_data_smithi069_31227_object19709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322269+0000", 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3400357619999999, 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.062924649999999999, 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191366 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322269+0000", 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322269+0000", 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322269+0000", 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322273+0000", 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8729999999999998e-06 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322283+0000", 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2299999999999997e-06 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322292+0000", 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0990000000000005e-06 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322325+0000", 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3563999999999999e-05 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322462+0000", 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136291 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322568+0000", 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106537 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385078+0000", 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.062509426000000007 2024-04-26T12:16:14.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385123+0000", 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5293000000000002e-05 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385161+0000", 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7562999999999999e-05 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385194+0000", 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3645000000000001e-05 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3399955339999998, 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.731 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:14.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:14.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191371 5.e 5:71e87366:::benchmark_data_smithi069_31227_object19714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.323086+0000", 2024-04-26T12:16:14.736 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.339218899, 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.062299113000000003, 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191371 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323086+0000", 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323086+0000", 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323085+0000", 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323090+0000", 2024-04-26T12:16:14.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9400000000000001e-06 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323101+0000", 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.024e-05 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323107+0000", 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2890000000000003e-06 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323541+0000", 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00043365100000000001 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323680+0000", 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013929200000000001 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.323778+0000", 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7862999999999995e-05 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384931+0000", 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.061153122999999997 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385286+0000", 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000355003 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385333+0000", 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7107999999999997e-05 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385385+0000", 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2574999999999997e-05 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3375689500000001, 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.742 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:14.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:14.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191375 5.e 5:77101596:::benchmark_data_smithi069_31227_object19718:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324773+0000", 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3375324910000002, 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.063134999999999997, 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.748 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191375 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324773+0000", 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324773+0000", 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324772+0000", 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324775+0000", 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6110000000000001e-06 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324784+0000", 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0010000000000007e-06 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324789+0000", 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.882e-06 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325586+0000", 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00079760699999999998 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325684+0000", 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7609999999999995e-05 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325742+0000", 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7939999999999998e-05 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385517+0000", 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059774704999999997 2024-04-26T12:16:14.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387822+0000", 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023058530000000001 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387865+0000", 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2491999999999999e-05 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387908+0000", 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2828999999999999e-05 2024-04-26T12:16:14.753 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191377 5.8 5:17b52d41:::benchmark_data_smithi069_31227_object19720:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324920+0000", 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3373852469999998, 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.062799913999999998, 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.754 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191377 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324920+0000", 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324920+0000", 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324919+0000", 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324923+0000", 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7280000000000001e-06 2024-04-26T12:16:14.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324931+0000", 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6690000000000006e-06 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324936+0000", 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324991+0000", 2024-04-26T12:16:14.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4698999999999999e-05 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325134+0000", 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014284700000000001 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325243+0000", 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010982800000000001 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385026+0000", 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059782689999999999 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387638+0000", 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00261203 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387676+0000", 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8217999999999999e-05 2024-04-26T12:16:14.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387720+0000", 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3571e-05 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3372811640000002, 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:14.760 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:14.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.765 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3370501510000001, 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.3342760130000002, 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:14.771 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:14.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:14.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:14.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:14.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:14.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:14.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.777 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:14.777 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:14.777 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:14.778 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:14.777+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:14.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:14.842 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:16:14.879 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:14.878+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0098371640000000007, 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098539620000000008, 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5.4e5d81b3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0091122379999999999, 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091642500000000005, 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:14.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0090773030000000001, 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091614829999999998, 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:14.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5.4b9be237 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0084089539999999997, 2024-04-26T12:16:14.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085251939999999998, 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:14.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0081909570000000004, 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083336420000000005, 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:14.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011833365, 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012003925, 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:14.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011597849, 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011800857, 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:14.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5.6bec1c23 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:14.948 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010419787, 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010651374999999999, 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:14.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.951 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:14.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:14.952 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:14.952 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 8 2024-04-26T12:16:14.952 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:14.953 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:14.980 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:14.979+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:15.081 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:15.079+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:15.146 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:15.146 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:15.147 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:15.147 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:15.147 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:15.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:15.181 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:15.180+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:15.282 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:15.281+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.075830076000003, 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.676774254000001, 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.272361164000003, 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.950414257999999, 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:15.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.954446220000001, 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.954093659000002, 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.950302748999999, 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:15.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:15.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:15.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.942905720999999, 2024-04-26T12:16:15.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:15.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:15.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8275167059999999, 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:15.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:15.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6526770229999999, 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:15.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:15.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40064833, 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.367 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:15.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:15.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40041281400000001, 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:15.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:15.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39923475200000003, 2024-04-26T12:16:15.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:15.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:15.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:15.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39865212900000002, 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:15.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39792720300000001, 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:15.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:15.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39789226799999999, 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:15.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:15.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39722391899999998, 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39700592200000001, 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:15.405 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39575608699999998, 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:15.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.39487883899999998, 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:15.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:15.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:15.415 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:15.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:15.417 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:15.415+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:15.517 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:15.516+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:15.551 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:15.557 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:15.557 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:15.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.557 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203463 5.9 5:9a9b53d9:::benchmark_data_smithi069_31227_object31806:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.557 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.548574+0000", 2024-04-26T12:16:15.557 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0068852230000000002, 2024-04-26T12:16:15.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069035049999999999, 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203463 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548574+0000", 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548574+0000", 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548573+0000", 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548576+0000", 2024-04-26T12:16:15.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8320000000000002e-06 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548583+0000", 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6089999999999997e-06 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548588+0000", 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4539999999999998e-06 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548634+0000", 2024-04-26T12:16:15.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5528999999999997e-05 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548812+0000", 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017793600000000001 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203464 5.4 5:200fb648:::benchmark_data_smithi069_31227_object31807:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.548596+0000", 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0068630430000000001, 2024-04-26T12:16:15.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069232119999999998, 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203464 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548596+0000", 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548596+0000", 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548595+0000", 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548598+0000", 2024-04-26T12:16:15.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.711e-06 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548610+0000", 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1909000000000001e-05 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.548615+0000", 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549947+0000", 2024-04-26T12:16:15.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013316910000000001 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550130+0000", 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018331200000000001 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550242+0000", 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111284 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553492+0000", 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032501140000000001 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203467 5.b 5:dda9233b:::benchmark_data_smithi069_31227_object31810:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.549832+0000", 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0056271569999999998, 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057302009999999999, 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203467 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549832+0000", 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549832+0000", 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549831+0000", 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549834+0000", 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.931e-06 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549846+0000", 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1336e-05 2024-04-26T12:16:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549852+0000", 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.549874+0000", 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2773e-05 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550020+0000", 2024-04-26T12:16:15.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014601800000000001 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550144+0000", 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012403699999999999 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552286+0000", 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002141231 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203468 5.9 5:944ed78e:::benchmark_data_smithi069_31227_object31811:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.550833+0000", 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046258489999999996, 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047725509999999999, 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203468 2024-04-26T12:16:15.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550833+0000", 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550833+0000", 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550832+0000", 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550837+0000", 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9470000000000002e-06 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550848+0000", 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0387000000000001e-05 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550855+0000", 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0149999999999998e-06 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550894+0000", 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9171000000000002e-05 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551004+0000", 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109864 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.574 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203469 5.e 5:7c52c1e0:::benchmark_data_smithi069_31227_object31812:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.550869+0000", 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045898800000000002, 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047703750000000003, 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203469 2024-04-26T12:16:15.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550869+0000", 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550869+0000", 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.576 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550869+0000", 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550872+0000", 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1200000000000002e-06 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550882+0000", 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8239999999999995e-06 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550888+0000", 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0610000000000001e-06 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550925+0000", 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7814000000000001e-05 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551103+0000", 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000177398 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551220+0000", 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117621 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553691+0000", 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002470763 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203470 5.4 5:2a71c38b:::benchmark_data_smithi069_31227_object31813:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.579 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.550900+0000", 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045587049999999997, 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047787710000000002, 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203470 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550900+0000", 2024-04-26T12:16:15.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550900+0000", 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550900+0000", 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550903+0000", 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8590000000000001e-06 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550909+0000", 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.737e-06 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.550915+0000", 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4280000000000004e-06 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551767+0000", 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085194600000000002 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551892+0000", 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000125041 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551951+0000", 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9669000000000001e-05 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555397+0000", 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034456420000000001 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203472 5.9 5:96a7e08c:::benchmark_data_smithi069_31227_object31815:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.584 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.551337+0000", 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0041223429999999997, 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043845129999999996, 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203472 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551337+0000", 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551337+0000", 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551336+0000", 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551340+0000", 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0960000000000003e-06 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551351+0000", 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0539e-05 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551356+0000", 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4739999999999996e-06 2024-04-26T12:16:15.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552595+0000", 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001239219 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552750+0000", 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015493899999999999 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203473 5.0 5:00082425:::benchmark_data_smithi069_31227_object31816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.551388+0000", 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040705660000000003, 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043665020000000004, 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203473 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551388+0000", 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551388+0000", 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551388+0000", 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551391+0000", 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551399+0000", 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0879999999999995e-06 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551404+0000", 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1630000000000004e-06 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551441+0000", 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6745999999999997e-05 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551591+0000", 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014973300000000001 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.551716+0000", 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012540199999999999 2024-04-26T12:16:15.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203474 5.4 5:258efc37:::benchmark_data_smithi069_31227_object31817:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.552083+0000", 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003376057, 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037082059999999999, 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203474 2024-04-26T12:16:15.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552083+0000", 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552083+0000", 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.594 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552082+0000", 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552087+0000", 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552098+0000", 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0793e-05 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552104+0000", 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2770000000000002e-06 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553587+0000", 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001483041 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553717+0000", 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013018200000000001 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553810+0000", 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2287000000000006e-05 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203476 5.8 5:17cc742d:::benchmark_data_smithi069_31227_object31819:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.552116+0000", 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033429509999999998, 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037110070000000001, 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.597 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203476 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552116+0000", 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552116+0000", 2024-04-26T12:16:15.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552116+0000", 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552118+0000", 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8660000000000002e-06 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552129+0000", 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0635999999999999e-05 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552134+0000", 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7149999999999997e-06 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552171+0000", 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7428000000000001e-05 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552311+0000", 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013953899999999999 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.552410+0000", 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9378999999999998e-05 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203478 5.0 5:0901a340:::benchmark_data_smithi069_31227_object31821:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.601 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.553426+0000", 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020325690000000001, 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024366840000000002, 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203478 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553426+0000", 2024-04-26T12:16:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553426+0000", 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553426+0000", 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553431+0000", 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5090000000000001e-06 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553440+0000", 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4190000000000008e-06 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553448+0000", 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2899999999999997e-06 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553474+0000", 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6441e-05 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553563+0000", 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9036999999999995e-05 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553628+0000", 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5208000000000003e-05 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.605 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203480 5.4 5:28fd0f05:::benchmark_data_smithi069_31227_object31823:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.553863+0000", 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001595508, 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020353680000000001, 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203480 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553863+0000", 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553863+0000", 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553863+0000", 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553867+0000", 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553882+0000", 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4963999999999999e-05 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.553888+0000", 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.28e-06 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555420+0000", 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015321149999999999 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555533+0000", 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011265299999999999 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555596+0000", 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3285000000000001e-05 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203481 5.f 5:f21eb2b3:::benchmark_data_smithi069_31227_object31824:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.554394+0000", 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0010653100000000001, 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015424550000000001, 2024-04-26T12:16:15.610 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203481 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554394+0000", 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554394+0000", 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554393+0000", 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554397+0000", 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554405+0000", 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3890000000000005e-06 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554412+0000", 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5189999999999998e-06 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554450+0000", 2024-04-26T12:16:15.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.862e-05 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.554598+0000", 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014750899999999999 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:203474 5.4 e43/16)", 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.555692+0000", 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997668, 2024-04-26T12:16:15.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032206599999999998, 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555692+0000", 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555692+0000", 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555692+0000", 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555696+0000", 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3810000000000001e-06 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555707+0000", 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0961999999999999e-05 2024-04-26T12:16:15.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555713+0000", 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8340000000000004e-06 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:203484 5.4 5.dca4cfc4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:15.555985+0000", 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.999474, 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2908000000000001e-05, 2024-04-26T12:16:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 203484 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555985+0000", 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555985+0000", 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555984+0000", 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555989+0000", 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0019999999999997e-06 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.555999+0000", 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5270000000000004e-06 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.556005+0000", 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1600000000000003e-06 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:15.620 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 15 2024-04-26T12:16:15.621 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:15.622 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:15.622 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:15.620+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:15.671 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:15.672 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:15.672 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:15.691 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:15.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:15.694 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:15.723 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:15.722+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:15.806 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:15.806 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:15.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:15.824 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:15.822+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:15.924 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:15.923+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:15.955 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:15.956 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:15.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:16.025 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:16.024+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:16.117 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:16.126 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:16.125+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:16.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:16.227 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:16.226+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:16.320 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:16.321 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:16.328 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:16.326+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:16.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:16.429 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:16.428+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:16.526 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:16.526 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:16.529 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:16.528+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:16.540 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:16.631 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:16.629+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:16.682 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:16.682 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:16.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:16.732 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:16.730+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:16.833 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:16.831+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:16.846 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:16.856 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:16:16.933 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:16.932+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:17.024 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:17.024 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:17.035 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.033+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:17.135 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.134+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.190 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:17.190 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:17.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:17.244 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.243+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.336 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:17.335+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:17.393 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:17.394 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:17.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:17.451 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.450+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.538 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.536+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.557 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:17.557 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:17.570 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:17.638 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.637+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.695 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:17.714 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:17.714 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:17.726 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:17.738 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.737+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.817 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:17.817 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:17.817 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:17.835 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:17.836 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:17.838 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:17.838 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:17.839 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.838+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:17.847 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:16:17.866 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:17.866 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:17.866 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:17.866 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:17.867 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:17.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:17.940 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:17.939+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:18.022 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:18.022 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:18.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:18.022 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.385907191000001, 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:18.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:18.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.384792023000003, 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.027 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.384519439000002, 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.032 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:18.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:18.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.037 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.383252882000001, 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.038 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:18.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.383045434000003, 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:18.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:18.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:18.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.382619949999999, 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:18.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.382349009999999, 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 41.381275011, 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.058 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:18.063 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.7036162189999997, 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.064 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:18.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:18.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.6973564410000002, 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:18.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:18.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:18.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.694929857, 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.074 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:18.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:18.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.079 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.6946420709999996, 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:18.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.694411058, 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:18.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:18.090 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 6.6916369199999997, 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:18.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:18.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.110513944, 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:18.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:18.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:18.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:18.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.110420059, 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.101 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:18.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1071031040000001, 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.107 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:18.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:18.112 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1058869790000001, 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:18.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:18.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:18.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:18.118 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1058693000000002, 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:18.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 3.1022905619999999, 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.124 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:18.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:18.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.129 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.130 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:18.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:18.132 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:18.129+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:18.232 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:18.230+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:18.287 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:18.287 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:18.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:211425 5.5 5:acebd1aa:::benchmark_data_smithi069_31227_object39768:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.280939+0000", 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0050401250000000003, 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005057443, 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 211425 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280939+0000", 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280939+0000", 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280939+0000", 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280948+0000", 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6390000000000004e-06 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280957+0000", 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7749999999999998e-06 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280964+0000", 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4320000000000004e-06 2024-04-26T12:16:18.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281011+0000", 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7460000000000003e-05 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281183+0000", 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017153000000000001 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:211426 5.5 5:a0956acf:::benchmark_data_smithi069_31227_object39769:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.280975+0000", 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0050040149999999997, 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050633930000000002, 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 211426 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280975+0000", 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280975+0000", 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280975+0000", 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280978+0000", 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9639999999999999e-06 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280984+0000", 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.280989+0000", 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1569999999999999e-06 2024-04-26T12:16:18.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.282977+0000", 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019875740000000002 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283125+0000", 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148338 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:211427 5.5 5:ab1c185f:::benchmark_data_smithi069_31227_object39770:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.281918+0000", 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040611479999999997, 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041555400000000001, 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 211427 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281918+0000", 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281918+0000", 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281917+0000", 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281922+0000", 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9980000000000003e-06 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281932+0000", 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7610000000000002e-06 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.281938+0000", 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0970000000000002e-06 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284718+0000", 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002780243 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284872+0000", 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015390799999999999 2024-04-26T12:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:211429 5.e e44/16 5:7c9aadd5:::benchmark_data_smithi069_31227_object39772:head v 44'13273, mlcod=44'13271)", 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.283484+0000", 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0024950380000000002, 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026254770000000002, 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283484+0000", 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283484+0000", 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283484+0000", 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283489+0000", 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.605e-06 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283496+0000", 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7239999999999992e-06 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283502+0000", 2024-04-26T12:16:18.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9109999999999998e-06 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283550+0000", 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7635e-05 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.283567+0000", 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6646e-05 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:211436 5.5 5.8085dc55 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.284140+0000", 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0018394450000000001, 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020001580000000001, 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 211436 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284140+0000", 2024-04-26T12:16:18.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284140+0000", 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284139+0000", 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284144+0000", 2024-04-26T12:16:18.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284153+0000", 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1819999999999995e-06 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284159+0000", 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0970000000000002e-06 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:211434 5.b e44/16 5:d60da9e8:::benchmark_data_smithi069_31227_object39777:head v 44'13316, mlcod=44'13313)", 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.284226+0000", 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001753758, 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019452199999999999, 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284226+0000", 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284226+0000", 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284225+0000", 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284231+0000", 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9059999999999999e-06 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284241+0000", 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023e-05 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284247+0000", 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.251e-06 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284276+0000", 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113999999999999e-05 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.284293+0000", 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6169000000000001e-05 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:211430 5.e e44/16 5:76535216:::benchmark_data_smithi069_31227_object39773:head v 44'13274, mlcod=44'13271)", 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.285605+0000", 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00037408999999999999, 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062108699999999998, 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285605+0000", 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285605+0000", 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285605+0000", 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285611+0000", 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285620+0000", 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0749999999999998e-06 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285625+0000", 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285672+0000", 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6733999999999997e-05 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285691+0000", 2024-04-26T12:16:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8711000000000001e-05 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:211443 5.1 5:8617fd1e:::benchmark_data_smithi069_31227_object39786:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.285793+0000", 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00018674699999999999, 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049428600000000003, 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 211443 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285793+0000", 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285793+0000", 2024-04-26T12:16:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285792+0000", 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285796+0000", 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5240000000000002e-06 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285805+0000", 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285809+0000", 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5889999999999996e-06 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.285842+0000", 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2923000000000003e-05 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286009+0000", 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016668299999999999 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:211441 5.8 e44/16 5:1e65d8a9:::benchmark_data_smithi069_31227_object39784:head v 44'13325, mlcod=44'13323)", 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:18.286146+0000", 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998331, 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020317600000000001, 2024-04-26T12:16:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286146+0000", 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286146+0000", 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286146+0000", 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286151+0000", 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3850000000000001e-06 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286161+0000", 2024-04-26T12:16:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9480000000000003e-06 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286167+0000", 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286207+0000", 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9585000000000001e-05 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:18.286227+0000", 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0869e-05 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 9 2024-04-26T12:16:18.322 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:18.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:18.332 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:18.331+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:18.433 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:18.432+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:18.471 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:18.472 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:18.472 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:18.472 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:18.472 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:18.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:18.534 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:18.532+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:18.634 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:18.633+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:18.638 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:18.638 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:18.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:18.638 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:18.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.638 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.401675032, 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:18.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:18.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.002619209999999, 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.59820612, 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:18.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:18.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.276259214, 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:18.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:18.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:18.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.280291175999999, 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:18.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.279938614999999, 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.276147705, 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:18.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:18.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142142 5.3 5:c97576df:::benchmark_data_smithi069_31227_object142141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.268750677, 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019659803999999999, 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142142 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366923+0000", 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366922+0000", 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366997+0000", 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.47e-05 2024-04-26T12:16:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367009+0000", 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2431e-05 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.367016+0000", 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370805+0000", 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037887730000000001 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.370955+0000", 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015016899999999999 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386459+0000", 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015503724 2024-04-26T12:16:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386504+0000", 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4974e-05 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.386583+0000", 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9263000000000003e-05 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.153361662, 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.9785219789999999, 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7264932860000002, 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7262577700000001, 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.725079708, 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7244970849999999, 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7237721590000001, 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7237372239999997, 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7230688750000001, 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.722850878, 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7216010430000002, 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7207237950000001, 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:18.739 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:18.740 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:18.739+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:18.741 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:18.842 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:18.840+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:18.887 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213188 5.9 5:9d9a014c:::benchmark_data_smithi069_31227_object41531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.879754+0000", 2024-04-26T12:16:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0057703700000000004, 2024-04-26T12:16:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057865570000000003, 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213188 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879754+0000", 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879754+0000", 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879754+0000", 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879758+0000", 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9700000000000001e-06 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879765+0000", 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7540000000000006e-06 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879771+0000", 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3399999999999997e-06 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879805+0000", 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4285999999999997e-05 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.879960+0000", 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015482199999999999 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213191 5.9 5:92a52e2e:::benchmark_data_smithi069_31227_object41534:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.880146+0000", 2024-04-26T12:16:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0053781870000000004, 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054350659999999997, 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213191 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880146+0000", 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880146+0000", 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880146+0000", 2024-04-26T12:16:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880149+0000", 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1970000000000001e-06 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880156+0000", 2024-04-26T12:16:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.878e-06 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880160+0000", 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7349999999999998e-06 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881656+0000", 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014965309999999999 2024-04-26T12:16:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881783+0000", 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000126754 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213192 5.b 5:dc770a3e:::benchmark_data_smithi069_31227_object41535:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.880612+0000", 2024-04-26T12:16:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049128449999999999, 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050131610000000004, 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213192 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880612+0000", 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880612+0000", 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880611+0000", 2024-04-26T12:16:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880615+0000", 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0579999999999999e-06 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880623+0000", 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880628+0000", 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880655+0000", 2024-04-26T12:16:18.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7016e-05 2024-04-26T12:16:18.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880758+0000", 2024-04-26T12:16:18.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010278200000000001 2024-04-26T12:16:18.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.880818+0000", 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0061e-05 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885246+0000", 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044275080000000001 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.903 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213194 5.b 5:d4fd2332:::benchmark_data_smithi069_31227_object41537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.881765+0000", 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037600049999999999, 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039066719999999999, 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213194 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881765+0000", 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881765+0000", 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881764+0000", 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881769+0000", 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8450000000000002e-06 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881780+0000", 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1883e-05 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.881787+0000", 2024-04-26T12:16:18.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0520000000000004e-06 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882000+0000", 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021262000000000001 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882105+0000", 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105227 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882163+0000", 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7392999999999998e-05 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885649+0000", 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034860080000000001 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213195 5.9 5:91d42af3:::benchmark_data_smithi069_31227_object41538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.882455+0000", 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0030699780000000001, 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032578239999999999, 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.910 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213195 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882455+0000", 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882455+0000", 2024-04-26T12:16:18.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882454+0000", 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882458+0000", 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1269999999999996e-06 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882468+0000", 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0380000000000001e-05 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882474+0000", 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9730000000000002e-06 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882915+0000", 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00044097599999999999 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883014+0000", 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8876999999999995e-05 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.914 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213198 5.0 5:075aa7eb:::benchmark_data_smithi069_31227_object41541:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.882640+0000", 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028848770000000001, 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003126415, 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213198 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882640+0000", 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882640+0000", 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882639+0000", 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882643+0000", 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6160000000000002e-06 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882652+0000", 2024-04-26T12:16:18.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3409999999999992e-06 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882657+0000", 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1819999999999997e-06 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882680+0000", 2024-04-26T12:16:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3252999999999999e-05 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882779+0000", 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8752999999999995e-05 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882841+0000", 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1807e-05 2024-04-26T12:16:18.920 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:213197 5.a e44/16 5:5edc6abf:::benchmark_data_smithi069_31227_object41540:head v 44'13212, mlcod=44'13209)", 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.882829+0000", 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002695865, 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029868849999999999, 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882829+0000", 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882829+0000", 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882828+0000", 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882834+0000", 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.02e-06 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882842+0000", 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882848+0000", 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6810000000000003e-06 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882884+0000", 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6269999999999997e-05 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.882902+0000", 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8162999999999999e-05 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213199 5.4 5:29d1db41:::benchmark_data_smithi069_31227_object41542:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.883316+0000", 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0022087309999999998, 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025331709999999999, 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.926 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213199 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883316+0000", 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883316+0000", 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883315+0000", 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883320+0000", 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6990000000000002e-06 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883332+0000", 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1902000000000001e-05 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883338+0000", 2024-04-26T12:16:18.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4969999999999998e-06 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883376+0000", 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7920999999999998e-05 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883531+0000", 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015491300000000001 2024-04-26T12:16:18.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883629+0000", 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8129999999999997e-05 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213200 5.f 5:f4439bd2:::benchmark_data_smithi069_31227_object41543:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.931 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.883441+0000", 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020834339999999999, 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002449147, 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213200 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883441+0000", 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883441+0000", 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883441+0000", 2024-04-26T12:16:18.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883444+0000", 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7170000000000002e-06 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883453+0000", 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.2320000000000007e-06 2024-04-26T12:16:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883459+0000", 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4829999999999999e-06 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883502+0000", 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3436000000000002e-05 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.883668+0000", 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016522299999999999 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213201 5.8 5:17af7982:::benchmark_data_smithi069_31227_object41544:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.884009+0000", 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001516033, 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001932146, 2024-04-26T12:16:18.936 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213201 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884009+0000", 2024-04-26T12:16:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884009+0000", 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884008+0000", 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:18.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884013+0000", 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9840000000000001e-06 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884025+0000", 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2534000000000001e-05 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884032+0000", 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5400000000000001e-06 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884419+0000", 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00038728699999999999 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884595+0000", 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017549199999999999 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884689+0000", 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4211999999999999e-05 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.941 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:213205 5.f 5:fa97b93d:::benchmark_data_smithi069_31227_object41548:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.884886+0000", 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00063820700000000001, 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0011145059999999999, 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 213205 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.942 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884886+0000", 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884886+0000", 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884886+0000", 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884890+0000", 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1849999999999997e-06 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884898+0000", 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5480000000000002e-06 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.884903+0000", 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4800000000000003e-06 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885709+0000", 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00080654700000000001 2024-04-26T12:16:18.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885845+0000", 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000135819 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:213207 5.a e44/16 5:59a01f90:::benchmark_data_smithi069_31227_object41550:head v 44'13213, mlcod=44'13210)", 2024-04-26T12:16:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:18.885737+0000", 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997873, 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00029895200000000001, 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885737+0000", 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885737+0000", 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885737+0000", 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885744+0000", 2024-04-26T12:16:18.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1740000000000003e-06 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885755+0000", 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0764000000000001e-05 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885763+0000", 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1519999999999992e-06 2024-04-26T12:16:18.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885797+0000", 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4433e-05 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:18.885817+0000", 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9460999999999999e-05 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.950 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:18.951 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:16:18.951 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:18.952 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:18.951+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:18.953 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:19.053 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:19.051+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:19.097 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:19.097 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:19.097 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:19.097 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:19.097 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:19.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:19.193 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:19.192+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:19.254 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:19.253+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:19.291 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.291 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.654120073999998, 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:19.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.653004906, 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.296 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:19.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.301 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.652732321999999, 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:19.307 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.651465764999998, 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:19.312 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.651258317, 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:19.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:19.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:19.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.650832833000003, 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:19.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:19.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.322 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.650561893000003, 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:19.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:19.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.649487894000004, 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:19.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.9718291020000001, 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:19.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:19.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:19.339 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.9655693239999996, 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:19.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:19.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.9631427400000003, 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:19.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:19.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.350 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.962854954, 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.351 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:19.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.9626239410000004, 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.356 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:19.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:19.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.959849803, 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.362 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:19.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:19.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3787268270000004, 2024-04-26T12:16:19.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:19.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3786329420000003, 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.374 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:19.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:19.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3753159870000005, 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.380 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:19.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:19.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:19.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3740998619999996, 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:19.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:19.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.392 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:19.392 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3740821829999996, 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.393 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:19.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:19.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4.3705034449999998, 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:19.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:19.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:19.404 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:19.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-26T12:16:19.406 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:19.404+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:19.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:19.506 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:19.505+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:215222 5.a e44/16 ondisk, result = 0)", 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.557318+0000", 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00013434800000000001, 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153086, 2024-04-26T12:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557318+0000", 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557318+0000", 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557318+0000", 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557322+0000", 2024-04-26T12:16:19.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7840000000000001e-06 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557330+0000", 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7409999999999998e-06 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557336+0000", 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557371+0000", 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5240000000000001e-05 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557378+0000", 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.515e-06 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:215241 5.e e44/16)", 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.557349+0000", 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00010421600000000001, 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018456899999999999, 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557349+0000", 2024-04-26T12:16:19.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557349+0000", 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557348+0000", 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557353+0000", 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5009999999999998e-06 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557359+0000", 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2489999999999998e-06 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.557364+0000", 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:215214 5.b e44/16 5:d042031a:::benchmark_data_smithi069_31227_object43557:head v 44'13544, mlcod=44'13541)", 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.546405+0000", 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011047479000000001, 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011160115, 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.546405+0000", 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.546405+0000", 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.546405+0000", 2024-04-26T12:16:19.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.546410+0000", 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0239999999999997e-06 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.546420+0000", 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.024e-05 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.546425+0000", 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1569999999999999e-06 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.547378+0000", 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000953209 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.547398+0000", 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9715e-05 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:215216 5.b e44/16 5:d8dc4290:::benchmark_data_smithi069_31227_object43559:head v 44'13545, mlcod=44'13541)", 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.548171+0000", 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0092821870000000008, 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094463310000000005, 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.548171+0000", 2024-04-26T12:16:19.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.548171+0000", 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.548170+0000", 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.548179+0000", 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8850000000000005e-06 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.548189+0000", 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0118e-05 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.548196+0000", 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7159999999999997e-06 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.549440+0000", 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001243844 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.549460+0000", 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0854000000000001e-05 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:215230 5.3 5:c053a4b0:::benchmark_data_smithi069_31227_object43573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.551770+0000", 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0056829289999999998, 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058878699999999999, 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 215230 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551770+0000", 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551770+0000", 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551769+0000", 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551772+0000", 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8439999999999998e-06 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551779+0000", 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8669999999999996e-06 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551784+0000", 2024-04-26T12:16:19.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553020+0000", 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012358060000000001 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553153+0000", 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133366 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:215231 5.3 5:c34b67df:::benchmark_data_smithi069_31227_object43574:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.551866+0000", 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0055870570000000003, 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005860657, 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 215231 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551866+0000", 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551866+0000", 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551861+0000", 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999957 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551870+0000", 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1610000000000003e-06 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551879+0000", 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0860000000000008e-06 2024-04-26T12:16:19.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.551885+0000", 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.302e-06 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.555352+0000", 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034665350000000002 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556513+0000", 2024-04-26T12:16:19.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001161947 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:215233 5.3 5.5b8fa663 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.552012+0000", 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0054403580000000002, 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057608080000000001, 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:19.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 215233 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.552012+0000", 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.552012+0000", 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.552012+0000", 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.552016+0000", 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8709999999999999e-06 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.552023+0000", 2024-04-26T12:16:19.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8089999999999993e-06 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.552030+0000", 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.455e-06 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:215234 5.b e44/16 5:d0f7a2cd:::benchmark_data_smithi069_31227_object43577:head v 44'13546, mlcod=44'13542)", 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.553526+0000", 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039262500000000001, 2024-04-26T12:16:19.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043010710000000001, 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553526+0000", 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553526+0000", 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553526+0000", 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553534+0000", 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6480000000000003e-06 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553542+0000", 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3729999999999993e-06 2024-04-26T12:16:19.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.553547+0000", 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4380000000000003e-06 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.555314+0000", 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017670069999999999 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.555424+0000", 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109852 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:215238 5.6 5:6de1a9cd:::benchmark_data_smithi069_31227_object43581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.554723+0000", 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002729768, 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003168354, 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 215238 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554723+0000", 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554723+0000", 2024-04-26T12:16:19.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554722+0000", 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554727+0000", 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.091e-06 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554736+0000", 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2889999999999998e-06 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554741+0000", 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554783+0000", 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1437000000000003e-05 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.554918+0000", 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013526599999999999 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:215239 5.6 5:66abe564:::benchmark_data_smithi069_31227_object43582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.556239+0000", 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012140390000000001, 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016986270000000001, 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:19.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:19.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:19.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 215239 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556239+0000", 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556239+0000", 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556238+0000", 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556243+0000", 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7049999999999998e-06 2024-04-26T12:16:19.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556252+0000", 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2070000000000001e-06 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556259+0000", 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4370000000000001e-06 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556683+0000", 2024-04-26T12:16:19.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042386399999999998 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556832+0000", 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014867099999999999 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:215240 5.6 5.8246b416 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:19.556268+0000", 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011847089999999999, 2024-04-26T12:16:19.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017084909999999999, 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 215240 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556268+0000", 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556268+0000", 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556268+0000", 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556270+0000", 2024-04-26T12:16:19.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3e-06 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556276+0000", 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5799999999999999e-06 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:19.556280+0000", 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.284e-06 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:19.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:19.604 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:19.605 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 11 2024-04-26T12:16:19.605 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:19.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:19.607 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:19.606+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:19.708 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:19.706+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:19.758 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:19.759 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:19.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:19.809 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:19.807+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:19.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:19.860 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:16:19.911 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:19.908+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:19.961 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:19.962 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:19.962 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:19.962 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:19.963 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:19.974 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:19.980 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:19.981 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:19.984 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:19.984 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:20.015 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:20.014+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:20.108 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:20.108 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:20.111 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:20.110+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:20.120 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:20.214 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:20.213+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:20.299 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:20.299 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:20.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:20.351 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:20.350+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:20.415 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:20.414+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:20.489 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:20.489 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:20.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:20.542 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:20.541+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:20.617 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:20.616+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:20.648 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:20.648 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:20.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:20.718 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:20.717+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:20.819 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:20.818+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:20.853 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:20.853 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:20.855 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:16:20.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:20.920 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:20.919+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.021 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:21.019+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.068 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:21.068 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:21.081 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:21.122 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:21.121+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:21.222 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:21.222 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:21.223 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:21.222+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:21.324 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:21.323+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:21.410 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:21.411 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:21.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:21.425 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:21.424+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:21.526 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:21.525+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.564 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:21.565 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:21.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:21.627 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:21.626+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.728 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:21.727+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.729 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:21.729 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:21.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:21.829 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:21.828+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.891 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:21.891 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:21.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:21.930 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:21.929+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:21.985 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:22.031 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:22.030+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:22.057 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:22.057 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:22.070 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:22.105 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:22.106 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:22.124 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:22.127 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:22.127 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:22.131 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:22.130+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:22.214 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:22.214 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:223016 5.a e45/16 5:5722830c:::benchmark_data_smithi069_31227_object51359:head v 45'13856, mlcod=45'13852)", 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.211429+0000", 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001651614, 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001665787, 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211429+0000", 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211429+0000", 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211428+0000", 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211434+0000", 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9730000000000002e-06 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211443+0000", 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8009999999999993e-06 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211449+0000", 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2700000000000001e-06 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211496+0000", 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6238e-05 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211517+0000", 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0962e-05 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223021 5.8 5.2114c08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.211711+0000", 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001369585, 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001432911, 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223021 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.219 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211711+0000", 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211711+0000", 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211710+0000", 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211715+0000", 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7700000000000001e-06 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211727+0000", 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1678000000000001e-05 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211733+0000", 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2519999999999996e-06 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223009 5.8 5:1f7dd0a3:::benchmark_data_smithi069_31227_object51352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.209065+0000", 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040153599999999999, 2024-04-26T12:16:22.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041128170000000004, 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223009 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209065+0000", 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209065+0000", 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209065+0000", 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209069+0000", 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0169999999999998e-06 2024-04-26T12:16:22.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209078+0000", 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0499999999999997e-06 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209084+0000", 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.421e-06 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209126+0000", 2024-04-26T12:16:22.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2150000000000001e-05 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209266+0000", 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014019299999999999 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209353+0000", 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7027999999999994e-05 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223011 5.8 5:15200d7e:::benchmark_data_smithi069_31227_object51354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.209096+0000", 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039845369999999998, 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041202649999999997, 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223011 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209096+0000", 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209096+0000", 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209095+0000", 2024-04-26T12:16:22.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209099+0000", 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5190000000000001e-06 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209106+0000", 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.277e-06 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209112+0000", 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211361+0000", 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002249095 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211523+0000", 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000162423 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211600+0000", 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6781999999999998e-05 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223013 5.4 5:223698a1:::benchmark_data_smithi069_31227_object51356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.209263+0000", 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003817122, 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039905160000000004, 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.231 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223013 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209263+0000", 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209263+0000", 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209263+0000", 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209267+0000", 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7900000000000001e-06 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209276+0000", 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4460000000000007e-06 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209282+0000", 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0499999999999997e-06 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209324+0000", 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1569000000000001e-05 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209460+0000", 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136496 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209554+0000", 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3768000000000001e-05 2024-04-26T12:16:22.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.212226+0000", 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026725099999999999 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223014 5.b 5:d622f54c:::benchmark_data_smithi069_31227_object51357:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.209334+0000", 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0037470310000000001, 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039703359999999997, 2024-04-26T12:16:22.236 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223014 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209334+0000", 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209334+0000", 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209333+0000", 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209337+0000", 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8999999999999999e-06 2024-04-26T12:16:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209345+0000", 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0490000000000004e-06 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209350+0000", 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3480000000000003e-06 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209377+0000", 2024-04-26T12:16:22.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6347999999999999e-05 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209516+0000", 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013943000000000001 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209619+0000", 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103093 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.212245+0000", 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026263710000000002 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:223010 5.a e45/16 5:5e0e0167:::benchmark_data_smithi069_31227_object51353:head v 45'13855, mlcod=45'13852)", 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.209420+0000", 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0036607269999999999, 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039554890000000004, 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209420+0000", 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209420+0000", 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209419+0000", 2024-04-26T12:16:22.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209424+0000", 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6990000000000002e-06 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209432+0000", 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7379999999999994e-06 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209437+0000", 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8110000000000002e-06 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209472+0000", 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5803000000000003e-05 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209492+0000", 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9579e-05 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.244 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223017 5.d 5:b3be9e77:::benchmark_data_smithi069_31227_object51360:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.209599+0000", 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034817279999999999, 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038209709999999998, 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223017 2024-04-26T12:16:22.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209599+0000", 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209599+0000", 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209598+0000", 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209603+0000", 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3630000000000002e-06 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209620+0000", 2024-04-26T12:16:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6299000000000001e-05 2024-04-26T12:16:22.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209628+0000", 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6629999999999999e-06 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209665+0000", 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6983999999999997e-05 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209830+0000", 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016489900000000001 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223018 5.e 5:7b3dabb3:::benchmark_data_smithi069_31227_object51361:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.209741+0000", 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033400069999999999, 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037395499999999999, 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:22.250 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223018 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209741+0000", 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209741+0000", 2024-04-26T12:16:22.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209740+0000", 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209744+0000", 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0520000000000003e-06 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209753+0000", 2024-04-26T12:16:22.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9190000000000005e-06 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209759+0000", 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4200000000000004e-06 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209809+0000", 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0157000000000001e-05 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.209977+0000", 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016803400000000001 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.210089+0000", 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112073 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.213349+0000", 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032593600000000002 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.254 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:223019 5.f 5:f1472c62:::benchmark_data_smithi069_31227_object51362:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:22.211251+0000", 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001829914, 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023024970000000001, 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 223019 2024-04-26T12:16:22.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211251+0000", 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211251+0000", 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211250+0000", 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211255+0000", 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3140000000000003e-06 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211265+0000", 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0171e-05 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211272+0000", 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6100000000000002e-06 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211374+0000", 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102043 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:22.211506+0000", 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000132156 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.258 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:22.259 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 10 2024-04-26T12:16:22.259 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:22.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:22.261 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:22.259+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:22.360 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:22.359+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:22.443 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:22.443 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:22.443 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:22.443 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:22.443 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:22.454 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:22.501 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:22.497+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:22.562 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:22.561+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:22.602 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.965260890000003, 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:22.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:22.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.964145721999998, 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:22.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.963873137999997, 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.613 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.618 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.962606581000003, 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:22.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.624 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.962399132999998, 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:22.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.629 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.961973649000001, 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.630 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:22.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:22.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.961702709000001, 2024-04-26T12:16:22.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:22.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:22.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.960628710000002, 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.641 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:22.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:22.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.282969917999999, 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.647 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:22.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:22.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.27671014, 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:22.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:22.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:22.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.274283556, 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:22.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:22.663 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.273995770000001, 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:22.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.273764757, 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:22.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 11.270990618999999, 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.675 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:22.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6898676430000004, 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:22.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.686 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6897737580000003, 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:22.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:22.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.690 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.692 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6864568030000004, 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:22.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:22.698 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6852406779999995, 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.699 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:22.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:22.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6852229990000005, 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:22.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:22.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 7.6816442609999998, 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:22.711 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:22.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:22.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:22.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.717 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.717 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:22.717 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:22.717 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:22.718 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:22.717+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:22.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:22.819 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:22.818+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:22.869 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225019 5.7 5:ebf9a694:::benchmark_data_smithi069_31227_object53362:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.875970+0000", 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00075802400000000005, 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000780242, 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225019 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.875970+0000", 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.875970+0000", 2024-04-26T12:16:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.875970+0000", 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.875975+0000", 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.875983+0000", 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1890000000000007e-06 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.875990+0000", 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876039+0000", 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9181999999999998e-05 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876194+0000", 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015487500000000001 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225021 5.a 5:5e0c199a:::benchmark_data_smithi069_31227_object53364:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.876068+0000", 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00066050099999999997, 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074901399999999999, 2024-04-26T12:16:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225021 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876068+0000", 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876068+0000", 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876067+0000", 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876072+0000", 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0490000000000003e-06 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876081+0000", 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2320000000000007e-06 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876088+0000", 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7059999999999998e-06 2024-04-26T12:16:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876113+0000", 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4870000000000001e-05 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876251+0000", 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013778900000000001 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876378+0000", 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012692700000000001 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225022 5.a 5.10119bfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.876191+0000", 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00053760199999999998, 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069060400000000004, 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225022 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876191+0000", 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876191+0000", 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876190+0000", 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876195+0000", 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876205+0000", 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8980000000000008e-06 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876211+0000", 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.144e-06 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:225018 5.e e45/16 5:710afb90:::benchmark_data_smithi069_31227_object53361:head v 45'14125, mlcod=45'14123)", 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.876305+0000", 2024-04-26T12:16:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000423015, 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062441999999999999, 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876305+0000", 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876305+0000", 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876305+0000", 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876319+0000", 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3764000000000001e-05 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876327+0000", 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6000000000000007e-06 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876333+0000", 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7799999999999997e-06 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876605+0000", 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000272086 2024-04-26T12:16:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876621+0000", 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6317e-05 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:225017 5.8 e45/16 5:1a2652df:::benchmark_data_smithi069_31227_object53360:head v 45'14155, mlcod=45'14153)", 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.876349+0000", 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00037895600000000001, 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00063840900000000005, 2024-04-26T12:16:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876349+0000", 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876349+0000", 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876349+0000", 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876353+0000", 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876359+0000", 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876364+0000", 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0359999999999997e-06 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876812+0000", 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044790299999999998 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876828+0000", 2024-04-26T12:16:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6039999999999999e-05 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:225020 5.0 e45/16)", 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.876374+0000", 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00035464600000000002, 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066175999999999995, 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876374+0000", 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876374+0000", 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876373+0000", 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876377+0000", 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1590000000000002e-06 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876383+0000", 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876387+0000", 2024-04-26T12:16:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1869999999999999e-06 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:224991 5.4 e45/16 5:2b744bbd:::benchmark_data_smithi069_31227_object53334:head v 45'13924, mlcod=45'13921)", 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.867936+0000", 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0087919720000000003, 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091419650000000002, 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.867936+0000", 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.867936+0000", 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.867936+0000", 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.867947+0000", 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0812000000000001e-05 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.867956+0000", 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3500000000000003e-06 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.867962+0000", 2024-04-26T12:16:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8889999999999999e-06 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.868009+0000", 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7026e-05 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.868025+0000", 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6393e-05 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225001 5.c 5:331a37e9:::benchmark_data_smithi069_31227_object53344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.869220+0000", 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.007507924, 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079106579999999992, 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225001 2024-04-26T12:16:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869220+0000", 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869220+0000", 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869220+0000", 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869224+0000", 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9389999999999999e-06 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869231+0000", 2024-04-26T12:16:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8229999999999995e-06 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869236+0000", 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872506+0000", 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032700889999999999 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872844+0000", 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000337585 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:224994 5.4 e45/16 5:2a267f78:::benchmark_data_smithi069_31227_object53337:head v 45'13925, mlcod=45'13921)", 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.869377+0000", 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0073518029999999996, 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078140810000000005, 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869377+0000", 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869377+0000", 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869376+0000", 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869382+0000", 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869393+0000", 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0573e-05 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.869398+0000", 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5969999999999999e-06 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870569+0000", 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00117067 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870599+0000", 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9496e-05 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225009 5.c 5:39aaf4c7:::benchmark_data_smithi069_31227_object53352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.870231+0000", 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.006497582, 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070122600000000002, 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225009 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870231+0000", 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870231+0000", 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870230+0000", 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870234+0000", 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870244+0000", 2024-04-26T12:16:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3929999999999997e-06 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.870250+0000", 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874588+0000", 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043380930000000003 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874678+0000", 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9517000000000004e-05 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225010 5.a 5:5e8242c5:::benchmark_data_smithi069_31227_object53353:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.871827+0000", 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0049016959999999997, 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00547482, 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225010 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871827+0000", 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871827+0000", 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871826+0000", 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871831+0000", 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.826e-06 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871839+0000", 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.32e-06 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871845+0000", 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871880+0000", 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4879999999999998e-05 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872023+0000", 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142924 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872132+0000", 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108637 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873859+0000", 2024-04-26T12:16:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017271680000000001 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225011 5.2 5:4ca64f2f:::benchmark_data_smithi069_31227_object53354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.871950+0000", 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0047780899999999996, 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054190330000000002, 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225011 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871950+0000", 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871950+0000", 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871950+0000", 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871953+0000", 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.641e-06 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871963+0000", 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4250000000000004e-06 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.871968+0000", 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873839+0000", 2024-04-26T12:16:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001871375 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874021+0000", 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000181676 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225012 5.c 5:30ed2a78:::benchmark_data_smithi069_31227_object53355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.872125+0000", 2024-04-26T12:16:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0046032299999999998, 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053014220000000001, 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225012 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872125+0000", 2024-04-26T12:16:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872125+0000", 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872125+0000", 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872128+0000", 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872137+0000", 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1849999999999993e-06 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872143+0000", 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6640000000000003e-06 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876189+0000", 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040461710000000003 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876326+0000", 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013734000000000001 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:225014 5.0 e45/16 5:0c49cbea:::benchmark_data_smithi069_31227_object53357:head v 45'14012, mlcod=45'14010)", 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.872781+0000", 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039469550000000003, 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047020569999999999, 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872781+0000", 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872781+0000", 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872781+0000", 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872788+0000", 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659999999999999e-06 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872796+0000", 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1159999999999999e-06 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872801+0000", 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4260000000000002e-06 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872832+0000", 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0979000000000003e-05 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.872849+0000", 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6949e-05 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:225016 5.6 5:606278fa:::benchmark_data_smithi069_31227_object53359:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.873024+0000", 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0037046150000000001, 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045115260000000001, 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 225016 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873024+0000", 2024-04-26T12:16:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873024+0000", 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873023+0000", 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873028+0000", 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6260000000000003e-06 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873037+0000", 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0599999999999997e-06 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.873043+0000", 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5050000000000004e-06 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876035+0000", 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029922450000000001 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.876344+0000", 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030826699999999998 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:225015 5.0 e45/16 5:0a97f995:::benchmark_data_smithi069_31227_object53358:head v 45'14013, mlcod=45'14010)", 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:22.874364+0000", 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002364367, 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032340870000000001, 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874364+0000", 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874364+0000", 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874363+0000", 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874369+0000", 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.356e-06 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874378+0000", 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3249999999999997e-06 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874384+0000", 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2079999999999997e-06 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874900+0000", 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000515575 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:22.874919+0000", 2024-04-26T12:16:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8672e-05 2024-04-26T12:16:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 16 2024-04-26T12:16:22.944 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:22.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:22.946 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:22.944+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:23.046 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:23.045+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:23.134 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:23.135 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:23.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:23.148 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:23.146+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:23.248 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:23.247+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:23.341 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.104026971000003, 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.704971149000002, 2024-04-26T12:16:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.300558058999997, 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.978611152999999, 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.982643114999998, 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.982290553999999, 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.978499643999999, 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.855713601, 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.680873918, 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4288452249999999, 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4286097089999998, 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4274316470000006, 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4268490239999991, 2024-04-26T12:16:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4261240980000007, 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4260891630000003, 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4254208140000006, 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4252028170000006, 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4239529819999994, 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4230757339999993, 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.068864631999999995, 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:23.446 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:23.448 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:23.448 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:23.446+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:23.549 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:23.547+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:227150 5.a e45/16 5:54ad1582:::benchmark_data_smithi069_31227_object55493:head v 45'14107, mlcod=45'14105)", 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.591860+0000", 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00037906600000000001, 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039847100000000001, 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591860+0000", 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591860+0000", 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591860+0000", 2024-04-26T12:16:23.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591864+0000", 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1359999999999999e-06 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591870+0000", 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591873+0000", 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2540000000000001e-06 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591913+0000", 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9879000000000002e-05 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591934+0000", 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0469999999999999e-05 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.598 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227151 5.8 5:190823e2:::benchmark_data_smithi069_31227_object55494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.591887+0000", 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000352617, 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00043430299999999998, 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.599 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227151 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591887+0000", 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591887+0000", 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591886+0000", 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591891+0000", 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2859999999999999e-06 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591901+0000", 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9019999999999994e-06 2024-04-26T12:16:23.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591909+0000", 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3280000000000006e-06 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591941+0000", 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1748999999999997e-05 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592062+0000", 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121025 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592153+0000", 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1137000000000005e-05 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227152 5.4 5.683791a4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.591920+0000", 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00031967399999999999, 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00046719600000000002, 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.604 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227152 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591920+0000", 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591920+0000", 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591919+0000", 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591922+0000", 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591928+0000", 2024-04-26T12:16:23.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0109999999999997e-06 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591933+0000", 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4589999999999997e-06 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:227144 5.8 e45/16)", 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.591959+0000", 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00028019600000000003, 2024-04-26T12:16:23.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00047394700000000001, 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591959+0000", 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591959+0000", 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591958+0000", 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591962+0000", 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9929999999999997e-06 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591976+0000", 2024-04-26T12:16:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3242e-05 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591981+0000", 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4489999999999998e-06 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:227137 5.4 e45/16)", 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.592083+0000", 2024-04-26T12:16:23.610 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00015632999999999999, 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039015799999999999, 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592083+0000", 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592083+0000", 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592082+0000", 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592086+0000", 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5209999999999998e-06 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592095+0000", 2024-04-26T12:16:23.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6959999999999994e-06 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592100+0000", 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0610000000000003e-06 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:227141 5.4 e45/16)", 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.592110+0000", 2024-04-26T12:16:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000129071, 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00040200899999999999, 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592110+0000", 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592110+0000", 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592110+0000", 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592113+0000", 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5940000000000001e-06 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592118+0000", 2024-04-26T12:16:23.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4859999999999997e-06 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592122+0000", 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9419999999999997e-06 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227153 5.8 5.21877808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.616 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.592387+0000", 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9998522, 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016695600000000001, 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227153 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592387+0000", 2024-04-26T12:16:23.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592387+0000", 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592386+0000", 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592390+0000", 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9040000000000002e-06 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592404+0000", 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4229e-05 2024-04-26T12:16:23.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.592411+0000", 2024-04-26T12:16:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1970000000000001e-06 2024-04-26T12:16:23.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227129 5.4 5:2dce1853:::benchmark_data_smithi069_31227_object55472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.584595+0000", 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0076444190000000004, 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0080104949999999994, 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227129 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584595+0000", 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584595+0000", 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584594+0000", 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584599+0000", 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9420000000000003e-06 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584607+0000", 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5750000000000001e-06 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584614+0000", 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.567e-06 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584693+0000", 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9386000000000002e-05 2024-04-26T12:16:23.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584805+0000", 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111871 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584862+0000", 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7156e-05 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.625 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227132 5.b 5:d5b45157:::benchmark_data_smithi069_31227_object55475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.584908+0000", 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0073315259999999997, 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0077650610000000002, 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.626 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227132 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584908+0000", 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584908+0000", 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584907+0000", 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584911+0000", 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.109e-06 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584921+0000", 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3999999999999998e-06 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584926+0000", 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.519e-06 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.584979+0000", 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2803999999999998e-05 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.585180+0000", 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000201382 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.585281+0000", 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100778 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590062+0000", 2024-04-26T12:16:23.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0047811319999999996 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227137 5.4 5:2f5378b1:::benchmark_data_smithi069_31227_object55480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.586389+0000", 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058504730000000001, 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063573019999999996, 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227137 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586389+0000", 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586389+0000", 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586388+0000", 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586392+0000", 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2860000000000001e-06 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586402+0000", 2024-04-26T12:16:23.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9620000000000005e-06 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586408+0000", 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6169999999999998e-06 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586664+0000", 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000256056 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586808+0000", 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014407800000000001 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586909+0000", 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101345 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227138 5.b 5:d0cbb10d:::benchmark_data_smithi069_31227_object55481:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.586629+0000", 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0056099369999999997, 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061838709999999996, 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227138 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586629+0000", 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586629+0000", 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586629+0000", 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586632+0000", 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5599999999999998e-06 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586640+0000", 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6680000000000001e-06 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.586646+0000", 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9719999999999997e-06 2024-04-26T12:16:23.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587269+0000", 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00062334700000000001 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587413+0000", 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014342000000000001 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587512+0000", 2024-04-26T12:16:23.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9568000000000006e-05 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590156+0000", 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002643378 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227140 5.e 5:7d09571b:::benchmark_data_smithi069_31227_object55483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.587470+0000", 2024-04-26T12:16:23.640 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047691369999999997, 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054136899999999996, 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227140 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587470+0000", 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587470+0000", 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587470+0000", 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587473+0000", 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.608e-06 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587480+0000", 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3339999999999998e-06 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587484+0000", 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.053e-06 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587521+0000", 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7061000000000003e-05 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587675+0000", 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015400200000000001 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.587771+0000", 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6253000000000002e-05 2024-04-26T12:16:23.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590570+0000", 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027990250000000001 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227141 5.4 5:2c0395ee:::benchmark_data_smithi069_31227_object55484:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.588387+0000", 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0038519729999999999, 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045680709999999999, 2024-04-26T12:16:23.645 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227141 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588387+0000", 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588387+0000", 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588387+0000", 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588390+0000", 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9679999999999998e-06 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588397+0000", 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8229999999999997e-06 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588400+0000", 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7560000000000001e-06 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588440+0000", 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9449000000000001e-05 2024-04-26T12:16:23.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588603+0000", 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000162867 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588714+0000", 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111184 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227143 5.0 5:023271eb:::benchmark_data_smithi069_31227_object55486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.588911+0000", 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033283539999999999, 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041198520000000002, 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227143 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588911+0000", 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588911+0000", 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588910+0000", 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588915+0000", 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9400000000000001e-06 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588926+0000", 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0536999999999999e-05 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.588932+0000", 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9699999999999996e-06 2024-04-26T12:16:23.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589008+0000", 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6531000000000003e-05 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589168+0000", 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000159977 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589253+0000", 2024-04-26T12:16:23.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5086999999999994e-05 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591816+0000", 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002563077 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227144 5.8 5:107d735c:::benchmark_data_smithi069_31227_object55487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.654 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.589042+0000", 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0031968069999999999, 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040623020000000003, 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227144 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589042+0000", 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589042+0000", 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589042+0000", 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589045+0000", 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.534e-06 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589052+0000", 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0559999999999999e-06 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589057+0000", 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2679999999999996e-06 2024-04-26T12:16:23.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589094+0000", 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7351000000000002e-05 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589202+0000", 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107948 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589300+0000", 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8193e-05 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227146 5.4 5:26bec68f:::benchmark_data_smithi069_31227_object55489:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.589065+0000", 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0031741930000000001, 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0041047799999999997, 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.659 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227146 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589065+0000", 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589065+0000", 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589065+0000", 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589067+0000", 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.362e-06 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589077+0000", 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6949999999999995e-06 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589082+0000", 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4160000000000003e-06 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590032+0000", 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00095039099999999997 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590167+0000", 2024-04-26T12:16:23.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000134917 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590275+0000", 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000107747 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227147 5.f 5:ffbd7545:::benchmark_data_smithi069_31227_object55490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.589477+0000", 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002761969, 2024-04-26T12:16:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0037596159999999999, 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227147 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589477+0000", 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589477+0000", 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589476+0000", 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589481+0000", 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4440000000000001e-06 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589490+0000", 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7770000000000008e-06 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589496+0000", 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0599999999999996e-06 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589539+0000", 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3551999999999999e-05 2024-04-26T12:16:23.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.589709+0000", 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016952699999999999 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227148 5.4 5:2b9c1af7:::benchmark_data_smithi069_31227_object55491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.590219+0000", 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020202990000000001, 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030773290000000002, 2024-04-26T12:16:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227148 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590219+0000", 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590219+0000", 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590218+0000", 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590222+0000", 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7120000000000002e-06 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590229+0000", 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7100000000000001e-06 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590233+0000", 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2420000000000002e-06 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591547+0000", 2024-04-26T12:16:23.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001313886 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591682+0000", 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013558799999999999 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591741+0000", 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8848999999999998e-05 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:227149 5.b 5:d299c945:::benchmark_data_smithi069_31227_object55492:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:23.590875+0000", 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0013638719999999999, 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024868830000000001, 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 227149 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:23.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590875+0000", 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590875+0000", 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590875+0000", 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:23.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590878+0000", 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6569999999999999e-06 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590886+0000", 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2640000000000002e-06 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:23.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590890+0000", 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9580000000000001e-06 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.590916+0000", 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6868000000000001e-05 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591036+0000", 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119405 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.591097+0000", 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1480000000000001e-05 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:23.593315+0000", 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022174320000000001 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:23.676 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:23.677 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 19 2024-04-26T12:16:23.677 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:23.678 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:23.679 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:23.676+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:23.779 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:23.777+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:23.861 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:23.861 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:23.861 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:23.865 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:16:23.873 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:23.879 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:23.878+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:23.980 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:23.978+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:24.012 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:24.012 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.375499343999998, 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.017 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.374384176, 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.018 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:24.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:24.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:24.023 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.374111591999998, 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:24.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:24.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:24.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.029 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.372845034999997, 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.030 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:24.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.372637587, 2024-04-26T12:16:24.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:24.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.372212103000003, 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.041 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:24.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.371941163000002, 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:24.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:24.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 47.370867164000003, 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.052 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:24.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:24.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:24.058 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.693208372000001, 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:24.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:24.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.686948594, 2024-04-26T12:16:24.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:24.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:24.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:24.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:24.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:24.070 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.68452201, 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:24.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:24.076 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.684234224000001, 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.684003211, 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.082 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:24.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.681229073000001, 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.1001060969999994, 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.1000122119999993, 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0966952570000004, 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0954791319999995, 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0954614530000004, 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 9.0918827150000006, 2024-04-26T12:16:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:24.130 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:24.131 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:24.132 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:24.130+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:24.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:24.232 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:24.230+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:24.254 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:24.273 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:24.273 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:24.276 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:24.276 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:24.282 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:24.283 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:24.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:24.333 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:24.332+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:24.434 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:24.432+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:24.487 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:24.487 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:24.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:24.535 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:24.534+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:24.636 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:24.635+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:24.653 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:24.653 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:24.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:24.737 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:24.736+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:24.813 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:24.813 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:24.825 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:24.838 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:24.837+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:24.939 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:24.937+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:24.962 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:24.963 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:24.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:25.040 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:25.038+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:25.140 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:25.139+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:25.161 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:25.161 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:25.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:25.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-26T12:16:25.241 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:25.240+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:25.325 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:25.325 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:25.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:25.342 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:25.340+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:25.443 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:25.441+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:25.493 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:25.494 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:25.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:25.547 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:25.546+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:25.644 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:25.643+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:25.698 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:25.698 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:25.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:25.745 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:25.744+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:25.846 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:25.845+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:25.851 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:25.851 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:25.863 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:25.878 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:16:25.948 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:25.946+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:26.009 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:26.009 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:26.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:26.065 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:26.064+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:26.151 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:26.149+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:26.160 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:26.160 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:26.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:26.252 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:26.251+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:26.278 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:26.327 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:26.327 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:26.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:26.382 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:26.380+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:26.403 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:26.403 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:26.403 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:26.421 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:26.421 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:26.424 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:26.424 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:26.453 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:26.452+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:26.531 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:26.532 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:26.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:26.589 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:26.588+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:26.655 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:26.654+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:26.698 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:26.698 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:26.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.460986464999998, 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:26.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:26.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.061930642999997, 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:26.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:26.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:26.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:26.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.657517552999998, 2024-04-26T12:16:26.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:26.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.335570646999997, 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.339602609000003, 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.339250047999997, 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:26.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:26.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.335459137999997, 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:26.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.212673095, 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:26.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:26.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.037833412000001, 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:26.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:26.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.785804719, 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:26.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:26.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:26.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.785569203, 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:26.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:26.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.784391141, 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:26.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.783808518000001, 2024-04-26T12:16:26.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:26.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.783083592000001, 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:26.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.783048657, 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:26.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:26.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.782380308, 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:26.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.782162311, 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:26.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.780912475999999, 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:26.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.780035227999999, 2024-04-26T12:16:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:26.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:26.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:26.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4258241260000002, 2024-04-26T12:16:26.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:26.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:26.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:26.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:26.800 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:26.802 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:26.802 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:26.800+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:26.869 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:16:26.902 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:26.901+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:237092 5.a e47/16 5:5c37c716:::benchmark_data_smithi069_31227_object65435:head v 47'14733, mlcod=47'14729)", 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.946963+0000", 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021765080000000002, 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021968809999999999, 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946963+0000", 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946963+0000", 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946962+0000", 2024-04-26T12:16:26.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946973+0000", 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0335e-05 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946981+0000", 2024-04-26T12:16:26.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1850000000000004e-06 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946986+0000", 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7200000000000003e-06 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947019+0000", 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947036+0000", 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7141000000000001e-05 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237072 5.8 5:157d2337:::benchmark_data_smithi069_31227_object65415:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.937645+0000", 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.011494706, 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.011581019, 2024-04-26T12:16:26.955 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237072 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.937645+0000", 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.937645+0000", 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.937644+0000", 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.937649+0000", 2024-04-26T12:16:26.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.22e-06 2024-04-26T12:16:26.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.937659+0000", 2024-04-26T12:16:26.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8090000000000004e-06 2024-04-26T12:16:26.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.937665+0000", 2024-04-26T12:16:26.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4779999999999996e-06 2024-04-26T12:16:26.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.941661+0000", 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003995223 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.941800+0000", 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000139822 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:26.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.941894+0000", 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3301999999999995e-05 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945740+0000", 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038461929999999999 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237100 5.e 5:70868cb4:::benchmark_data_smithi069_31227_object65443:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.961 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.947978+0000", 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001160849, 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013273250000000001, 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237100 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947978+0000", 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947978+0000", 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947978+0000", 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947983+0000", 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1370000000000001e-06 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947995+0000", 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2448e-05 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948002+0000", 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7519999999999999e-06 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948892+0000", 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00088977100000000003 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949011+0000", 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118965 2024-04-26T12:16:26.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949079+0000", 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8300000000000007e-05 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:237096 5.a e47/16 5:50408483:::benchmark_data_smithi069_31227_object65439:head v 47'14734, mlcod=47'14729)", 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.948523+0000", 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00061605199999999996, 2024-04-26T12:16:26.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00085036900000000002, 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948523+0000", 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948523+0000", 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948523+0000", 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948527+0000", 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.963e-06 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948536+0000", 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5619999999999993e-06 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948541+0000", 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7790000000000003e-06 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948566+0000", 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5236999999999999e-05 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.948578+0000", 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1430999999999999e-05 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:237093 5.e e47/16)", 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.949140+0000", 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.999999, 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000287714, 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.970 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949140+0000", 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949140+0000", 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949140+0000", 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949143+0000", 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.146e-06 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949151+0000", 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4290000000000001e-06 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949156+0000", 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7849999999999999e-06 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237077 5.0 5:0574588f:::benchmark_data_smithi069_31227_object65420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.940367+0000", 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0087723190000000006, 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091097820000000003, 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.973 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237077 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940367+0000", 2024-04-26T12:16:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940367+0000", 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940366+0000", 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940376+0000", 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.91e-06 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940385+0000", 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940393+0000", 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4479999999999997e-06 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943572+0000", 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003179585 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943674+0000", 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101402 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943777+0000", 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103113 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949214+0000", 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054369179999999998 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237079 5.0 5:067c54fb:::benchmark_data_smithi069_31227_object65422:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.940426+0000", 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00871305, 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0091244299999999993, 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237079 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940426+0000", 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940426+0000", 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940426+0000", 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940428+0000", 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7219999999999999e-06 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940435+0000", 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6989999999999997e-06 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.940440+0000", 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945803+0000", 2024-04-26T12:16:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053632640000000004 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945988+0000", 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018507800000000001 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946093+0000", 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104746 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.983 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237088 5.0 5:05818979:::benchmark_data_smithi069_31227_object65431:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.943824+0000", 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0053152779999999997, 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058029379999999997, 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237088 2024-04-26T12:16:26.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943824+0000", 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943824+0000", 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943823+0000", 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943828+0000", 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7140000000000001e-06 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943838+0000", 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0149999999999999e-05 2024-04-26T12:16:26.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943845+0000", 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8199999999999999e-06 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947465+0000", 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003619747 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947614+0000", 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000149491 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947718+0000", 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010388899999999999 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237089 5.0 5:0b5b11a4:::benchmark_data_smithi069_31227_object65432:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.988 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.943851+0000", 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052884580000000002, 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058322089999999997, 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237089 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943851+0000", 2024-04-26T12:16:26.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943851+0000", 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943850+0000", 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943853+0000", 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943858+0000", 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4729999999999999e-06 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.943863+0000", 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5560000000000001e-06 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949247+0000", 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053844130000000002 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949396+0000", 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000148863 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.949506+0000", 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110166 2024-04-26T12:16:26.992 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237091 5.0 5.1fe20120 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.945160+0000", 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039796689999999999, 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045600390000000001, 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.993 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237091 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945160+0000", 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945160+0000", 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945159+0000", 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945164+0000", 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945173+0000", 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9260000000000006e-06 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945179+0000", 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.686e-06 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237093 5.e 5:7084e268:::benchmark_data_smithi069_31227_object65436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.945240+0000", 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0038990689999999998, 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045076780000000002, 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:26.996 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237093 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945240+0000", 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945240+0000", 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945239+0000", 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945244+0000", 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3340000000000003e-06 2024-04-26T12:16:26.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945252+0000", 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4589999999999998e-06 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945259+0000", 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4030000000000004e-06 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:26.999 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945300+0000", 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1121999999999997e-05 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945482+0000", 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000181953 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.945578+0000", 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6238999999999998e-05 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.000 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:237097 5.e 5:77888fce:::benchmark_data_smithi069_31227_object65440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:26.946692+0000", 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002446906, 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030919239999999998, 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.001 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 237097 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946692+0000", 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946692+0000", 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946692+0000", 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946697+0000", 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.04e-06 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946709+0000", 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:16:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.946715+0000", 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5479999999999998e-06 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947205+0000", 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00048983000000000002 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947304+0000", 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9528e-05 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:26.947365+0000", 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0204000000000002e-05 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:16:27.006 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:27.007 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:27.008 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:27.005+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:27.108 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:27.107+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:27.190 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:27.190 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:27.190 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:27.190 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:27.190 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:27.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:27.208 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:27.207+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:27.310 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:27.308+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:27.392 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:27.392 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:27.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.756199395000003, 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:27.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:27.397 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.755084226999998, 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:27.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:27.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:27.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.402 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.754811642999996, 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.403 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:27.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:27.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:27.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.753545086000003, 2024-04-26T12:16:27.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.753337637999998, 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.752912154000001, 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.752641214000001, 2024-04-26T12:16:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.751567215000001, 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.073908422999999, 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.067648644999998, 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.065222061, 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:27.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.064934274999999, 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:27.459 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:27.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.064703261999998, 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:27.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 16.061929123999999, 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.471 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:27.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:27.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.480806147999999, 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.477 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:27.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.480712262999999, 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.483 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:27.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:27.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.489 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.477395308, 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:27.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:27.496 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.476179182999999, 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:27.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:27.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.476161504, 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:27.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:27.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 12.472582766, 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:27.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:27.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:27.514 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:27.516 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:27.514+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:27.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:27.618 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:27.617+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:27.669 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:239267 5.6 5:60efbb02:::benchmark_data_smithi069_31227_object67610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.663313+0000", 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0042935400000000002, 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043249439999999998, 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239267 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663313+0000", 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663313+0000", 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663312+0000", 2024-04-26T12:16:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663317+0000", 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4259999999999996e-06 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663324+0000", 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7740000000000004e-06 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663330+0000", 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9410000000000004e-06 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663405+0000", 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4523999999999993e-05 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663546+0000", 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014093600000000001 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:239268 5.4 e47/16 5:2fd034ce:::benchmark_data_smithi069_31227_object67611:head v 47'14854, mlcod=47'14852)", 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.663707+0000", 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038992380000000002, 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040050709999999998, 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663707+0000", 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663707+0000", 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663707+0000", 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663712+0000", 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663724+0000", 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2729e-05 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663730+0000", 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8760000000000002e-06 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663800+0000", 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9362000000000004e-05 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663816+0000", 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6538999999999999e-05 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:239270 5.b e47/16 5:d898c5c2:::benchmark_data_smithi069_31227_object67613:head v 47'14999, mlcod=47'14997)", 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.663745+0000", 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038618680000000001, 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004000974, 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663745+0000", 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663745+0000", 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663744+0000", 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663748+0000", 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.349e-06 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663753+0000", 2024-04-26T12:16:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.663757+0000", 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0160000000000002e-06 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.664322+0000", 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056477899999999995 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.664338+0000", 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5464999999999998e-05 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:239272 5.1 5:80992d01:::benchmark_data_smithi069_31227_object67615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.665196+0000", 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0024099080000000001, 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025805630000000001, 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239272 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665196+0000", 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665196+0000", 2024-04-26T12:16:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665196+0000", 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665200+0000", 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665209+0000", 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8219999999999996e-06 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665216+0000", 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6930000000000001e-06 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665259+0000", 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3569000000000002e-05 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665467+0000", 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020807000000000001 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:239277 5.7 5:e379a25e:::benchmark_data_smithi069_31227_object67620:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.665379+0000", 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022274880000000001, 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002458404, 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239277 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665379+0000", 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665379+0000", 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665378+0000", 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665382+0000", 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9899999999999999e-06 2024-04-26T12:16:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665390+0000", 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8879999999999997e-06 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665396+0000", 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.088e-06 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665438+0000", 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1573999999999999e-05 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665578+0000", 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004299999999999 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:239279 5.a 5:54dceb81:::benchmark_data_smithi069_31227_object67622:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.665435+0000", 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0021711830000000001, 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024684199999999998, 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239279 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665435+0000", 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665435+0000", 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665434+0000", 2024-04-26T12:16:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665438+0000", 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9879999999999998e-06 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665446+0000", 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5739999999999998e-06 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665452+0000", 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665515+0000", 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3314999999999999e-05 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665667+0000", 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015163399999999999 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665770+0000", 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102602 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:239281 5.c 5:359cc61e:::benchmark_data_smithi069_31227_object67624:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.665543+0000", 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0020632850000000002, 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002430598, 2024-04-26T12:16:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239281 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665543+0000", 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665543+0000", 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665542+0000", 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665546+0000", 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4520000000000002e-06 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665553+0000", 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2570000000000001e-06 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665559+0000", 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6060000000000002e-06 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665599+0000", 2024-04-26T12:16:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0537000000000002e-05 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665766+0000", 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016708000000000001 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:239273 5.4 e47/16 5:2d794d7f:::benchmark_data_smithi069_31227_object67616:head v 47'14855, mlcod=47'14852)", 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.665619+0000", 2024-04-26T12:16:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019874440000000001, 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024161009999999999, 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665619+0000", 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665619+0000", 2024-04-26T12:16:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665618+0000", 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665624+0000", 2024-04-26T12:16:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6960000000000002e-06 2024-04-26T12:16:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665633+0000", 2024-04-26T12:16:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000001e-06 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665639+0000", 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665951+0000", 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031208499999999998 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665962+0000", 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0808000000000001e-05 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:239271 5.e e47/16 5:72f20a94:::benchmark_data_smithi069_31227_object67614:head v 47'14996, mlcod=47'14994)", 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.665683+0000", 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001922902, 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024034479999999999, 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665683+0000", 2024-04-26T12:16:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665683+0000", 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665683+0000", 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665687+0000", 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000002e-06 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665694+0000", 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7179999999999999e-06 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665699+0000", 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9620000000000001e-06 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665730+0000", 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0982999999999998e-05 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665746+0000", 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6087999999999999e-05 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:239280 5.b e47/16 5:de036c04:::benchmark_data_smithi069_31227_object67623:head v 47'15000, mlcod=47'14997)", 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.665856+0000", 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0017507740000000001, 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022831010000000001, 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665856+0000", 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665856+0000", 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665855+0000", 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665863+0000", 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1960000000000008e-06 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665870+0000", 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1389999999999998e-06 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.665875+0000", 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7899999999999999e-06 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.666279+0000", 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040414200000000002 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.666295+0000", 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5427999999999999e-05 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:239278 5.4 e47/16 5:239bd562:::benchmark_data_smithi069_31227_object67621:head v 47'14856, mlcod=47'14852)", 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.667161+0000", 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000445573, 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010308299999999999, 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667161+0000", 2024-04-26T12:16:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667161+0000", 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667160+0000", 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667167+0000", 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667176+0000", 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9930000000000001e-06 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667182+0000", 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4299999999999997e-06 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667808+0000", 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062592300000000002 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667827+0000", 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8978999999999999e-05 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:239275 5.e e47/16 5:729f3780:::benchmark_data_smithi069_31227_object67618:head v 47'14997, mlcod=47'14994)", 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.667586+0000", 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.0767999999999998e-05, 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065853999999999999, 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667586+0000", 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667586+0000", 2024-04-26T12:16:27.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667585+0000", 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667591+0000", 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9359999999999996e-06 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667599+0000", 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2039999999999997e-06 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667604+0000", 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667725+0000", 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012091000000000001 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667753+0000", 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8462e-05 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:239282 5.2 5:4a12290d:::benchmark_data_smithi069_31227_object67625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.667987+0000", 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.999619, 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031115400000000001, 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239282 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667987+0000", 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667987+0000", 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667987+0000", 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.667992+0000", 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2129999999999999e-06 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668006+0000", 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.394e-05 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668013+0000", 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8260000000000004e-06 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668058+0000", 2024-04-26T12:16:27.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5558e-05 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:239283 5.a 5:53202c63:::benchmark_data_smithi069_31227_object67626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:27.668269+0000", 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9993367, 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6954999999999997e-05, 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:27.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239283 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668269+0000", 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668269+0000", 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668269+0000", 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668273+0000", 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5210000000000004e-06 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668287+0000", 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3709999999999999e-05 2024-04-26T12:16:27.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668293+0000", 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:27.668326+0000", 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2777999999999997e-05 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 14 2024-04-26T12:16:27.727 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:27.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:27.729 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:27.726+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:27.829 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:27.828+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:27.920 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:27.920 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:27.920 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:27.920 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:27.920 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:27.930 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:27.928+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:27.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:28.031 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:28.029+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.880702159000002, 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.481646337000001, 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.077233247000002, 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.755286341000001, 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.759318303000001, 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.758965742000001, 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.755174832000002, 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.632388789, 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.457549105999998, 2024-04-26T12:16:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.205520413, 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.205284897, 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.204106834999999, 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.203524212, 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:28.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:28.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.202799285999999, 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:28.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.202764351000001, 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.202096001999999, 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.201878004999999, 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.20062817, 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.199750922, 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8455398199999999, 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:28.220 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:28.221 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:28.222 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:28.219+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:28.322 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:28.321+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241237 5.b 5:d528713c:::benchmark_data_smithi069_31227_object69580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.357840+0000", 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0065982200000000001, 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006614104, 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241237 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.357840+0000", 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.357840+0000", 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.357837+0000", 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999976 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.357843+0000", 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3890000000000004e-06 2024-04-26T12:16:28.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.357850+0000", 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1019999999999999e-06 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.357854+0000", 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1849999999999997e-06 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360371+0000", 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025166139999999999 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360476+0000", 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105059 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360563+0000", 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7795999999999998e-05 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363873+0000", 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003309827 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241244 5.e 5:73cb5dea:::benchmark_data_smithi069_31227_object69587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.358274+0000", 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061641899999999999, 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006227893, 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241244 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.358274+0000", 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.358274+0000", 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.358273+0000", 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.358277+0000", 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9550000000000002e-06 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.358286+0000", 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1989999999999995e-06 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.358292+0000", 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7440000000000004e-06 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359941+0000", 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016496550000000001 2024-04-26T12:16:28.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360133+0000", 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019190200000000001 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360221+0000", 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7398999999999994e-05 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363892+0000", 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003671138 2024-04-26T12:16:28.375 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:241236 5.a e47/16 5:5de00640:::benchmark_data_smithi069_31227_object69579:head v 47'15003, mlcod=47'14999)", 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.359712+0000", 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047253130000000001, 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048304919999999996, 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359712+0000", 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359712+0000", 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359712+0000", 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359720+0000", 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0639999999999994e-06 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359731+0000", 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.081e-05 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359736+0000", 2024-04-26T12:16:28.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6879999999999996e-06 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359774+0000", 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7486e-05 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.359794+0000", 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9874999999999999e-05 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.379 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241245 5.0 5:0d1cf085:::benchmark_data_smithi069_31227_object69588:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.360583+0000", 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0038546990000000001, 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039911970000000001, 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241245 2024-04-26T12:16:28.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360583+0000", 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360583+0000", 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360582+0000", 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360588+0000", 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0639999999999999e-06 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360597+0000", 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360604+0000", 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0559999999999999e-06 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360666+0000", 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2513000000000003e-05 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360809+0000", 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014223799999999999 2024-04-26T12:16:28.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.360912+0000", 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103386 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364108+0000", 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031958080000000001 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241247 5.e 5:7f097701:::benchmark_data_smithi069_31227_object69590:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.361366+0000", 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003071626, 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032491349999999998, 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241247 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361366+0000", 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361366+0000", 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361365+0000", 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361369+0000", 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9009999999999996e-06 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361377+0000", 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0260000000000007e-06 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361382+0000", 2024-04-26T12:16:28.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361547+0000", 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016469799999999999 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361649+0000", 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102018 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:28.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361708+0000", 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8566999999999997e-05 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:241246 5.a e47/16 5:574daf15:::benchmark_data_smithi069_31227_object69589:head v 47'15004, mlcod=47'15000)", 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.361559+0000", 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028792240000000001, 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030929310000000002, 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361559+0000", 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361559+0000", 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361558+0000", 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361562+0000", 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5650000000000002e-06 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361567+0000", 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9350000000000002e-06 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361570+0000", 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1389999999999999e-06 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361595+0000", 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5357000000000001e-05 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.361606+0000", 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0772e-05 2024-04-26T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241249 5.e 5:7e07b557:::benchmark_data_smithi069_31227_object69592:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.363833+0000", 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00060507699999999998, 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00084941300000000003, 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241249 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363833+0000", 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363833+0000", 2024-04-26T12:16:28.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363832+0000", 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363836+0000", 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9079999999999997e-06 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363844+0000", 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6690000000000006e-06 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363850+0000", 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5849999999999996e-06 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363911+0000", 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0427999999999998e-05 2024-04-26T12:16:28.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364032+0000", 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120887 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364102+0000", 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0617000000000005e-05 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241252 5.4 5:2cbb84b1:::benchmark_data_smithi069_31227_object69595:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.363892+0000", 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00054577399999999996, 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00082874800000000003, 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241252 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.398 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363892+0000", 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363892+0000", 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363892+0000", 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363894+0000", 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363899+0000", 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5970000000000002e-06 2024-04-26T12:16:28.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363902+0000", 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3670000000000001e-06 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363931+0000", 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9215000000000001e-05 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364085+0000", 2024-04-26T12:16:28.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015368399999999999 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364196+0000", 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011112000000000001 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241253 5.d 5:bb398f00:::benchmark_data_smithi069_31227_object69596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.363909+0000", 2024-04-26T12:16:28.402 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00052881499999999997, 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00084813, 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241253 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363909+0000", 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363909+0000", 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363909+0000", 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363910+0000", 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.497e-06 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363913+0000", 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.163e-06 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363916+0000", 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.965e-06 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363948+0000", 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2141999999999998e-05 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364087+0000", 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013833199999999999 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.406 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241254 5.4 5.33edd754 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.363921+0000", 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00051637700000000005, 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00086731099999999995, 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241254 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363921+0000", 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363921+0000", 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363921+0000", 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363923+0000", 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.477e-06 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363927+0000", 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.363931+0000", 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2289999999999997e-06 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.409 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:241250 5.a e47/16 5:521e9c9c:::benchmark_data_smithi069_31227_object69593:head v 47'15005, mlcod=47'15001)", 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.364256+0000", 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000181304, 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00055963599999999997, 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364256+0000", 2024-04-26T12:16:28.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364256+0000", 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364256+0000", 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364260+0000", 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6040000000000001e-06 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364265+0000", 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4260000000000002e-06 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364268+0000", 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3349999999999998e-06 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364301+0000", 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2642999999999999e-05 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364318+0000", 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7218e-05 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:241256 5.4 5.3e2b2c94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:16:28.413 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:28.364348+0000", 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.9692999999999997e-05, 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00049668599999999998, 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 241256 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364348+0000", 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364348+0000", 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364347+0000", 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:28.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364353+0000", 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3750000000000002e-06 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364364+0000", 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1251e-05 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:28.364370+0000", 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:28.417 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:28.417 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:16:28.417 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:28.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:28.423 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:28.422+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:28.425 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:28.524 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:28.522+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:28.546 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:28.566 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:28.567 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:28.569 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:28.570 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:28.603 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:28.603 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:28.617 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:28.657 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:28.656+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:28.726 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:28.725+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:28.797 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:28.797 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:28.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:28.827 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:28.826+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:28.883 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:16:28.928 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:28.927+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:28.959 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:28.959 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:28.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:29.028 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:29.027+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:29.128 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:29.128 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:29.129 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:29.128+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:29.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:29.230 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:29.229+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:29.329 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:29.330 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:29.331 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:29.329+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:29.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:29.431 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:29.430+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:29.486 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:29.486 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:29.497 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:29.532 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:29.531+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:29.633 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:29.631+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:29.635 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:29.635 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:29.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:29.734 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:29.733+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:29.827 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:29.834 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:29.833+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:29.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:29.878 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:16:29.936 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:29.934+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:29.993 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:29.993 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:30.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:30.043 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:30.042+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:30.138 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:30.137+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:30.194 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:30.194 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:30.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:30.239 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:30.238+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:30.340 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:30.339+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:30.357 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:30.357 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:30.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:30.441 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:30.440+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:30.512 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:30.513 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:30.525 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:30.542 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:30.541+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:30.571 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:30.643 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:30.642+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:30.694 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:30.695 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:30.695 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:30.706 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:30.707 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:30.714 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:30.715 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:30.717 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:30.718 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:30.720 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:30.744 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:30.743+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:30.845 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:30.844+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:30.863 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:30.863 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:30.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.226231466999998, 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:30.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:30.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.225116299, 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:30.868 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:30.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.224843714999999, 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:30.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.223577157999998, 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:30.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.884 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.22336971, 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.885 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:30.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:30.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:30.889 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.222944226000003, 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.890 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:30.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:30.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.222673286000003, 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.895 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.221599286999997, 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.900 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:30.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:30.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.543940495000001, 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.906 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:30.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.537680717000001, 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.535254132999999, 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.916 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.534966347000001, 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.922 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.534735334000001, 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:30.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:30.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:30.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 19.531961196000001, 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:30.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.938 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.95083822, 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:30.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:30.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:30.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.950744335, 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:30.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:30.950 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.947427380000001, 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:30.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:30.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:30.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.946211255, 2024-04-26T12:16:30.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:30.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.946193576000001, 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.962 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:30.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 15.942614838000001, 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:30.968 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:30.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:30.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:30.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:30.974 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:30.974 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:30.975 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:30.974+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:30.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:31.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-26T12:16:31.076 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:31.075+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:31.131 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:31.131 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:31.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249387 5.0 e48/16 5:0b7dfa89:::benchmark_data_smithi069_31227_object77730:head v 48'15543, mlcod=48'15538)", 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.126892+0000", 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027605110000000002, 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00278261, 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126892+0000", 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126892+0000", 2024-04-26T12:16:31.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126892+0000", 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126897+0000", 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.04e-06 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126906+0000", 2024-04-26T12:16:31.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7629999999999995e-06 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126913+0000", 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.229e-06 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129403+0000", 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002490052 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129420+0000", 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7509000000000001e-05 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:249390 5.7 5:ece4b202:::benchmark_data_smithi069_31227_object77733:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.127625+0000", 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0020273040000000002, 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021168929999999999, 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 249390 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127625+0000", 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127625+0000", 2024-04-26T12:16:31.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127624+0000", 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127629+0000", 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127639+0000", 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127645+0000", 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127682+0000", 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6829000000000003e-05 2024-04-26T12:16:31.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127836+0000", 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015449800000000001 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:249392 5.3 5:cad87e62:::benchmark_data_smithi069_31227_object77735:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.128156+0000", 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014965359999999999, 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016548680000000001, 2024-04-26T12:16:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 249392 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128156+0000", 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128156+0000", 2024-04-26T12:16:31.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128155+0000", 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128160+0000", 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128169+0000", 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9160000000000007e-06 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128175+0000", 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9039999999999997e-06 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128216+0000", 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0373999999999997e-05 2024-04-26T12:16:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128351+0000", 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135835 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249389 5.8 e48/16 5:101d3606:::benchmark_data_smithi069_31227_object77732:head v 48'15663, mlcod=48'15660)", 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.128191+0000", 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014612570000000001, 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016833110000000001, 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128191+0000", 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128191+0000", 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128191+0000", 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128197+0000", 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128207+0000", 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8919999999999995e-06 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128213+0000", 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1290000000000001e-06 2024-04-26T12:16:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129388+0000", 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001175291 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129405+0000", 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6558999999999998e-05 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:249396 5.5 5:a2dd4705:::benchmark_data_smithi069_31227_object77739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.129421+0000", 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00023126200000000001, 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051376500000000001, 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 249396 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129421+0000", 2024-04-26T12:16:31.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129421+0000", 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129421+0000", 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129425+0000", 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6600000000000003e-06 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129435+0000", 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129442+0000", 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129490+0000", 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8791000000000001e-05 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129646+0000", 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155308 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249394 5.e e48/16 5:748d5c50:::benchmark_data_smithi069_31227_object77737:head v 48'15656, mlcod=48'15654)", 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.129646+0000", 2024-04-26T12:16:31.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.5100000000000004e-06, 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035695099999999999, 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129646+0000", 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129646+0000", 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129646+0000", 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129651+0000", 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4600000000000002e-06 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129659+0000", 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3219999999999993e-06 2024-04-26T12:16:31.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129664+0000", 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129697+0000", 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2861999999999998e-05 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129715+0000", 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7492000000000001e-05 2024-04-26T12:16:31.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249395 5.b e48/16 5:de78c3c6:::benchmark_data_smithi069_31227_object77738:head v 48'15650, mlcod=48'15647)", 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.129684+0000", 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999685, 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000376459, 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129684+0000", 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129684+0000", 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129684+0000", 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129688+0000", 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6880000000000001e-06 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129694+0000", 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.105e-06 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129698+0000", 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5279999999999997e-06 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129739+0000", 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0501999999999999e-05 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129756+0000", 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7107000000000001e-05 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249391 5.8 e48/16)", 2024-04-26T12:16:31.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.129829+0000", 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998231, 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028564200000000001, 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129829+0000", 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129829+0000", 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129829+0000", 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129835+0000", 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3910000000000003e-06 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129844+0000", 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0399999999999998e-06 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.129850+0000", 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0510000000000002e-06 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:249383 5.a 5:54e6e1cf:::benchmark_data_smithi069_31227_object77726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.124160+0000", 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0054922929999999997, 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006003357, 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 249383 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124160+0000", 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124160+0000", 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124160+0000", 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124163+0000", 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6569999999999999e-06 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124172+0000", 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8629999999999997e-06 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124178+0000", 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3470000000000004e-06 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126214+0000", 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002035261 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126396+0000", 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018215700000000001 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.126500+0000", 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104089 2024-04-26T12:16:31.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.128049+0000", 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015491210000000001 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249378 5.0 e48/16 5:07bde7c9:::benchmark_data_smithi069_31227_object77721:head v 48'15541, mlcod=48'15538)", 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.124216+0000", 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0054365000000000004, 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060236760000000004, 2024-04-26T12:16:31.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124216+0000", 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124216+0000", 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124216+0000", 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124224+0000", 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7509999999999997e-06 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124231+0000", 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3269999999999997e-06 2024-04-26T12:16:31.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124235+0000", 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1409999999999998e-06 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124267+0000", 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2326999999999997e-05 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124285+0000", 2024-04-26T12:16:31.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249377 5.8 e48/16 5:1653c855:::benchmark_data_smithi069_31227_object77720:head v 48'15662, mlcod=48'15659)", 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.124242+0000", 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0054105580000000002, 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060553209999999998, 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124242+0000", 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124242+0000", 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124242+0000", 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124245+0000", 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3799999999999998e-06 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124250+0000", 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1429999999999997e-06 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124254+0000", 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3170000000000002e-06 2024-04-26T12:16:31.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124288+0000", 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4214999999999997e-05 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.124298+0000", 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0608000000000001e-05 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:249382 5.0 e48/16 5:017c552d:::benchmark_data_smithi069_31227_object77725:head v 48'15542, mlcod=48'15538)", 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:31.125653+0000", 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039999889999999998, 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047028970000000002, 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.125653+0000", 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.125653+0000", 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.125652+0000", 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.125657+0000", 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5349999999999998e-06 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.125665+0000", 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4400000000000005e-06 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.125669+0000", 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3440000000000003e-06 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127409+0000", 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739169 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:31.127425+0000", 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6878e-05 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 12 2024-04-26T12:16:31.176 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:31.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:31.178 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:31.176+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:31.278 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:31.277+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:31.373 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:31.373 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:31.373 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:31.379 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:31.378+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:31.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:31.480 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:31.478+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.338928952000003, 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.939873130000002, 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:31.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:31.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:31.587 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.535460039999997, 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:31.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.592 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.213513134000003, 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:31.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:31.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.217545096000002, 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:31.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:31.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.217192535000002, 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.603 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:31.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.213401625000003, 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.090615582000002, 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:31.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.915775899, 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:31.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:31.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.663747206, 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:31.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.66351169, 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.662333627999999, 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.661751004999999, 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.661026078999999, 2024-04-26T12:16:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.660991144, 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.660322794999999, 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.660104797999999, 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.658854963, 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.657977715000001, 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.3037666130000005, 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:31.679 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:31.679 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:31.677+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:31.779 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:31.778+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:31.817 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251374 5.d 5:b6d5f445:::benchmark_data_smithi069_31227_object79717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.808499+0000", 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0072793340000000002, 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072975050000000001, 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251374 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808499+0000", 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808499+0000", 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808499+0000", 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808501+0000", 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7349999999999999e-06 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808505+0000", 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0090000000000001e-06 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808508+0000", 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9660000000000001e-06 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.810818+0000", 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023105510000000001 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.810974+0000", 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015614200000000001 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251375 5.d 5:b02ff16b:::benchmark_data_smithi069_31227_object79718:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.808510+0000", 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0072685140000000002, 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.007339028, 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251375 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808510+0000", 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808510+0000", 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808510+0000", 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808511+0000", 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3179999999999999e-06 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808514+0000", 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.14e-06 2024-04-26T12:16:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.808517+0000", 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5730000000000002e-06 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.812368+0000", 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038506830000000001 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.812522+0000", 2024-04-26T12:16:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015459 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251381 5.4 5:2bb69aba:::benchmark_data_smithi069_31227_object79724:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.811071+0000", 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047075930000000004, 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048200739999999997, 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251381 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811071+0000", 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811071+0000", 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811070+0000", 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811075+0000", 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2590000000000002e-06 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811083+0000", 2024-04-26T12:16:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1820000000000006e-06 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811087+0000", 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7639999999999996e-06 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811125+0000", 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7079999999999997e-05 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811285+0000", 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016089500000000001 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811397+0000", 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000111383 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813493+0000", 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002095679 2024-04-26T12:16:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251382 5.e 5:72b36f3a:::benchmark_data_smithi069_31227_object79725:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.811094+0000", 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046843020000000004, 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048484599999999997, 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251382 2024-04-26T12:16:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811094+0000", 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811094+0000", 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811094+0000", 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811096+0000", 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6750000000000001e-06 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811101+0000", 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.626e-06 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811107+0000", 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811147+0000", 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9233000000000002e-05 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811328+0000", 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018123600000000001 2024-04-26T12:16:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.812355+0000", 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010270069999999999 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251383 5.9 5:980d8478:::benchmark_data_smithi069_31227_object79726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.811116+0000", 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0046622549999999997, 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048737659999999999, 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251383 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811116+0000", 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811116+0000", 2024-04-26T12:16:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811116+0000", 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811118+0000", 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4169999999999999e-06 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811123+0000", 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:16:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811127+0000", 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1130000000000001e-06 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811169+0000", 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2441000000000002e-05 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811361+0000", 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000191528 2024-04-26T12:16:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251384 5.d 5:bcc458f2:::benchmark_data_smithi069_31227_object79727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.811133+0000", 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004645733, 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048990570000000001, 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251384 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811133+0000", 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811133+0000", 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811133+0000", 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811134+0000", 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5379999999999999e-06 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811138+0000", 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811140+0000", 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.814124+0000", 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029839710000000002 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.814295+0000", 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017095599999999999 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251385 5.b 5:dd534498:::benchmark_data_smithi069_31227_object79728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.811230+0000", 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0045485960000000002, 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048497779999999999, 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251385 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811230+0000", 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811230+0000", 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811229+0000", 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811234+0000", 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1039999999999998e-06 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811243+0000", 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.9900000000000003e-06 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811255+0000", 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1241e-05 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811293+0000", 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8884999999999998e-05 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811445+0000", 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015113099999999999 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.811542+0000", 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7744999999999993e-05 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.814066+0000", 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025238499999999998 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251388 5.9 5:9d095517:::benchmark_data_smithi069_31227_object79731:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.813795+0000", 2024-04-26T12:16:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019836400000000001, 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023664419999999999, 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251388 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813795+0000", 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813795+0000", 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813794+0000", 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813800+0000", 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1650000000000003e-06 2024-04-26T12:16:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813813+0000", 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3317e-05 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813821+0000", 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8760000000000005e-06 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813852+0000", 2024-04-26T12:16:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813954+0000", 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101945 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251390 5.8 5:15dab8e5:::benchmark_data_smithi069_31227_object79733:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.813939+0000", 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001839916, 2024-04-26T12:16:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022800910000000001, 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251390 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813939+0000", 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813939+0000", 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813938+0000", 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813943+0000", 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8849999999999998e-06 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813953+0000", 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7769999999999997e-06 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.813959+0000", 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3110000000000002e-06 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.814006+0000", 2024-04-26T12:16:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7049000000000003e-05 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.814144+0000", 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000138527 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.814253+0000", 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108318 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251393 5.8 5:199c45d7:::benchmark_data_smithi069_31227_object79736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.815848+0000", 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9999304, 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00042696999999999999, 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251393 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.815848+0000", 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.815848+0000", 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.815847+0000", 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.815852+0000", 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5899999999999998e-06 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.815865+0000", 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.22e-05 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.815872+0000", 2024-04-26T12:16:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1389999999999998e-06 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816109+0000", 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000237612 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816235+0000", 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012536099999999999 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251395 5.f 5:f275094a:::benchmark_data_smithi069_31227_object79738:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.816109+0000", 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996696, 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000231604, 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251395 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816109+0000", 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816109+0000", 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816108+0000", 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816113+0000", 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7929999999999997e-06 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816122+0000", 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.986e-06 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816129+0000", 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816166+0000", 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7045999999999997e-05 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816339+0000", 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017272000000000001 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:251396 5.b 5:df293ea7:::benchmark_data_smithi069_31227_object79739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:31.816251+0000", 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995279, 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000151299, 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 251396 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816251+0000", 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816251+0000", 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816250+0000", 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816254+0000", 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1409999999999998e-06 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816263+0000", 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2300000000000008e-06 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816269+0000", 2024-04-26T12:16:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2929999999999997e-06 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:31.816305+0000", 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:16:31.867 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:31.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:31.891 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:16:31.909 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:31.908+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:31.981 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:31.979+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:32.056 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:32.056 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:32.067 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:32.108 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:32.107+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:32.183 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:32.182+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:32.251 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:32.251 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.614470113000003, 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:32.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.613354944999998, 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.256 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:32.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:32.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.613082360999996, 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.261 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:32.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.611815804000003, 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.267 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:32.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:32.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.611608355999998, 2024-04-26T12:16:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:32.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:32.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:32.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.611182872000001, 2024-04-26T12:16:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:32.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.610911932, 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:32.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.287 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.609837933000001, 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:32.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:32.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.932179140999999, 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.925919362999998, 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:32.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:32.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.923492779, 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.304 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:32.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.309 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.923204992999999, 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.310 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:32.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.922973979999998, 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.315 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.920199841999999, 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:32.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.339076865999999, 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.338982981000001, 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:32.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.335666025999998, 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.334449900999999, 2024-04-26T12:16:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.334432222, 2024-04-26T12:16:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 17.330853483999999, 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:32.364 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:32.365 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:32.364+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:32.366 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:32.466 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:32.464+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:32.518 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:32.518 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:32.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:253484 5.0 e48/16 5:0e59067c:::benchmark_data_smithi069_31227_object81827:head v 48'15801, mlcod=48'15797)", 2024-04-26T12:16:32.518 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.511437+0000", 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.004957744, 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049788130000000003, 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511437+0000", 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511437+0000", 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511436+0000", 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511442+0000", 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7919999999999998e-06 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511451+0000", 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0440000000000001e-06 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511457+0000", 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7309999999999998e-06 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511948+0000", 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049179599999999996 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511964+0000", 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5855e-05 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:253487 5.b e48/16 5:d56b2ab4:::benchmark_data_smithi069_31227_object81830:head v 48'15919, mlcod=48'15916)", 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.511852+0000", 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0045420649999999996, 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046231579999999996, 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511852+0000", 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511852+0000", 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511852+0000", 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511856+0000", 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511887+0000", 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0731000000000001e-05 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511893+0000", 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3770000000000004e-06 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511936+0000", 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3624000000000001e-05 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.511958+0000", 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1455e-05 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253491 5.6 5:66ff2fa8:::benchmark_data_smithi069_31227_object81834:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.512493+0000", 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039013780000000001, 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040404050000000004, 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253491 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512493+0000", 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512493+0000", 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512492+0000", 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512496+0000", 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9759999999999997e-06 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512504+0000", 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1070000000000005e-06 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512510+0000", 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6609999999999997e-06 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512804+0000", 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029398500000000003 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512947+0000", 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014333799999999999 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:253486 5.0 e48/16 5:0c7fd8a7:::benchmark_data_smithi069_31227_object81829:head v 48'15802, mlcod=48'15797)", 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.512719+0000", 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003675813, 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038760230000000001, 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512719+0000", 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512719+0000", 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512718+0000", 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512722+0000", 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8290000000000001e-06 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512728+0000", 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512733+0000", 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3730000000000003e-06 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513992+0000", 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001258903 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514020+0000", 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.849e-05 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:253493 5.e e48/16 5:7423a4b5:::benchmark_data_smithi069_31227_object81836:head v 48'15900, mlcod=48'15898)", 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.512974+0000", 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0034207909999999998, 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003674058, 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512974+0000", 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512974+0000", 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512973+0000", 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512978+0000", 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7870000000000001e-06 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512986+0000", 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8790000000000003e-06 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.512991+0000", 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7840000000000003e-06 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514584+0000", 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015935109999999999 2024-04-26T12:16:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514600+0000", 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6198e-05 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253492 5.3 5:cc273f0d:::benchmark_data_smithi069_31227_object81835:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.513079+0000", 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0033156570000000001, 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036223200000000001, 2024-04-26T12:16:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253492 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513079+0000", 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513079+0000", 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513078+0000", 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513083+0000", 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:16:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513093+0000", 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.005e-05 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513100+0000", 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.545e-06 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513886+0000", 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622299999999996 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514032+0000", 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014580999999999999 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253494 5.3 5:c30fd6b0:::benchmark_data_smithi069_31227_object81837:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.513106+0000", 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003288296, 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036540330000000001, 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253494 2024-04-26T12:16:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513106+0000", 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513106+0000", 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513106+0000", 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513108+0000", 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1449999999999998e-06 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513113+0000", 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2059999999999998e-06 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513117+0000", 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0729999999999998e-06 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515856+0000", 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027387539999999999 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515992+0000", 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000136324 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253496 5.7 5:e3a9b0c5:::benchmark_data_smithi069_31227_object81839:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.513357+0000", 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003037859, 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034618399999999999, 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253496 2024-04-26T12:16:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513357+0000", 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513357+0000", 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513356+0000", 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513360+0000", 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.658e-06 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513370+0000", 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9299999999999998e-06 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513375+0000", 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513412+0000", 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7286999999999997e-05 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.513553+0000", 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014142500000000001 2024-04-26T12:16:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:253495 5.0 e48/16 5:08e659e3:::benchmark_data_smithi069_31227_object81838:head v 48'15803, mlcod=48'15797)", 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.514236+0000", 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002158493, 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002643154, 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514236+0000", 2024-04-26T12:16:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514236+0000", 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514235+0000", 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514240+0000", 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514248+0000", 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2050000000000002e-06 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514254+0000", 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.271e-06 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515671+0000", 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014175780000000001 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515688+0000", 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.666e-05 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253498 5.2 5:475f49ff:::benchmark_data_smithi069_31227_object81841:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.514727+0000", 2024-04-26T12:16:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0016677020000000001, 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022047600000000001, 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253498 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514727+0000", 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514727+0000", 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514726+0000", 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514731+0000", 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6859999999999997e-06 2024-04-26T12:16:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514742+0000", 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1039000000000001e-05 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514750+0000", 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.011e-06 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514788+0000", 2024-04-26T12:16:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8195000000000003e-05 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.514929+0000", 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000140574 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253499 5.6 5:6d66feaf:::benchmark_data_smithi069_31227_object81842:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.515260+0000", 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011349369999999999, 2024-04-26T12:16:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001734464, 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253499 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515260+0000", 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515260+0000", 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515259+0000", 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515263+0000", 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4569999999999998e-06 2024-04-26T12:16:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515273+0000", 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3600000000000002e-06 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515278+0000", 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8119999999999996e-06 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515312+0000", 2024-04-26T12:16:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3908999999999997e-05 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515517+0000", 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020476500000000001 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253501 5.a 5:53ddf1a8:::benchmark_data_smithi069_31227_object81844:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.515481+0000", 2024-04-26T12:16:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00091372299999999997, 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001573468, 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253501 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515481+0000", 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515481+0000", 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515480+0000", 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515484+0000", 2024-04-26T12:16:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8589999999999998e-06 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515493+0000", 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6400000000000003e-06 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515501+0000", 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1340000000000004e-06 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515536+0000", 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5101999999999997e-05 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515679+0000", 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143239 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515776+0000", 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7115999999999996e-05 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:253502 5.1 5:8a1202f1:::benchmark_data_smithi069_31227_object81845:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.515550+0000", 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00084451399999999999, 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001568416, 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 253502 2024-04-26T12:16:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515550+0000", 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515550+0000", 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515549+0000", 2024-04-26T12:16:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515553+0000", 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4860000000000002e-06 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515560+0000", 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4340000000000003e-06 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515565+0000", 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2089999999999996e-06 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515614+0000", 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8309000000000001e-05 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.515787+0000", 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017323300000000001 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:253503 5.0 e48/16)", 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:32.516575+0000", 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998198, 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000599583, 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.516575+0000", 2024-04-26T12:16:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.516575+0000", 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.516574+0000", 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.516579+0000", 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8629999999999999e-06 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.516589+0000", 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0185e-05 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:32.516595+0000", 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 14 2024-04-26T12:16:32.574 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:32.575 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:32.574+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:32.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:32.676 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:32.675+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:32.719 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:32.725 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:32.725 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:32.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:32.777 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:32.776+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:32.841 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:32.841 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:32.841 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:32.859 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:32.859 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:32.861 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:32.862 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:32.878 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:32.877+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:32.892 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:16:32.893 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:32.893 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:32.906 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:32.979 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:32.977+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:33.045 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:33.045 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:33.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:33.102 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:33.101+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:33.180 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:33.179+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:33.198 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:33.198 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:33.210 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:33.294 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:33.293+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:33.381 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:33.380+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:33.391 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:33.391 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:33.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:33.483 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:33.481+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:33.554 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:33.554 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:33.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:33.612 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:33.611+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:33.685 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:33.683+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:33.717 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:33.717 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:33.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:33.786 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:33.785+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:33.887 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:33.886+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:33.924 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:33.924 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:33.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:33.988 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:33.987+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:34.077 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:34.078 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:34.089 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:34.090 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:34.087+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:34.190 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:34.188+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:34.271 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:34.271 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:34.282 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:34.290 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:34.289+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:34.391 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:34.389+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:34.424 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:34.424 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:34.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:34.491 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:34.490+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:34.588 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:34.588 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:34.592 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:34.590+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:34.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:34.692 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:34.691+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:34.793 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:34.792+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:34.794 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:34.794 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:34.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:34.863 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:34.894 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:34.892+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:34.906 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:16:34.986 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:34.987 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:34.987 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:34.994 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:34.993+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:35.003 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:35.003 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.766872444000001, 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.367816621999999, 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.963403532000001, 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:35.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:139458 5.6 5:6eba2ccf:::benchmark_data_smithi069_31227_object139457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.641456626, 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020005815, 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139458 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359414+0000", 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359452+0000", 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8101e-05 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359460+0000", 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.359465+0000", 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.365886+0000", 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064203339999999998 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.366028+0000", 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000142247 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379257+0000", 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013229642 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379343+0000", 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5673000000000005e-05 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:52.379420+0000", 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082000000000005e-05 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.645488587999999, 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.027 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.645136027, 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641345117, 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:35.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.518559073999999, 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.343719391, 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:35.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:35.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.091690698000001, 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:35.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.091455182000001, 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:35.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:35.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.09027712, 2024-04-26T12:16:35.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:35.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.089694497, 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:35.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.088969571, 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:35.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:35.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.088934636000001, 2024-04-26T12:16:35.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:35.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.088266287, 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.08804829, 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.086798455, 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.085921206999998, 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.731710104999999, 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:35.107 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:35.108 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:35.110 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:35.110 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:35.110 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:35.107+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:35.111 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:35.111 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:35.210 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:35.209+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:35.252 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:35.252 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:35.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261533 5.8 5:17249f29:::benchmark_data_smithi069_31227_object89876:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.247107+0000", 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033873990000000001, 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034100369999999999, 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261533 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247107+0000", 2024-04-26T12:16:35.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247107+0000", 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247106+0000", 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247111+0000", 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.437e-06 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247122+0000", 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1378e-05 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247134+0000", 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1598e-05 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247171+0000", 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7540999999999999e-05 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247325+0000", 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000153945 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247440+0000", 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114633 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.256 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261535 5.8 5:16fa6b1e:::benchmark_data_smithi069_31227_object89878:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.248299+0000", 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021954399999999999, 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002290907, 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261535 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.257 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.248299+0000", 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.248299+0000", 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.258 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.248298+0000", 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.248303+0000", 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.248318+0000", 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5577999999999999e-05 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.248325+0000", 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9909999999999996e-06 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.248981+0000", 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00065584400000000004 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249153+0000", 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017184000000000001 2024-04-26T12:16:35.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249270+0000", 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011722699999999999 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261536 5.4 5:26059217:::benchmark_data_smithi069_31227_object89879:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.249261+0000", 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0012339219999999999, 2024-04-26T12:16:35.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001395435, 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261536 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249261+0000", 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249261+0000", 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249260+0000", 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249265+0000", 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2530000000000004e-06 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249282+0000", 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.6705e-05 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249289+0000", 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6429999999999995e-06 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249331+0000", 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1876999999999999e-05 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249506+0000", 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000175079 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249608+0000", 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101675 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.265 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:261537 5.a e49/16 5:5456361b:::benchmark_data_smithi069_31227_object89880:head v 49'16264, mlcod=49'16261)", 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.249571+0000", 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00092397900000000001, 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001150018, 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249571+0000", 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249571+0000", 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249570+0000", 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249576+0000", 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0090000000000004e-06 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249584+0000", 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7340000000000008e-06 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249591+0000", 2024-04-26T12:16:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2169999999999997e-06 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249643+0000", 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2385000000000001e-05 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249661+0000", 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7980000000000001e-05 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.269 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261541 5.8 5:1aa0125e:::benchmark_data_smithi069_31227_object89884:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.249813+0000", 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00068179899999999997, 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00096253099999999998, 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.270 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261541 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249813+0000", 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249813+0000", 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249812+0000", 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249817+0000", 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6920000000000001e-06 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249830+0000", 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3152e-05 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249838+0000", 2024-04-26T12:16:35.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.354e-06 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250676+0000", 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00083757000000000005 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261542 5.d 5:bf92200a:::benchmark_data_smithi069_31227_object89885:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.274 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.249847+0000", 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00064737699999999998, 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00098410500000000009, 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261542 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249847+0000", 2024-04-26T12:16:35.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249847+0000", 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249847+0000", 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249849+0000", 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9210000000000001e-06 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249857+0000", 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5410000000000003e-06 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249864+0000", 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6810000000000001e-06 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249899+0000", 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4977000000000001e-05 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250063+0000", 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000164201 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261543 5.9 5:9933858b:::benchmark_data_smithi069_31227_object89886:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.249878+0000", 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00061605199999999996, 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001012722, 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261543 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249878+0000", 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249878+0000", 2024-04-26T12:16:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249878+0000", 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249881+0000", 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8760000000000001e-06 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249888+0000", 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3440000000000003e-06 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249893+0000", 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1320000000000002e-06 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249930+0000", 2024-04-26T12:16:35.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7078e-05 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250100+0000", 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016965 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261544 5.0 5:07c3b35a:::benchmark_data_smithi069_31227_object89887:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.249905+0000", 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00058952600000000005, 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001048525, 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261544 2024-04-26T12:16:35.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249905+0000", 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249905+0000", 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249904+0000", 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249907+0000", 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.83e-06 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249915+0000", 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3220000000000004e-06 2024-04-26T12:16:35.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.249920+0000", 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3789999999999997e-06 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250518+0000", 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00059761500000000002 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250662+0000", 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144826 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250761+0000", 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8313999999999994e-05 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:261533 5.8 e49/16)", 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.250610+0000", 2024-04-26T12:16:35.288 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9998841, 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00041176400000000001, 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250610+0000", 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250610+0000", 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250610+0000", 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250615+0000", 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:16:35.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250625+0000", 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9480000000000003e-06 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.250631+0000", 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9100000000000002e-06 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261514 5.0 5:04a83e83:::benchmark_data_smithi069_31227_object89857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.240248+0000", 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010246862000000001, 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010818737, 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261514 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240248+0000", 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240248+0000", 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240247+0000", 2024-04-26T12:16:35.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240252+0000", 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6820000000000002e-06 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240262+0000", 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0548e-05 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240270+0000", 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8099999999999998e-06 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240307+0000", 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7110000000000002e-05 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240453+0000", 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014571500000000001 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240551+0000", 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8278999999999999e-05 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244372+0000", 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038213940000000001 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261517 5.0 5:07255aa0:::benchmark_data_smithi069_31227_object89860:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.240310+0000", 2024-04-26T12:16:35.297 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.010184652000000001, 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.010829815, 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261517 2024-04-26T12:16:35.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240310+0000", 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240310+0000", 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240309+0000", 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240312+0000", 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5620000000000002e-06 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240318+0000", 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3600000000000001e-06 2024-04-26T12:16:35.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.240323+0000", 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.242453+0000", 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021295839999999999 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.242625+0000", 2024-04-26T12:16:35.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017205399999999999 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.242735+0000", 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109988 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.245693+0000", 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0029584849999999998 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.302 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:261525 5.0 5:00dce712:::benchmark_data_smithi069_31227_object89868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:35.244387+0000", 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061074320000000003, 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00682389, 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.303 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 261525 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244387+0000", 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244387+0000", 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244386+0000", 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244390+0000", 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0670000000000002e-06 2024-04-26T12:16:35.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244409+0000", 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8219999999999998e-05 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244415+0000", 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5479999999999998e-06 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244448+0000", 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2733e-05 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244551+0000", 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102935 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.244612+0000", 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1171000000000001e-05 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:35.247097+0000", 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002485133 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:16:35.308 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:35.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:35.311 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:35.310+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:35.412 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:35.411+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:35.494 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:35.494 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:35.495 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:35.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:35.548 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:35.547+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:35.614 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:35.613+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:35.695 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:35.695 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:35.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:35.695 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:35.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.695 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.058459108999998, 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.698 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:35.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:35.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:35.701 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.701 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.701 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.701 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.057343940999999, 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:35.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:35.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:35.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:35.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:35.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:35.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:35.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:35.708 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.057071356999998, 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.715 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.055804799999997, 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:35.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:35.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:35.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:35.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:35.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:35.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:35.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.722 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.055597351999999, 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.723 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:35.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:35.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:35.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:35.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:35.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:35.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:35.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:35.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:35.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:35.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.730 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.730 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:35.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.055171868000002, 2024-04-26T12:16:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.054900928000002, 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 59.053826929000003, 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:35.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:35.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:35.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:35.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.376168137000001, 2024-04-26T12:16:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.756 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.369908359, 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.757 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:35.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:35.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:35.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.367481775000002, 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:35.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:35.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:35.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:35.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:35.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:35.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:35.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.771 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.367193989, 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.777 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.366962976, 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:35.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:35.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:35.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:35.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:35.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:35.784 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 24.364188838, 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:35.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:35.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:35.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:35.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:35.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:35.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:35.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:35.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:35.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:35.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:35.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.783065862000001, 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.793 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:35.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:35.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.799 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.782971976999999, 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:35.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:35.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.779655022, 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:35.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:35.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:35.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:35.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:35.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:35.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.815 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.816 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:35.816 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.778438897000001, 2024-04-26T12:16:35.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:35.816 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.816 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:35.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:35.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:35.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.778421217999998, 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.827 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:35.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:35.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 20.77484248, 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:35.833 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:35.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:35.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:35.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:35.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:35.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.839 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:35.839 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:35.839 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:35.840 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:35.839+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:35.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:35.889 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:16:35.941 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:35.940+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:35.996 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:35.996 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:35.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.996 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263815 5.a 5:5b52f93d:::benchmark_data_smithi069_31227_object92158:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.992247+0000", 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029185859999999999, 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029358959999999999, 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263815 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992247+0000", 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992247+0000", 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992247+0000", 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:35.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992251+0000", 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992259+0000", 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9209999999999992e-06 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992264+0000", 2024-04-26T12:16:35.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5090000000000001e-06 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992298+0000", 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3278999999999998e-05 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992439+0000", 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014112799999999999 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992537+0000", 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8183999999999994e-05 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263817 5.a 5:54e2346e:::benchmark_data_smithi069_31227_object92160:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.993427+0000", 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0017392519999999999, 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018005829999999999, 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263817 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993427+0000", 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993427+0000", 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993426+0000", 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993430+0000", 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.391e-06 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993441+0000", 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0818e-05 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993448+0000", 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.994110+0000", 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066191500000000001 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.994278+0000", 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016790899999999999 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.994360+0000", 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1364000000000002e-05 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.005 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263818 5.c 5:39292a3c:::benchmark_data_smithi069_31227_object92161:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.993691+0000", 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001474747, 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015758250000000001, 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263818 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993691+0000", 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993691+0000", 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993690+0000", 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993694+0000", 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7579999999999998e-06 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993702+0000", 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3240000000000003e-06 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993709+0000", 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1800000000000001e-06 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993751+0000", 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-05 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993949+0000", 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019765200000000001 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263819 5.5 5.8a5675c5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.993878+0000", 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012878029999999999, 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014521950000000001, 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263819 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993878+0000", 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993878+0000", 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993877+0000", 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993881+0000", 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993889+0000", 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6969999999999993e-06 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993896+0000", 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-04-26T12:16:36.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263807 5.5 5:ad746604:::benchmark_data_smithi069_31227_object92150:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.989124+0000", 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0060417090000000001, 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062641579999999997, 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.013 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263807 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989124+0000", 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989124+0000", 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989124+0000", 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989126+0000", 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7150000000000001e-06 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989129+0000", 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6689999999999999e-06 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989132+0000", 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991591+0000", 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024596900000000001 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991739+0000", 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014719200000000001 2024-04-26T12:16:36.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.995276+0000", 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035377339999999998 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.995336+0000", 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9589000000000002e-05 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263809 5.a 5:5b95b2af:::benchmark_data_smithi069_31227_object92152:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.989195+0000", 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0059707170000000004, 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006263584, 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263809 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.018 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989195+0000", 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989195+0000", 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989195+0000", 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989197+0000", 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.007e-06 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989202+0000", 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6620000000000002e-06 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989207+0000", 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989235+0000", 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8768999999999998e-05 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989344+0000", 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108659 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.989404+0000", 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9913e-05 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263812 5.2 5:499ac44f:::benchmark_data_smithi069_31227_object92155:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.991382+0000", 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0037839789999999998, 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041318290000000001, 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:36.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263812 2024-04-26T12:16:36.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.025 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991382+0000", 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991382+0000", 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991381+0000", 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991386+0000", 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6099999999999999e-06 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991395+0000", 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5550000000000008e-06 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991402+0000", 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991481+0000", 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991646+0000", 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016486499999999999 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:263813 5.5 5:a9f5c9c9:::benchmark_data_smithi069_31227_object92156:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.991505+0000", 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0036610169999999999, 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040445489999999997, 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 263813 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.029 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991505+0000", 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991505+0000", 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991504+0000", 2024-04-26T12:16:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991508+0000", 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991516+0000", 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.991522+0000", 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993789+0000", 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022666800000000001 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.993970+0000", 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000181516 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:263814 5.4 e50/16 5:254522fe:::benchmark_data_smithi069_31227_object92157:head v 50'16319, mlcod=50'16317)", 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:35.992163+0000", 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0030030220000000002, 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034197009999999998, 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992163+0000", 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992163+0000", 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992162+0000", 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992169+0000", 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:16:36.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992177+0000", 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1270000000000003e-06 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992183+0000", 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9460000000000003e-06 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992226+0000", 2024-04-26T12:16:36.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3115000000000003e-05 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:35.992244+0000", 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8063e-05 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 9 2024-04-26T12:16:36.036 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:36.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:36.083 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:36.081+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:36.143 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:36.142+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:36.189 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:36.189 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:36.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:36.245 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:36.243+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:36.345 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:36.344+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:36.395 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:36.395 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:36.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:36.395 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:36.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.158352699000005, 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:36.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:36.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.759296876999997, 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:36.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:36.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.354883786999999, 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:36.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:36.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.036968842999997, 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:36.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.036616281999997, 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:36.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:36.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.032825371999998, 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:36.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:36.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.910039329, 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:36.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:36.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.735199646000002, 2024-04-26T12:16:36.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:36.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:36.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:36.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:36.442 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.483170952999998, 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:36.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:36.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.482935436999998, 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:36.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.481757375000001, 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:36.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.481174752000001, 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:36.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.480449826000001, 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:36.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.480414890999999, 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:36.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:36.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:36.473 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.479746542000001, 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:36.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:36.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:36.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.479528545000001, 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.479 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:36.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.478278710000001, 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:36.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:36.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.477401462, 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.489 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:36.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.123190360000001, 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:36.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25446443600000002, 2024-04-26T12:16:36.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:36.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:36.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:36.505 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:36.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:36.507 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:36.505+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:36.607 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:36.606+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:36.651 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:36.651 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:36.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.651 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265689 5.b 5:d6be60c0:::benchmark_data_smithi069_31227_object94032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.651 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.644763+0000", 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004970721, 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049928250000000002, 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265689 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.652 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644763+0000", 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644763+0000", 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644762+0000", 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644767+0000", 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9030000000000003e-06 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644777+0000", 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7019999999999996e-06 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644783+0000", 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644823+0000", 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9483999999999997e-05 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.644977+0000", 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015421900000000001 2024-04-26T12:16:36.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.645080+0000", 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102798 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:265691 5.a e50/16 5:581de38c:::benchmark_data_smithi069_31227_object94034:head v 50'16517, mlcod=50'16514)", 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.646271+0000", 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0034631050000000002, 2024-04-26T12:16:36.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0035655869999999998, 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646271+0000", 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646271+0000", 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646270+0000", 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646276+0000", 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4060000000000004e-06 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646284+0000", 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:16:36.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646289+0000", 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3600000000000004e-06 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646334+0000", 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4778999999999999e-05 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:36.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.646354+0000", 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.999e-05 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265701 5.b 5:d82801fb:::benchmark_data_smithi069_31227_object94044:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.648241+0000", 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014927779999999999, 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016478199999999999, 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.660 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265701 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648241+0000", 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648241+0000", 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648240+0000", 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648245+0000", 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.639e-06 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648257+0000", 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2116000000000001e-05 2024-04-26T12:16:36.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648263+0000", 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648298+0000", 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5352999999999998e-05 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:36.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648448+0000", 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015010199999999999 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648559+0000", 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011107600000000001 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265702 5.f 5:f622c038:::benchmark_data_smithi069_31227_object94045:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.648303+0000", 2024-04-26T12:16:36.664 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014303969999999999, 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016428180000000001, 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265702 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648303+0000", 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648303+0000", 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648303+0000", 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648305+0000", 2024-04-26T12:16:36.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2110000000000001e-06 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648311+0000", 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648314+0000", 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.354e-06 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648342+0000", 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7840000000000001e-05 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648471+0000", 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012883600000000001 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:265698 5.a e50/16 5:54623a60:::benchmark_data_smithi069_31227_object94041:head v 50'16518, mlcod=50'16514)", 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.648382+0000", 2024-04-26T12:16:36.668 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0013518709999999999, 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001607083, 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648382+0000", 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648382+0000", 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648381+0000", 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648387+0000", 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0109999999999997e-06 2024-04-26T12:16:36.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648407+0000", 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0038e-05 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648414+0000", 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3269999999999997e-06 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:36.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648450+0000", 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6451e-05 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.648471+0000", 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1251999999999999e-05 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.672 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265703 5.9 5:9ec555ab:::benchmark_data_smithi069_31227_object94046:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.649368+0000", 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00036585699999999998, 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00065141000000000005, 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265703 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649368+0000", 2024-04-26T12:16:36.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649368+0000", 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649367+0000", 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.674 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649372+0000", 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9949999999999996e-06 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649381+0000", 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3780000000000001e-06 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649387+0000", 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:16:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649432+0000", 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4682999999999999e-05 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649581+0000", 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000148944 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.676 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265705 5.b 5.54facdcb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.649646+0000", 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 8.7878000000000001e-05, 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00040564900000000001, 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265705 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.677 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649646+0000", 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649646+0000", 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649645+0000", 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649650+0000", 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0150000000000003e-06 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649661+0000", 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0441999999999999e-05 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.679 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649667+0000", 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6610000000000003e-06 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265706 5.f 5.b3d447af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.649683+0000", 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 5.1233000000000002e-05, 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00039710899999999998, 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:36.680 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265706 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649683+0000", 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649683+0000", 2024-04-26T12:16:36.681 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649682+0000", 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649685+0000", 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8710000000000001e-06 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.682 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649694+0000", 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3600000000000002e-06 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.649699+0000", 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7099999999999998e-06 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265707 5.9 5.925ab029 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.683 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.650074+0000", 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996595, 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7922e-05, 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265707 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650074+0000", 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650074+0000", 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650074+0000", 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650078+0000", 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6349999999999997e-06 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.685 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650090+0000", 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1504e-05 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650096+0000", 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.686 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265708 5.b 5.2dcfbcb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.650131+0000", 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996033, 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2970999999999999e-05, 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265708 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650131+0000", 2024-04-26T12:16:36.687 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650131+0000", 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650130+0000", 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.688 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650134+0000", 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9659999999999998e-06 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650145+0000", 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0862999999999999e-05 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650151+0000", 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3810000000000004e-06 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.689 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:265709 5.b 5.f6d9895b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:36.650159+0000", 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995751, 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9357999999999996e-05, 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:36.690 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 265709 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650159+0000", 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650159+0000", 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:36.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650158+0000", 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650161+0000", 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.672e-06 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650166+0000", 2024-04-26T12:16:36.692 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0860000000000001e-06 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:36.650169+0000", 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2550000000000002e-06 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 11 2024-04-26T12:16:36.693 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:36.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:36.738 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:36.737+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:36.808 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:36.807+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:36.839 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:36.839 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:36.840 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:36.840 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:36.852 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:36.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-26T12:16:36.936 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:36.935+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:37.011 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:37.009+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:37.029 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.393413961999997, 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.030 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:37.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:37.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:37.034 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.392298793999998, 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:37.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:37.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:37.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:37.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.392026209999997, 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.041 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:37.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.047 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.390759653000003, 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:37.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:37.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:37.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:37.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:37.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.390552204999999, 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.055 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:37.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:37.059 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.390126721000001, 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.060 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:37.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.389855781000001, 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.065 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 60.388781782000002, 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:37.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:37.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.71112299, 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.077 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:37.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.704863211999999, 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.082 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.702436628000001, 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:37.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.702148842, 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:37.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:37.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.701917828999999, 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.099 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:37.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.699143691, 2024-04-26T12:16:37.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:37.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:37.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.118020715, 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:37.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.117926829999998, 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:37.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:37.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:37.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:37.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.114609874999999, 2024-04-26T12:16:37.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:37.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:37.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.11339375, 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.131 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:37.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.113376071000001, 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.137 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:37.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:37.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:37.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 22.109797332999999, 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:37.143 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:37.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:37.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:37.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:37.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:37.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:37.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.149 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:37.149 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:37.149 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:37.150 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:37.151 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:37.149+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:37.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:37.251 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:37.249+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:37.271 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:37.272 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:37.272 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:37.290 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:37.290 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:37.292 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:37.293 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:37.308 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:37.308 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:37.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:37.363 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:37.361+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:37.453 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:37.451+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:37.518 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:37.518 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:37.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:37.554 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:37.552+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:37.655 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:37.654+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:37.723 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:37.724 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:37.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:37.756 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:37.755+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:37.857 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:37.856+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:37.877 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:37.877 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:37.887 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:37.904 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:16:37.958 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:37.957+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:38.028 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:38.029 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:38.041 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:38.059 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:38.057+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:38.160 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:38.158+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:38.226 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:38.226 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:38.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:38.281 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:38.280+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:38.361 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:38.360+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:38.392 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:38.392 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:38.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:38.489 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:38.487+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:38.562 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:38.561+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:38.594 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:38.594 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:38.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:38.662 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:38.661+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:38.763 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:38.762+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:38.796 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:38.797 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:38.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:38.864 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:38.863+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:38.904 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:16:38.949 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:38.949 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:38.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:38.965 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:38.963+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:39.065 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:39.064+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:39.104 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:39.104 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:39.116 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:39.167 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:39.166+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:39.254 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:39.254 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:39.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:39.294 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:39.307 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:39.306+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:39.369 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:39.368+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:39.418 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:39.418 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:39.419 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:273848 5.5 5:aa70361d:::benchmark_data_smithi069_31227_object102191:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:39.417762+0000", 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014477579999999999, 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014713389999999999, 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 273848 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417762+0000", 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417762+0000", 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417761+0000", 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417765+0000", 2024-04-26T12:16:39.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8469999999999998e-06 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417773+0000", 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0509999999999997e-06 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417778+0000", 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3770000000000004e-06 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417812+0000", 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3535000000000003e-05 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417974+0000", 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016161600000000001 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:273852 5.c 5:3dc8c4fd:::benchmark_data_smithi069_31227_object102195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:39.417792+0000", 2024-04-26T12:16:39.424 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014179660000000001, 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015162839999999999, 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 273852 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417792+0000", 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417792+0000", 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417791+0000", 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417794+0000", 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417801+0000", 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6510000000000004e-06 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417807+0000", 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5899999999999998e-06 2024-04-26T12:16:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418387+0000", 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058013699999999999 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418526+0000", 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013959500000000001 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:273854 5.a 5:563f619e:::benchmark_data_smithi069_31227_object102197:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:39.417840+0000", 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00136998, 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015325, 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 273854 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.429 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417840+0000", 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417840+0000", 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417839+0000", 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417842+0000", 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2610000000000002e-06 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417849+0000", 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4339999999999997e-06 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417854+0000", 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3340000000000001e-06 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.417911+0000", 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6975999999999998e-05 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418062+0000", 2024-04-26T12:16:39.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151244 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418164+0000", 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101959 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:273851 5.e e51/16 5:7b911e78:::benchmark_data_smithi069_31227_object102194:head v 51'17174, mlcod=51'17172)", 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:39.418242+0000", 2024-04-26T12:16:39.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00096742300000000002, 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011997970000000001, 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418242+0000", 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418242+0000", 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418242+0000", 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418249+0000", 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2470000000000002e-06 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418258+0000", 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9590000000000001e-06 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418264+0000", 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9209999999999997e-06 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418324+0000", 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0086e-05 2024-04-26T12:16:39.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418341+0000", 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7078000000000001e-05 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:273856 5.a 5.54a1e75a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:39.418348+0000", 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00086202800000000003, 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001151259, 2024-04-26T12:16:39.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 273856 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418348+0000", 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418348+0000", 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418347+0000", 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418351+0000", 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5090000000000004e-06 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418359+0000", 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4220000000000003e-06 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:39.418365+0000", 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2979999999999997e-06 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:39.440 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 5 2024-04-26T12:16:39.441 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:39.441 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:39.442 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:39.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:39.443 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:39.443 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:39.469 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:39.468+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:39.570 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:39.569+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:39.590 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:39.590 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:39.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:39.671 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:39.670+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:39.752 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.515783386999999, 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.116727564999998, 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.712314474999999, 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.394399530999998, 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.394046969999998, 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.390256059999999, 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.267470017000001, 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.092630333999999, 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.840601640999999, 2024-04-26T12:16:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.840366124999999, 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.839188063000002, 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.838605439999998, 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.837880513999998, 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.837845579, 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.837177230000002, 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.836959233000002, 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.835709397999999, 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.83483215, 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.480621048, 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6118951240000001, 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:39.856 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:39.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:39.858 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:39.856+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:39.959 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:39.957+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:39.999 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:39.999 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:39.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:39.999 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275466 5.b 5:deb68d87:::benchmark_data_smithi069_31227_object103809:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.990459+0000", 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0075478139999999999, 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0075726049999999996, 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275466 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990459+0000", 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990459+0000", 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990458+0000", 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990461+0000", 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.897e-06 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990468+0000", 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6120000000000004e-06 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990473+0000", 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8409999999999999e-06 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991784+0000", 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001311579 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991936+0000", 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015157500000000001 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.992048+0000", 2024-04-26T12:16:40.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112087 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.994722+0000", 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026739979999999999 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275467 5.0 5:0bbcc6eb:::benchmark_data_smithi069_31227_object103810:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.990478+0000", 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0075289520000000002, 2024-04-26T12:16:40.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0076380650000000003, 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275467 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990478+0000", 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990478+0000", 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990477+0000", 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990480+0000", 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.447e-06 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990486+0000", 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1399999999999997e-06 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.990490+0000", 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2590000000000002e-06 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991113+0000", 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00062325499999999997 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991280+0000", 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016687399999999999 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991411+0000", 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013031100000000001 2024-04-26T12:16:40.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993854+0000", 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024432450000000001 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275471 5.d 5:b31b04e6:::benchmark_data_smithi069_31227_object103814:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.991860+0000", 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061464390000000001, 2024-04-26T12:16:40.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0063342290000000002, 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275471 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991860+0000", 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991860+0000", 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991860+0000", 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991864+0000", 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3479999999999997e-06 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991873+0000", 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8319999999999995e-06 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991879+0000", 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.84e-06 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.991916+0000", 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7761e-05 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.992092+0000", 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017537100000000001 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.998197+0000", 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061054120000000002 2024-04-26T12:16:40.013 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275474 5.d 5:b2d5d57f:::benchmark_data_smithi069_31227_object103817:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.993180+0000", 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048265080000000002, 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050897290000000003, 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.014 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275474 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993180+0000", 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993180+0000", 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993179+0000", 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993184+0000", 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993197+0000", 2024-04-26T12:16:40.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2958e-05 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993205+0000", 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5619999999999998e-06 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993839+0000", 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00063374199999999996 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.994023+0000", 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018476699999999999 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275475 5.d 5:b00fd279:::benchmark_data_smithi069_31227_object103818:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.993243+0000", 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047641489999999996, 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050635039999999999, 2024-04-26T12:16:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275475 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993243+0000", 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993243+0000", 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993242+0000", 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993245+0000", 2024-04-26T12:16:40.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993255+0000", 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5100000000000004e-06 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.993260+0000", 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2100000000000001e-06 2024-04-26T12:16:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995570+0000", 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023102219999999998 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995745+0000", 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017488399999999999 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275480 5.8 5:1264d3de:::benchmark_data_smithi069_31227_object103823:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.995528+0000", 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024789859999999999, 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028123309999999999, 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275480 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.023 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995528+0000", 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995528+0000", 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995527+0000", 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995531+0000", 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2189999999999998e-06 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995538+0000", 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.545e-06 2024-04-26T12:16:40.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995543+0000", 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9459999999999997e-06 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995583+0000", 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0330999999999997e-05 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995743+0000", 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015998600000000001 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995861+0000", 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011760900000000001 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275483 5.8 5:1dee4f80:::benchmark_data_smithi069_31227_object103826:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.995579+0000", 2024-04-26T12:16:40.027 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002427551, 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027971770000000001, 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275483 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995579+0000", 2024-04-26T12:16:40.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995579+0000", 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995579+0000", 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995582+0000", 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.965e-06 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995588+0000", 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0780000000000001e-06 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995591+0000", 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3969999999999998e-06 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997569+0000", 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019777789999999998 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997700+0000", 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013107599999999999 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997764+0000", 2024-04-26T12:16:40.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3623999999999999e-05 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:275482 5.a e51/16 5:595c226e:::benchmark_data_smithi069_31227_object103825:head v 51'17135, mlcod=51'17132)", 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.995959+0000", 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020479999999999999, 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024562970000000001, 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995959+0000", 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995959+0000", 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995958+0000", 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995964+0000", 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7200000000000003e-06 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995982+0000", 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8196999999999999e-05 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.995990+0000", 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5820000000000004e-06 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.996020+0000", 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0426999999999999e-05 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.996033+0000", 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3416e-05 2024-04-26T12:16:40.035 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:275487 5.f 5:f0b9314f:::benchmark_data_smithi069_31227_object103830:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:39.997617+0000", 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00039001999999999998, 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00082870299999999997, 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.036 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 275487 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997617+0000", 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997617+0000", 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997616+0000", 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997621+0000", 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.809e-06 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997632+0000", 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.187e-05 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997639+0000", 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.545e-06 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997679+0000", 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9755999999999997e-05 2024-04-26T12:16:40.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:39.997781+0000", 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000101778 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-26T12:16:40.040 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:40.041 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:40.059 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:40.057+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:40.161 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:40.159+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:40.224 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:40.225 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:40.225 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:40.225 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:40.225 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:40.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:40.261 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:40.260+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:40.362 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:40.361+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:40.378 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.741175513000002, 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.383 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:40.383 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:40.383 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.740060345000003, 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:40.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:40.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:40.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.739787761000002, 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:40.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:40.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:40.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:40.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.400 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:40.400 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:40.400 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.738521204000001, 2024-04-26T12:16:40.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:40.400 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.401 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.401 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.401 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.401 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.401 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:40.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.401 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:40.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.738313755999997, 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.407 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:40.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:40.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.737888271999999, 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.413 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:40.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:40.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.737617331999999, 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.419 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:40.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:40.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.424 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 63.736543333, 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.425 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:40.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:40.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:40.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:40.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.432 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.058884541000001, 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.433 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:40.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:40.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:40.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:40.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.052624763000001, 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:40.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:40.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:40.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.447 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.050198178999999, 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:40.448 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:40.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:40.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.452 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:40.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:40.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:40.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:40.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.049910393000001, 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.457 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:40.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:40.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:40.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:40.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.049679380000001, 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:40.464 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:40.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:40.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:40.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:40.473 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 29.046905242000001, 2024-04-26T12:16:40.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:40.474 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.474 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.474 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:40.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:40.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:40.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:40.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.479 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:40.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:40.483 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.465782266000001, 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.465688381, 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:40.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:40.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:40.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:40.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:40.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.462371426000001, 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:40.497 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:40.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.461155301000002, 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:40.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.461137621999999, 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:40.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:40.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.514 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 25.457558884000001, 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:40.515 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:40.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:40.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.519 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:40.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:40.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.522 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:40.522 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:40.522 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:40.525 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:40.522+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:40.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:40.625 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:40.623+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:40.682 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277485 5.2 5:427d6ef0:::benchmark_data_smithi069_31227_object105828:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.674110+0000", 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065845959999999999, 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066091680000000003, 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277485 2024-04-26T12:16:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674110+0000", 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674110+0000", 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674110+0000", 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674114+0000", 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2459999999999997e-06 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674121+0000", 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5420000000000002e-06 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674125+0000", 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674169+0000", 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4406000000000001e-05 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674335+0000", 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016531 2024-04-26T12:16:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277489 5.2 5:47957582:::benchmark_data_smithi069_31227_object105832:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.674152+0000", 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065430219999999999, 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066362110000000004, 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277489 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674152+0000", 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674152+0000", 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674152+0000", 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674154+0000", 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.683e-06 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674160+0000", 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1149999999999999e-06 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.674165+0000", 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8189999999999999e-06 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676082+0000", 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001916467 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676252+0000", 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016976900000000001 2024-04-26T12:16:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277493 5.2 5:4d08ed1c:::benchmark_data_smithi069_31227_object105836:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.675687+0000", 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0050081520000000001, 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051633709999999999, 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277493 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.675687+0000", 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.675687+0000", 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.675686+0000", 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.675690+0000", 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0729999999999998e-06 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.675699+0000", 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2199999999999992e-06 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.675703+0000", 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4859999999999999e-06 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.677913+0000", 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002210301 2024-04-26T12:16:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678084+0000", 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017024600000000001 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:277478 5.a e51/16 ondisk, result = 0)", 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.676632+0000", 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040633939999999997, 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042747210000000004, 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676632+0000", 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676632+0000", 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676631+0000", 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676635+0000", 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2010000000000001e-06 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676645+0000", 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0009e-05 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676652+0000", 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.404e-06 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.677895+0000", 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012433120000000001 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.677901+0000", 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3380000000000001e-06 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277494 5.2 5:43713960:::benchmark_data_smithi069_31227_object105837:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.676814+0000", 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003881518, 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041538199999999999, 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277494 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676814+0000", 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676814+0000", 2024-04-26T12:16:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676813+0000", 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676818+0000", 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8199999999999996e-06 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676829+0000", 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1378e-05 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676836+0000", 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679969+0000", 2024-04-26T12:16:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00313292 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680135+0000", 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016631299999999999 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277495 5.a 5.b2a5e84a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.676842+0000", 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038526290000000002, 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004182547, 2024-04-26T12:16:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277495 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676842+0000", 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676842+0000", 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676842+0000", 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676845+0000", 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676858+0000", 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3451e-05 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.676865+0000", 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6120000000000004e-06 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:277500 5.0 e51/16 5:0a15bd77:::benchmark_data_smithi069_31227_object105843:head v 51'17302, mlcod=51'17299)", 2024-04-26T12:16:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.678509+0000", 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0021861710000000002, 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002565529, 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678509+0000", 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678509+0000", 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678508+0000", 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678514+0000", 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2220000000000001e-06 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678526+0000", 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2627e-05 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678534+0000", 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2629999999999997e-06 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678566+0000", 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2169000000000003e-05 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678592+0000", 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6322999999999999e-05 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277501 5.1 5:86703e8e:::benchmark_data_smithi069_31227_object105844:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.678631+0000", 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0020636280000000001, 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002496744, 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277501 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678631+0000", 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678631+0000", 2024-04-26T12:16:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678631+0000", 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678635+0000", 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0589999999999996e-06 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678641+0000", 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678646+0000", 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6299999999999997e-06 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678683+0000", 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7004e-05 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.678787+0000", 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010375 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277504 5.1 5:87df6c3e:::benchmark_data_smithi069_31227_object105847:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.679472+0000", 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012228339999999999, 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001717327, 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277504 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679472+0000", 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679472+0000", 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679472+0000", 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679475+0000", 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7459999999999998e-06 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679483+0000", 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9109999999999993e-06 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679488+0000", 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680473+0000", 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098520199999999991 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680638+0000", 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016489599999999999 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:277506 5.c 5:3b8019bf:::benchmark_data_smithi069_31227_object105849:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.679499+0000", 2024-04-26T12:16:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00119655, 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017526760000000001, 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 277506 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679499+0000", 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679499+0000", 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679498+0000", 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679500+0000", 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9570000000000001e-06 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679504+0000", 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9040000000000002e-06 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679507+0000", 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9110000000000002e-06 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679542+0000", 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4898999999999999e-05 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679651+0000", 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108925 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:277502 5.b e51/16 5:ddecb983:::benchmark_data_smithi069_31227_object105845:head v 51'17424, mlcod=51'17422)", 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.679909+0000", 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00078615599999999999, 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400108, 2024-04-26T12:16:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679909+0000", 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679909+0000", 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679908+0000", 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679914+0000", 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2780000000000001e-06 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679923+0000", 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9819999999999997e-06 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679928+0000", 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8080000000000001e-06 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679968+0000", 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9619999999999997e-05 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.679984+0000", 2024-04-26T12:16:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6169999999999999e-05 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:277503 5.0 e51/16 5:01e682ba:::benchmark_data_smithi069_31227_object105846:head v 51'17303, mlcod=51'17299)", 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.680025+0000", 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00067042200000000005, 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001335941, 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680025+0000", 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680025+0000", 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680024+0000", 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680029+0000", 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680035+0000", 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8800000000000002e-06 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680040+0000", 2024-04-26T12:16:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680266+0000", 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225646 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.680277+0000", 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1028e-05 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:277505 5.0 e51/16)", 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:40.681123+0000", 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9995718, 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028675700000000001, 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.681123+0000", 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.681123+0000", 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.681123+0000", 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.681132+0000", 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.679e-06 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.681141+0000", 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1629999999999996e-06 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:40.681147+0000", 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-04-26T12:16:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 13 2024-04-26T12:16:40.734 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:40.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:40.737 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:40.734+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:40.836 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:40.835+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:40.918 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:16:40.922 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:40.922 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:40.922 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:40.922 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:40.922 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:40.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:40.978 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:40.977+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:41.038 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:41.036+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.896479446000001, 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:41.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:41.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:41.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.497423624000007, 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:41.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 62.093010534000001, 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.775095589999999, 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.774743029, 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.770952119, 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:41.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:41.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:41.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:41.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.648166075999999, 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.170 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.473326393000001, 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.221297700000001, 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:41.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:41.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.221062184000001, 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:41.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:41.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.219884122, 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:41.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.219301499, 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:41.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.218576573, 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:41.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.218541638000001, 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:41.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.204 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.217873289, 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.205 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.217655292, 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:41.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.216405457, 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.218 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.215528208999999, 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:41.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:226175 5.2 5:4898eedf:::benchmark_data_smithi069_31227_object54518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.861317107000001, 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020044956999999999, 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 226175 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269161+0000", 2024-04-26T12:16:41.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269160+0000", 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269168+0000", 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269176+0000", 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8769999999999999e-06 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.269184+0000", 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.282949+0000", 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013764938000000001 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.283139+0000", 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190077 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289092+0000", 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059523919999999999 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289135+0000", 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3058e-05 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:23.289206+0000", 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1150999999999997e-05 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.992591183, 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:41.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:41.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:41.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:41.234 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:41.236 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:41.236 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:41.234+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:41.337 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:41.335+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:41.378 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:41.378 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:41.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.378 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279513 5.e 5:7ab20d57:::benchmark_data_smithi069_31227_object107856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.378 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.370586+0000", 2024-04-26T12:16:41.378 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061815869999999997, 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061980359999999996, 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279513 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370586+0000", 2024-04-26T12:16:41.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370586+0000", 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370584+0000", 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370590+0000", 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1689999999999997e-06 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370601+0000", 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0522e-05 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370609+0000", 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8490000000000006e-06 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370847+0000", 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000238044 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371034+0000", 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018709600000000001 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371174+0000", 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014025600000000001 2024-04-26T12:16:41.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279516 5.e 5:74b9cea8:::benchmark_data_smithi069_31227_object107859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.370837+0000", 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0059298140000000003, 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059920340000000002, 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279516 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370837+0000", 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370837+0000", 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370837+0000", 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370841+0000", 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7249999999999997e-06 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370851+0000", 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.370857+0000", 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4150000000000004e-06 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.373208+0000", 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023504089999999999 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.373363+0000", 2024-04-26T12:16:41.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000155585 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.373481+0000", 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000117218 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279518 5.e 5:7b6344ce:::benchmark_data_smithi069_31227_object107861:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.371497+0000", 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0052701509999999998, 2024-04-26T12:16:41.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0053706459999999998, 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279518 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371497+0000", 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371497+0000", 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371496+0000", 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371501+0000", 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2640000000000002e-06 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371509+0000", 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3809999999999999e-06 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.371514+0000", 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0000000000000004e-06 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375423+0000", 2024-04-26T12:16:41.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0039085669999999999 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375569+0000", 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014637100000000001 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375678+0000", 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109231 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.391 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279524 5.d 5:bc4f5c46:::benchmark_data_smithi069_31227_object107867:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.372463+0000", 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0043041210000000002, 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044442600000000002, 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279524 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372463+0000", 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372463+0000", 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372462+0000", 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372467+0000", 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8629999999999999e-06 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372477+0000", 2024-04-26T12:16:41.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0383999999999999e-05 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372484+0000", 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3160000000000002e-06 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372524+0000", 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0092000000000002e-05 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372681+0000", 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015731299999999999 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279525 5.9 5:944ad556:::benchmark_data_smithi069_31227_object107868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.372590+0000", 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.004177287, 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043523900000000003, 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279525 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372590+0000", 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372590+0000", 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372589+0000", 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372593+0000", 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372600+0000", 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5000000000000002e-06 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372606+0000", 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372648+0000", 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2221000000000001e-05 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372795+0000", 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014674299999999999 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279526 5.e 5.e42961ee (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.372754+0000", 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040130440000000003, 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0042291660000000003, 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279526 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372754+0000", 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372754+0000", 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372754+0000", 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372757+0000", 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3050000000000001e-06 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372765+0000", 2024-04-26T12:16:41.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.372770+0000", 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.288e-06 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279531 5.9 5:946dca1d:::benchmark_data_smithi069_31227_object107874:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.374601+0000", 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002166528, 2024-04-26T12:16:41.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024118999999999998, 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279531 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374601+0000", 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374601+0000", 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374600+0000", 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374604+0000", 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1479999999999999e-06 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374613+0000", 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.524e-06 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374619+0000", 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4280000000000001e-06 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374658+0000", 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9280999999999999e-05 2024-04-26T12:16:41.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374838+0000", 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000179815 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279532 5.4 5:2ca55e9d:::benchmark_data_smithi069_31227_object107875:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.374630+0000", 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021373099999999999, 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024179710000000001, 2024-04-26T12:16:41.407 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279532 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374630+0000", 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374630+0000", 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374629+0000", 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374632+0000", 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374638+0000", 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1589999999999998e-06 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374643+0000", 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374730+0000", 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6598e-05 2024-04-26T12:16:41.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374848+0000", 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000118196 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374926+0000", 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7416999999999994e-05 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.411 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279533 5.d 5:b76eab84:::benchmark_data_smithi069_31227_object107876:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.374768+0000", 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0019994209999999999, 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023258250000000001, 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279533 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374768+0000", 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374768+0000", 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374767+0000", 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374770+0000", 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.208e-06 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374784+0000", 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.331e-05 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374788+0000", 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1450000000000001e-06 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374813+0000", 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5284999999999999e-05 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.374916+0000", 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102685 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.415 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279534 5.e 5.e03a603e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.375318+0000", 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0014487359999999999, 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018268570000000001, 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279534 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375318+0000", 2024-04-26T12:16:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375318+0000", 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375318+0000", 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375323+0000", 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9609999999999996e-06 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375331+0000", 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.1799999999999996e-06 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.375337+0000", 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.302e-06 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:279513 5.e e51/16)", 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.376845+0000", 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9999223, 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00032716499999999998, 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.376845+0000", 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.376845+0000", 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.376845+0000", 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.376849+0000", 2024-04-26T12:16:41.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.376860+0000", 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1654000000000001e-05 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.376865+0000", 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3699999999999997e-06 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.421 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:279508 5.e 5:711e6b8f:::benchmark_data_smithi069_31227_object107851:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:41.367810+0000", 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0089574279999999999, 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0093885319999999998, 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:41.422 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 279508 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.367810+0000", 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.367810+0000", 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:41.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.367809+0000", 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.367813+0000", 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.367820+0000", 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2230000000000001e-06 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.367825+0000", 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1030000000000001e-06 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.367863+0000", 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7959e-05 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.368034+0000", 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017084000000000001 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.368133+0000", 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9615000000000001e-05 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:41.373180+0000", 2024-04-26T12:16:41.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050463039999999997 2024-04-26T12:16:41.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.427 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:41.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:41.427 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:41.427 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:16:41.427 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:41.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:41.438 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:41.437+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:41.445 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:41.538 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:41.537+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:41.569 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:41.570 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:41.570 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:41.570 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:41.570 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:41.570 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:41.571 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:41.571 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:41.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:41.589 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:41.589 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:41.591 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:41.592 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:41.666 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:41.665+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:41.741 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:41.740+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:41.763 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:41.763 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:41.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:41.842 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:41.841+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:41.906 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:16:41.930 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:41.931 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:41.943 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:41.941+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:41.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:42.044 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:42.042+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:42.137 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:42.138 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:42.145 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:42.143+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:42.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:42.245 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:42.244+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:42.344 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:42.344 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:42.346 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:42.345+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:42.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:42.447 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:42.446+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:42.501 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:42.502 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:42.514 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:42.557 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:42.556+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:42.650 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:42.649+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:42.652 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:42.653 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:42.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:42.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-26T12:16:42.751 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:42.750+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:42.849 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:42.849 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:42.852 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:42.851+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:42.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:42.953 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:42.952+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:43.013 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:43.013 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:43.025 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:43.070 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:43.069+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:43.155 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:43.153+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:43.170 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:43.170 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:43.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:43.270 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:43.268+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:43.356 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:43.355+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:43.378 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:43.378 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:43.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:43.458 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:43.456+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:43.532 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:43.532 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:43.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:43.558 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:43.557+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:43.592 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:43.659 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:43.658+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:43.690 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:43.690 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:43.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:43.714 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:43.715 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:43.715 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:43.732 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:43.733 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:43.735 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:43.736 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:43.761 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:43.759+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:43.840 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.202729688999995, 2024-04-26T12:16:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.842 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:43.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.851 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.201614520999996, 2024-04-26T12:16:43.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:43.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:43.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.859 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:43.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:43.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.863 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.201341936999995, 2024-04-26T12:16:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.864 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.868 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:43.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.200075380000001, 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:43.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:43.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.878 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.199867932000004, 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:43.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.884 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.199442447999999, 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.885 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:43.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:43.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.199171508000006, 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.890 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.892 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.895 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 67.198097508999993, 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.896 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:43.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:43.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:43.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.520438716999998, 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.909 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.514178938999997, 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.910 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:43.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.511752354999999, 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:43.915 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:43.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:43.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.511464568999997, 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:43.921 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:43.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:43.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:43.926 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.511233556000001, 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:43.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:43.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:43.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 32.508459418000001, 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:43.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:43.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.936 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.938 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.927336442000001, 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.939 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:43.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:43.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.927242557, 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:43.944 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:43.946 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.947 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.948 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.923925602000001, 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:43.950 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.951 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:43.952 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.953 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.954 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.922709477000001, 2024-04-26T12:16:43.956 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.957 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:43.958 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:43.959 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.922691797999999, 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:43.962 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.963 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.964 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:43.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 28.919113060000001, 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:43.968 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:43.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:43.971 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:43.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.973 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:43.974 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:43.974 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:43.974 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:16:43.975 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:43.973+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:43.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:44.076 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:44.075+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287594 5.a 5:5eacc236:::benchmark_data_smithi069_31227_object115937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.118727+0000", 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0053315569999999998, 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053536169999999998, 2024-04-26T12:16:44.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287594 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.118727+0000", 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.118727+0000", 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.118726+0000", 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.118730+0000", 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:16:44.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.118752+0000", 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1563999999999999e-05 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.118759+0000", 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4760000000000003e-06 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.119356+0000", 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059763800000000005 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.119533+0000", 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176365 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.119655+0000", 2024-04-26T12:16:44.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012288699999999999 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.121346+0000", 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016904159999999999 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:287596 5.8 e52/16 5:1563c3e6:::benchmark_data_smithi069_31227_object115939:head v 52'18042, mlcod=52'18038)", 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.120044+0000", 2024-04-26T12:16:44.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040140159999999996, 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041197259999999998, 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.120044+0000", 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.120044+0000", 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.120044+0000", 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.120048+0000", 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.963e-06 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.120055+0000", 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5299999999999999e-06 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.120063+0000", 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4569999999999999e-06 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.122138+0000", 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002075098 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.122156+0000", 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8159e-05 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287603 5.5 5:ad2c3e54:::benchmark_data_smithi069_31227_object115946:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.123888+0000", 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000169832, 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032088100000000002, 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:44.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287603 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.123888+0000", 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.123888+0000", 2024-04-26T12:16:44.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.123888+0000", 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.123892+0000", 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1849999999999997e-06 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.123901+0000", 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3889999999999994e-06 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.123908+0000", 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8399999999999997e-06 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.123951+0000", 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3248999999999999e-05 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124099+0000", 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014770199999999999 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:287590 5.a e52/16 ondisk, result = 0)", 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124097+0000", 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999614, 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015989699999999999, 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:44.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124097+0000", 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124097+0000", 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124096+0000", 2024-04-26T12:16:44.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124104+0000", 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3860000000000001e-06 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124113+0000", 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8119999999999997e-06 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124123+0000", 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0764000000000001e-05 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124167+0000", 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3649000000000002e-05 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124176+0000", 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5529999999999993e-06 2024-04-26T12:16:44.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287606 5.7 5:ed20cd8f:::benchmark_data_smithi069_31227_object115949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124114+0000", 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999442, 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000194957, 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287606 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124114+0000", 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124114+0000", 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124113+0000", 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124117+0000", 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3229999999999999e-06 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124130+0000", 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2155e-05 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124137+0000", 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3250000000000002e-06 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124184+0000", 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6656000000000002e-05 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:287594 5.a e52/16 ondisk, result = 0)", 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124138+0000", 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999199, 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022962699999999999, 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124138+0000", 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124138+0000", 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124138+0000", 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124140+0000", 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5660000000000001e-06 2024-04-26T12:16:44.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124147+0000", 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124151+0000", 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5000000000000001e-06 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124328+0000", 2024-04-26T12:16:44.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017712399999999999 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124336+0000", 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1470000000000004e-06 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287607 5.2 5:4173242d:::benchmark_data_smithi069_31227_object115950:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124154+0000", 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999046, 2024-04-26T12:16:44.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000272203, 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287607 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124154+0000", 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124154+0000", 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124153+0000", 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124156+0000", 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0939999999999999e-06 2024-04-26T12:16:44.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124164+0000", 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6040000000000004e-06 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124169+0000", 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124342+0000", 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017256800000000001 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287608 5.2 5.4f01ee42 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124174+0000", 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998841, 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031031500000000003, 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:44.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287608 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124174+0000", 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124174+0000", 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124174+0000", 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124176+0000", 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2680000000000001e-06 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124182+0000", 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5899999999999998e-06 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124188+0000", 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7300000000000002e-06 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287610 5.1 5:8165aef5:::benchmark_data_smithi069_31227_object115953:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124245+0000", 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998136, 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029010100000000002, 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287610 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124245+0000", 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124245+0000", 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124244+0000", 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124248+0000", 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3730000000000001e-06 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124256+0000", 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5369999999999997e-06 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124263+0000", 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5780000000000004e-06 2024-04-26T12:16:44.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124315+0000", 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1734999999999998e-05 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124493+0000", 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017892 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287611 5.5 5.b8970705 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124272+0000", 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997859, 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030763900000000001, 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287611 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124272+0000", 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124272+0000", 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124272+0000", 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124274+0000", 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3819999999999998e-06 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124280+0000", 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.083e-06 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124305+0000", 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5037000000000001e-05 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:287612 5.a 5.457863ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124319+0000", 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997396, 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031391299999999997, 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 287612 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124319+0000", 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124319+0000", 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124318+0000", 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124321+0000", 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9550000000000001e-06 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124329+0000", 2024-04-26T12:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4590000000000001e-06 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124334+0000", 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6640000000000003e-06 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:287605 5.b e52/16 5:de42227b:::benchmark_data_smithi069_31227_object115948:head v 52'18082, mlcod=52'18080)", 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124462+0000", 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9995961, 2024-04-26T12:16:44.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022495699999999999, 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124462+0000", 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124462+0000", 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124462+0000", 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124468+0000", 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6000000000000003e-06 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124477+0000", 2024-04-26T12:16:44.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9439999999999994e-06 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124483+0000", 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124521+0000", 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8337000000000002e-05 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124541+0000", 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9593e-05 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:287604 5.8 e52/16)", 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124575+0000", 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9994836, 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000166885, 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124575+0000", 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124575+0000", 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124574+0000", 2024-04-26T12:16:44.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124578+0000", 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124588+0000", 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8709999999999992e-06 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124594+0000", 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.835e-06 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:287609 5.4 e52/16 5:2c3de491:::benchmark_data_smithi069_31227_object115952:head v 52'17743, mlcod=52'17741)", 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124614+0000", 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9994445, 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017672599999999999, 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124614+0000", 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124614+0000", 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124614+0000", 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124617+0000", 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6519999999999999e-06 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124625+0000", 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1680000000000004e-06 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124630+0000", 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4089999999999996e-06 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124738+0000", 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108661 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124764+0000", 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5588e-05 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:287613 5.e e52/16)", 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.124686+0000", 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9993725, 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015861900000000001, 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124686+0000", 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124686+0000", 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124685+0000", 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124692+0000", 2024-04-26T12:16:44.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.409e-06 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124699+0000", 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.124704+0000", 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.763e-06 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.183 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:44.183 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 15 2024-04-26T12:16:44.183 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:44.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:44.185 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:44.183+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:44.285 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:44.284+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:44.374 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:44.375 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:44.386 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:44.385+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:44.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:44.487 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:44.486+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:44.588 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.349608818999997, 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.950552997000003, 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.546139906999997, 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.228224963000002, 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.227872402000003, 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.224081492000003, 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.101295448999998, 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.926455765999997, 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.674427073, 2024-04-26T12:16:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.674191557, 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.673013494999999, 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.672430872, 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.671705945999999, 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.671671011000001, 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.671002661999999, 2024-04-26T12:16:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.670784664999999, 2024-04-26T12:16:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.66953483, 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:44.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:44.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.668657582000002, 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:44.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:44.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.694 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4457205559999995, 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:44.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.28717336799999998, 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:44.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:44.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:44.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:44.705 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:44.706 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:44.587+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:44.706 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:44.708 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:44.706+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:44.808 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:44.806+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:44.850 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:44.850 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289692 5.9 5:9ffa053f:::benchmark_data_smithi069_31227_object118035:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.838108+0000", 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0070657089999999999, 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070836390000000001, 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289692 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.851 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838108+0000", 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838108+0000", 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838107+0000", 2024-04-26T12:16:44.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838111+0000", 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8229999999999997e-06 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838118+0000", 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5299999999999999e-06 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838123+0000", 2024-04-26T12:16:44.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7049999999999998e-06 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838164+0000", 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0865000000000003e-05 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838333+0000", 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000169436 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.854 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289694 5.d 5:b3b1400c:::benchmark_data_smithi069_31227_object118037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.838159+0000", 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0070144150000000004, 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0070743960000000002, 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289694 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.855 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838159+0000", 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838159+0000", 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838158+0000", 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838161+0000", 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3159999999999999e-06 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838165+0000", 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5480000000000003e-06 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838169+0000", 2024-04-26T12:16:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3730000000000001e-06 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838208+0000", 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9128999999999998e-05 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.858 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838376+0000", 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000167994 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:289693 5.a e52/16 5:5f427e92:::benchmark_data_smithi069_31227_object118036:head v 52'17957, mlcod=52'17955)", 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.838400+0000", 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0067736619999999997, 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0068788749999999996, 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:44.859 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838400+0000", 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838400+0000", 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838399+0000", 2024-04-26T12:16:44.860 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838404+0000", 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2799999999999997e-06 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838409+0000", 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4330000000000003e-06 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838412+0000", 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0570000000000001e-06 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838446+0000", 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4180000000000001e-05 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.838465+0000", 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8567999999999999e-05 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.862 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289697 5.0 5:09f0da93:::benchmark_data_smithi069_31227_object118040:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.840246+0000", 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049272250000000004, 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050750530000000004, 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289697 2024-04-26T12:16:44.863 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840246+0000", 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840246+0000", 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.864 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840245+0000", 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840250+0000", 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:16:44.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840258+0000", 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5709999999999998e-06 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840263+0000", 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0730000000000004e-06 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.866 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840294+0000", 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1145000000000001e-05 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840404+0000", 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010919100000000001 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840462+0000", 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8856e-05 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289700 5.0 5:06215e3b:::benchmark_data_smithi069_31227_object118043:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.840277+0000", 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048964239999999999, 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050874730000000003, 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289700 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.868 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840277+0000", 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840277+0000", 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840276+0000", 2024-04-26T12:16:44.869 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840279+0000", 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7410000000000001e-06 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840284+0000", 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1250000000000001e-06 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.870 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840289+0000", 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.276e-06 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842287+0000", 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001997586 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842442+0000", 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015453400000000001 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.871 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842552+0000", 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000110722 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289701 5.e 5:78f7c3ae:::benchmark_data_smithi069_31227_object118044:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.840295+0000", 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0048782139999999996, 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005120449, 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.872 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289701 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840295+0000", 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.873 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840295+0000", 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840295+0000", 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840297+0000", 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4889999999999998e-06 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.874 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.875 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.875 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840303+0000", 2024-04-26T12:16:44.875 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.015e-06 2024-04-26T12:16:44.875 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.875 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840308+0000", 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6789999999999996e-06 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840352+0000", 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3748999999999997e-05 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840527+0000", 2024-04-26T12:16:44.877 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017551200000000001 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.840635+0000", 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010830199999999999 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843216+0000", 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002580354 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.878 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289705 5.b 5:d069a76b:::benchmark_data_smithi069_31227_object118048:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.841150+0000", 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040230919999999998, 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043440079999999999, 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289705 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.879 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841150+0000", 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841150+0000", 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841150+0000", 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.880 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841153+0000", 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841160+0000", 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5190000000000003e-06 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.881 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841164+0000", 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8850000000000001e-06 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841203+0000", 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9031e-05 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841351+0000", 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014796399999999999 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.882 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.841455+0000", 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010412399999999999 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289706 5.8 5:1d729963:::benchmark_data_smithi069_31227_object118049:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.842207+0000", 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0029660189999999999, 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003359679, 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.883 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289706 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842207+0000", 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842207+0000", 2024-04-26T12:16:44.884 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842206+0000", 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842212+0000", 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9630000000000003e-06 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842226+0000", 2024-04-26T12:16:44.885 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3906999999999999e-05 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842233+0000", 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842273+0000", 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9882999999999997e-05 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842412+0000", 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000138632 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.842505+0000", 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3103999999999995e-05 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289707 5.0 5:0bf1bba1:::benchmark_data_smithi069_31227_object118050:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.887 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.843062+0000", 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021111480000000002, 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002577378, 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289707 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843062+0000", 2024-04-26T12:16:44.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843062+0000", 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843061+0000", 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843066+0000", 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1080000000000001e-06 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843078+0000", 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2021000000000001e-05 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843085+0000", 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6950000000000003e-06 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843866+0000", 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000781013 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.843981+0000", 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000114708 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.844044+0000", 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3039000000000004e-05 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.891 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289710 5.4 5:260cb530:::benchmark_data_smithi069_31227_object118053:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.845374+0000", 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997993, 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000338983, 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.892 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289710 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845374+0000", 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845374+0000", 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845373+0000", 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845378+0000", 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3250000000000001e-06 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845386+0000", 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6470000000000004e-06 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845391+0000", 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.532e-06 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845430+0000", 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9569e-05 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845645+0000", 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021467 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.895 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289711 5.b 5:d7064153:::benchmark_data_smithi069_31227_object118054:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.845398+0000", 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997754, 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00038629300000000001, 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289711 2024-04-26T12:16:44.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845398+0000", 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845398+0000", 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845398+0000", 2024-04-26T12:16:44.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845400+0000", 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845412+0000", 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1321000000000001e-05 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845417+0000", 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2170000000000002e-06 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845454+0000", 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7489e-05 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845620+0000", 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016622699999999999 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845729+0000", 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010843799999999999 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289712 5.0 5:0c0524c0:::benchmark_data_smithi069_31227_object118055:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.845432+0000", 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997411, 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00042729900000000002, 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:44.900 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289712 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845432+0000", 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845432+0000", 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845432+0000", 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845435+0000", 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.943e-06 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845442+0000", 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8050000000000001e-06 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845447+0000", 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3580000000000002e-06 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845481+0000", 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3640999999999999e-05 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:44.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845625+0000", 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000144709 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845728+0000", 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102268 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:289705 5.b e52/16)", 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.845678+0000", 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9994955, 2024-04-26T12:16:44.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025029700000000002, 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845678+0000", 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845678+0000", 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845677+0000", 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845682+0000", 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3800000000000004e-06 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845690+0000", 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0860000000000002e-06 2024-04-26T12:16:44.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845695+0000", 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7760000000000003e-06 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289715 5.d 5:b63a5466:::benchmark_data_smithi069_31227_object118058:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.845885+0000", 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9992881, 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010200300000000001, 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.907 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289715 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845885+0000", 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845885+0000", 2024-04-26T12:16:44.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845885+0000", 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845889+0000", 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845895+0000", 2024-04-26T12:16:44.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5830000000000003e-06 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845900+0000", 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6120000000000001e-06 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845936+0000", 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5777e-05 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:289718 5.f 5.97f33a4f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:44.845978+0000", 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9991951, 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1601999999999996e-05, 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 289718 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:44.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845978+0000", 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845978+0000", 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845978+0000", 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845982+0000", 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9509999999999999e-06 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845992+0000", 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0570999999999999e-05 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.845998+0000", 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6879999999999996e-06 2024-04-26T12:16:44.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:44.846037+0000", 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8933000000000001e-05 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 15 2024-04-26T12:16:44.914 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:44.916 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:44.916 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:44.913+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:16:45.016 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:45.014+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:45.055 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:45.055 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:45.056 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:45.056 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:45.056 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:45.067 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:45.118 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:45.115+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:45.208 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:45.208 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:45.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:45.208 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.571710038000006, 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:45.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.570594869999994, 2024-04-26T12:16:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:45.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:45.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.570322286000007, 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.219 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:45.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.224 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.569055728999999, 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:45.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:45.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.568848281000001, 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:45.230 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:45.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:45.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.235 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.568422796999997, 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.236 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:45.240 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.568151857000004, 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.241 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:45.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 68.567077858000005, 2024-04-26T12:16:45.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:45.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:45.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.889419066000002, 2024-04-26T12:16:45.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:45.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.883159288000002, 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:45.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.261 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:45.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.880732704000003, 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.266 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:45.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:45.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.880444918000002, 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.272 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.275 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.880213904999998, 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.277 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:45.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.877439766999998, 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:45.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:45.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.296316790999999, 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:45.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:45.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.296222906000001, 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:45.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:45.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.292905951000002, 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:45.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:45.307 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.291689825999999, 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:45.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.313 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.291672147, 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:45.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:45.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.319 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 30.288093408999998, 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:45.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:45.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:45.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:45.325 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:45.327 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:45.325+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:45.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:45.428 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:45.425+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:45.480 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:291516 5.a 5:5078dffe:::benchmark_data_smithi069_31227_object119859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.471136+0000", 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0070613159999999998, 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070857860000000002, 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 291516 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471136+0000", 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471136+0000", 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471135+0000", 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471139+0000", 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-06 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471146+0000", 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0589999999999997e-06 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471153+0000", 2024-04-26T12:16:45.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310000000000001e-06 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471191+0000", 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7221999999999997e-05 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471323+0000", 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000131827 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:45.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.471440+0000", 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117655 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.474988+0000", 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00354828 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:291522 5.b e53/16 5:d60ee919:::benchmark_data_smithi069_31227_object119865:head v 53'18326, mlcod=53'18323)", 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.473763+0000", 2024-04-26T12:16:45.485 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0044343450000000001, 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045440710000000002, 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473763+0000", 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473763+0000", 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473762+0000", 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473767+0000", 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-04-26T12:16:45.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473774+0000", 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473778+0000", 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2400000000000001e-06 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473807+0000", 2024-04-26T12:16:45.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8192999999999999e-05 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.473823+0000", 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6218999999999998e-05 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:291526 5.6 5:6f680126:::benchmark_data_smithi069_31227_object119869:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.475403+0000", 2024-04-26T12:16:45.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027947599999999999, 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029646479999999998, 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 291526 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475403+0000", 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475403+0000", 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475402+0000", 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475407+0000", 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9230000000000001e-06 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475416+0000", 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475422+0000", 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:16:45.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475471+0000", 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8822000000000001e-05 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475587+0000", 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116792 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:291527 5.6 5:62f971f0:::benchmark_data_smithi069_31227_object119870:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.475431+0000", 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002766218, 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030013800000000001, 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 291527 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475431+0000", 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475431+0000", 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475431+0000", 2024-04-26T12:16:45.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475433+0000", 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475453+0000", 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9811999999999999e-05 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475458+0000", 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1710000000000001e-06 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.478148+0000", 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026900119999999999 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.478304+0000", 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155644 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:291525 5.b e53/16 5:de2a1357:::benchmark_data_smithi069_31227_object119868:head v 53'18327, mlcod=53'18323)", 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.475460+0000", 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027369370000000001, 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030290730000000002, 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475460+0000", 2024-04-26T12:16:45.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475460+0000", 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475460+0000", 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475465+0000", 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.203e-06 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475473+0000", 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475479+0000", 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8590000000000001e-06 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475756+0000", 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027716200000000001 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475777+0000", 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1101e-05 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:291529 5.7 5:e949a962:::benchmark_data_smithi069_31227_object119872:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:16:45.501 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.475984+0000", 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022134279999999999, 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025621089999999999, 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 291529 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475984+0000", 2024-04-26T12:16:45.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475984+0000", 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475983+0000", 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475988+0000", 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6120000000000001e-06 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.475997+0000", 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8480000000000007e-06 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476001+0000", 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5979999999999999e-06 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476036+0000", 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4272e-05 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476175+0000", 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013988600000000001 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:291531 5.6 5.f3eabf26 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:16:45.505 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.476014+0000", 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0021837760000000001, 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025937149999999999, 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 291531 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476014+0000", 2024-04-26T12:16:45.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476014+0000", 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476013+0000", 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476015+0000", 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2840000000000001e-06 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476020+0000", 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9180000000000002e-06 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476025+0000", 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7419999999999997e-06 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:291530 5.4 e53/16 5:2bc409d0:::benchmark_data_smithi069_31227_object119873:head v 53'17989, mlcod=53'17987)", 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.476358+0000", 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0018390839999999999, 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023049809999999998, 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476358+0000", 2024-04-26T12:16:45.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476358+0000", 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476358+0000", 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476363+0000", 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476371+0000", 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476375+0000", 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7019999999999999e-06 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476407+0000", 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2023000000000002e-05 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.476419+0000", 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2669e-05 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.512 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:291533 5.b e53/16 5:d5225f52:::benchmark_data_smithi069_31227_object119876:head v 53'18328, mlcod=53'18324)", 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.477060+0000", 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011372369999999999, 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016582210000000001, 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477060+0000", 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477060+0000", 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477059+0000", 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477067+0000", 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8220000000000007e-06 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477078+0000", 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0801999999999999e-05 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477084+0000", 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6030000000000004e-06 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477233+0000", 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014886899999999999 2024-04-26T12:16:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477249+0000", 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6722e-05 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:291535 5.7 5:e6644ff2:::benchmark_data_smithi069_31227_object119878:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:45.477066+0000", 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011313060000000001, 2024-04-26T12:16:45.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017078740000000001, 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 291535 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477066+0000", 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477066+0000", 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477065+0000", 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:45.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477070+0000", 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6380000000000003e-06 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477081+0000", 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0995999999999999e-05 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477087+0000", 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.477973+0000", 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088596400000000004 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:45.478142+0000", 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016870000000000001 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 10 2024-04-26T12:16:45.521 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:45.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:45.563 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:45.561+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:45.629 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:45.628+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:45.713 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:45.714 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:45.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:45.730 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:45.729+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:45.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:45.831 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:45.830+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:45.861 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:45.881 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:45.881 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:45.882 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:45.882 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:45.883 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:45.883 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:45.894 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:45.938 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:45.936+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:46.032 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:46.032 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:46.033 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:46.030+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:46.045 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:46.133 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:46.131+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:46.228 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:46.228 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:46.234 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:46.231+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:46.241 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:46.335 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:46.333+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:46.386 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:46.387 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:46.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:46.436 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:46.434+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:46.537 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:46.534+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:46.553 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:46.553 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:46.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:46.651 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:46.649+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:46.738 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:46.735+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:46.758 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:46.758 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:46.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:46.839 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:46.837+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:46.933 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:16:46.940 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:46.938+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:46.965 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:46.966 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:46.977 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:47.041 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:47.038+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:47.119 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:47.119 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:47.131 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:47.172 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:47.170+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:47.242 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:47.241+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:47.311 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:47.311 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:47.324 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:47.343 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:47.342+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:47.444 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:47.443+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:47.463 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:47.463 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:47.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:47.545 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:47.544+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:47.630 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:47.630 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:47.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:47.683 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:47.682+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:47.746 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:47.745+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:47.836 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:47.836 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:47.847 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:47.846+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:47.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:47.884 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:47.926 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:16:47.948 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:47.947+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:48.006 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:48.006 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:48.007 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:48.024 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:48.024 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:48.027 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:48.027 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:48.049 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.812678082999994, 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 71.413622261, 2024-04-26T12:16:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.009209170999995, 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.691294227, 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.690941666000001, 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.687150756000001, 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.564364713000003, 2024-04-26T12:16:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:48.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:48.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.389525030000001, 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:48.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.137496337000002, 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:48.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.137260820999998, 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.136082758999997, 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:48.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:48.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:48.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:48.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.135500135999997, 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.134775210000001, 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:48.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:48.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:48.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.134740274999999, 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.134071925999997, 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:48.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:48.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.133853928999997, 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:48.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:48.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:48.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.132604094000001, 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:48.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.131726845999999, 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:48.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:48.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:48.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.908789819999999, 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:48.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:48.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.750242632, 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:16:48.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.150 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:48.151 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:48.048+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:48.151 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:48.150+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:48.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:48.252 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:48.250+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:48.296 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299650 5.e 5:75f35290:::benchmark_data_smithi069_31227_object127993:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.288911+0000", 2024-04-26T12:16:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058457140000000001, 2024-04-26T12:16:48.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058678430000000002, 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299650 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288911+0000", 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288911+0000", 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288910+0000", 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288916+0000", 2024-04-26T12:16:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5389999999999998e-06 2024-04-26T12:16:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288927+0000", 2024-04-26T12:16:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1562e-05 2024-04-26T12:16:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288933+0000", 2024-04-26T12:16:48.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3430000000000001e-06 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288982+0000", 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8908e-05 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289123+0000", 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000140467 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289184+0000", 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1625999999999996e-05 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299651 5.e 5:7b1eb894:::benchmark_data_smithi069_31227_object127994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.288944+0000", 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058130760000000004, 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058806800000000001, 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.302 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299651 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288944+0000", 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288944+0000", 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288944+0000", 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288946+0000", 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3700000000000002e-06 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288952+0000", 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8950000000000003e-06 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288956+0000", 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3080000000000001e-06 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.290729+0000", 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00177242 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.290885+0000", 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015665000000000001 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291007+0000", 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012228400000000001 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299652 5.4 5:2d156130:::benchmark_data_smithi069_31227_object127995:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.288978+0000", 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0057792570000000003, 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.005885337, 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299652 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288978+0000", 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288978+0000", 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288977+0000", 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288982+0000", 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288992+0000", 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9680000000000001e-06 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.288999+0000", 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:16:48.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289438+0000", 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00043965900000000001 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289621+0000", 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000183189 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289750+0000", 2024-04-26T12:16:48.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012857100000000001 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292188+0000", 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024375070000000002 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299653 5.e 5:794969a8:::benchmark_data_smithi069_31227_object127996:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.289014+0000", 2024-04-26T12:16:48.311 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0057431390000000004, 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058900280000000003, 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299653 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289014+0000", 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289014+0000", 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289013+0000", 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289017+0000", 2024-04-26T12:16:48.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9949999999999999e-06 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289024+0000", 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9149999999999999e-06 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.289029+0000", 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1309999999999997e-06 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292296+0000", 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032665540000000001 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292471+0000", 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000174873 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292598+0000", 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012757600000000001 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.315 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299657 5.8 5:12e96bf2:::benchmark_data_smithi069_31227_object128000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.291430+0000", 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033274379999999998, 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003511045, 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299657 2024-04-26T12:16:48.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291430+0000", 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291430+0000", 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291429+0000", 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291433+0000", 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0219999999999998e-06 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291443+0000", 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6379999999999999e-06 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291448+0000", 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.967e-06 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291480+0000", 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2886999999999999e-05 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291578+0000", 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7492999999999996e-05 2024-04-26T12:16:48.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.291635+0000", 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7003999999999998e-05 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299660 5.e 5:77240dc9:::benchmark_data_smithi069_31227_object128003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.292579+0000", 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021777810000000002, 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024044819999999999, 2024-04-26T12:16:48.320 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299660 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292579+0000", 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292579+0000", 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292579+0000", 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292582+0000", 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9610000000000001e-06 2024-04-26T12:16:48.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292588+0000", 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8629999999999996e-06 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292591+0000", 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5700000000000001e-06 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293975+0000", 2024-04-26T12:16:48.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0013843359999999999 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.294132+0000", 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000156935 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.294249+0000", 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011611 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299661 5.e 5.d7cac71e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.292747+0000", 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0020098350000000002, 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022726909999999999, 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299661 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292747+0000", 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292747+0000", 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292746+0000", 2024-04-26T12:16:48.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292751+0000", 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292763+0000", 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292768+0000", 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0069999999999997e-06 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:299650 5.e e54/16)", 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.292904+0000", 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001852799, 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002143893, 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292904+0000", 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292904+0000", 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292904+0000", 2024-04-26T12:16:48.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292908+0000", 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1740000000000002e-06 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292916+0000", 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.292923+0000", 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299665 5.e 5.5ec062de (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.293131+0000", 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016263530000000001, 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001941143, 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299665 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293131+0000", 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293131+0000", 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293130+0000", 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293134+0000", 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.002e-06 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293142+0000", 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4810000000000006e-06 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293147+0000", 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4469999999999999e-06 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299666 5.f 5:f47f98cd:::benchmark_data_smithi069_31227_object128009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.293155+0000", 2024-04-26T12:16:48.334 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0016021659999999999, 2024-04-26T12:16:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019450139999999999, 2024-04-26T12:16:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.335 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.337 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299666 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293155+0000", 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293155+0000", 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293155+0000", 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293156+0000", 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293161+0000", 2024-04-26T12:16:48.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4839999999999998e-06 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293164+0000", 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.819e-06 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293195+0000", 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0936999999999999e-05 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293353+0000", 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015824900000000001 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299667 5.b 5:de88d982:::benchmark_data_smithi069_31227_object128010:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.293170+0000", 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0015873759999999999, 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019634380000000001, 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.341 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299667 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293170+0000", 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293170+0000", 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293169+0000", 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293171+0000", 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.885e-06 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293175+0000", 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1230000000000002e-06 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293178+0000", 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293215+0000", 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7023000000000001e-05 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293364+0000", 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014866099999999999 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293425+0000", 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1439999999999995e-05 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:299668 5.8 5:1d0fd1af:::benchmark_data_smithi069_31227_object128011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:48.293186+0000", 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0015708569999999999, 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019829650000000002, 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 299668 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293186+0000", 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293186+0000", 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293186+0000", 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293188+0000", 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293194+0000", 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.677e-06 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293198+0000", 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6229999999999996e-06 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293229+0000", 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0307999999999998e-05 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293395+0000", 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016595499999999999 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:48.293495+0000", 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000100274 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 12 2024-04-26T12:16:48.350 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:48.351 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:48.353 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:48.351+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:48.454 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:48.452+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:48.497 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:48.498 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:48.498 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:48.498 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:48.498 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:48.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:48.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-26T12:16:48.595 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:48.594+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:48.655 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:48.654+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:48.692 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:48.692 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.055579902000005, 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.693 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.694 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.696 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.697 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.054464734000007, 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.698 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.699 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.700 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:48.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:48.702 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.054192150000006, 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.703 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:48.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:48.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:48.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.052925592999998, 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.709 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:48.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.052718145, 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.714 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.715 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:48.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.052292660999996, 2024-04-26T12:16:48.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:48.722 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.724 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.052021721000003, 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:48.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.726 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:48.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 72.050947722000004, 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.373288930000001, 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:48.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:48.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.740 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.367029152000001, 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:48.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.364602568000002, 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.364314782000001, 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:48.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:48.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.760 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.364083768999997, 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:48.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:48.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:48.766 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 37.361309630999997, 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:48.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.771 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.772 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.780186655000001, 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:48.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:48.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:48.778 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.780092770000003, 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:48.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:48.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:48.784 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.776775815000001, 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:48.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:48.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.775559690000001, 2024-04-26T12:16:48.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:48.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.793 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:48.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.775542010999999, 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:48.796 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:48.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:48.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 33.771963272999997, 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:48.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:48.807 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.808 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.808 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.808 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:48.808 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:48.808 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:48.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:48.810 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:48.808+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:48.910 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:48.908+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:48.964 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:301646 5.6 5:68892b33:::benchmark_data_smithi069_31227_object129989:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.955767+0000", 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0073436819999999998, 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073676169999999999, 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 301646 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.955767+0000", 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.955767+0000", 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.955766+0000", 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.955771+0000", 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6029999999999998e-06 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.955780+0000", 2024-04-26T12:16:48.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4149999999999999e-06 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.955786+0000", 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5540000000000003e-06 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957597+0000", 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018110470000000001 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957742+0000", 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144874 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:301643 5.e e54/16 5:7dead941:::benchmark_data_smithi069_31227_object129986:head v 54'18909, mlcod=54'18906)", 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.956198+0000", 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.006912563, 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070125989999999996, 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.956198+0000", 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.956198+0000", 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.956198+0000", 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.956204+0000", 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.998e-06 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.956213+0000", 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9679999999999995e-06 2024-04-26T12:16:48.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.956218+0000", 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6509999999999998e-06 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957505+0000", 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012868129999999999 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957522+0000", 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6452000000000001e-05 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:301644 5.e e54/16 5:7277fd13:::benchmark_data_smithi069_31227_object129987:head v 54'18910, mlcod=54'18906)", 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.957110+0000", 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0060004840000000004, 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061607420000000003, 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957110+0000", 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957110+0000", 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957110+0000", 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957118+0000", 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2840000000000006e-06 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957128+0000", 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0135999999999999e-05 2024-04-26T12:16:48.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.957134+0000", 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5060000000000003e-06 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960208+0000", 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003074528 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960226+0000", 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8063e-05 2024-04-26T12:16:48.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:301653 5.6 5:65d5c524:::benchmark_data_smithi069_31227_object129996:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.958426+0000", 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0046850190000000003, 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049020340000000004, 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 301653 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.958426+0000", 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.958426+0000", 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.958425+0000", 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.958429+0000", 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7120000000000002e-06 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.958437+0000", 2024-04-26T12:16:48.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6490000000000008e-06 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.958441+0000", 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6299999999999997e-06 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963134+0000", 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004692926 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:301654 5.e e54/16 5:77ac005b:::benchmark_data_smithi069_31227_object129997:head v 54'18911, mlcod=54'18906)", 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.959561+0000", 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0035499609999999999, 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038379040000000001, 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.959561+0000", 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.959561+0000", 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.959561+0000", 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.959565+0000", 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.959571+0000", 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5520000000000001e-06 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.959576+0000", 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4429999999999996e-06 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961780+0000", 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022045749999999999 2024-04-26T12:16:48.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961798+0000", 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7791999999999998e-05 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:301656 5.e e54/16 5:7c825975:::benchmark_data_smithi069_31227_object129999:head v 54'18912, mlcod=54'18906)", 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.960936+0000", 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00217512, 2024-04-26T12:16:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025174120000000001, 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960936+0000", 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960936+0000", 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960935+0000", 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960941+0000", 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.553e-06 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960961+0000", 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0095999999999999e-05 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.960966+0000", 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6219999999999997e-06 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963169+0000", 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022020920000000001 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963185+0000", 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6844999999999999e-05 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:301662 5.6 5.483c74d6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.961227+0000", 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001883921, 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002279915, 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 301662 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961227+0000", 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961227+0000", 2024-04-26T12:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961226+0000", 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961230+0000", 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0239999999999999e-06 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961240+0000", 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0000000000000001e-05 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961246+0000", 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:301661 5.4 e54/16 5:29b48af9:::benchmark_data_smithi069_31227_object130004:head v 54'18602, mlcod=54'18600)", 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.961657+0000", 2024-04-26T12:16:48.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0014543169999999999, 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001901682, 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961657+0000", 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961657+0000", 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961656+0000", 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961662+0000", 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6729999999999997e-06 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961671+0000", 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2269999999999999e-06 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961677+0000", 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4500000000000001e-06 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961716+0000", 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8677999999999998e-05 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.961736+0000", 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9797e-05 2024-04-26T12:16:48.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:301664 5.8 e54/16 5:13b75e23:::benchmark_data_smithi069_31227_object130007:head v 54'18952, mlcod=54'18949)", 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.962452+0000", 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00065934100000000003, 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001163543, 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962452+0000", 2024-04-26T12:16:48.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962452+0000", 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962451+0000", 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:48.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962456+0000", 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962465+0000", 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0350000000000007e-06 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962472+0000", 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7719999999999997e-06 2024-04-26T12:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962514+0000", 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2484999999999997e-05 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.962530+0000", 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5954999999999999e-05 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:48.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:301667 5.b e54/16 5:df102b3d:::benchmark_data_smithi069_31227_object130010:head v 54'18926, mlcod=54'18924)", 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:48.963085+0000", 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5919e-05, 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058388999999999999, 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963085+0000", 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:48.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963085+0000", 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963085+0000", 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963089+0000", 2024-04-26T12:16:49.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7280000000000003e-06 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963095+0000", 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0800000000000002e-06 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963099+0000", 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963133+0000", 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4014999999999999e-05 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:48.963156+0000", 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2855000000000001e-05 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 10 2024-04-26T12:16:49.002 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:49.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:49.011 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:49.009+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:49.112 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:49.111+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:49.198 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:49.198 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:49.198 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:49.198 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:49.198 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:49.211 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:49.212 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:49.211+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:49.313 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:49.312+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:49.366 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:49.366 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:49.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:49.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:49.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.366 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:49.366 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.128949114999998, 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:49.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.371 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.729893293000003, 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:105209 5.6 5:6416aae6:::benchmark_data_smithi069_31227_object105208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.325480202999998, 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020258101000000001, 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 105209 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037468+0000", 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037467+0000", 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037503+0000", 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6164000000000001e-05 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037512+0000", 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8829999999999995e-06 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.037520+0000", 2024-04-26T12:16:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6820000000000003e-06 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045368+0000", 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078486509999999999 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.045486+0000", 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117513 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057640+0000", 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153794000000001 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057669+0000", 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:39.057726+0000", 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6841e-05 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.007565259000003, 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.383 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:49.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.007212697999996, 2024-04-26T12:16:49.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:49.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:49.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:49.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.003421787999997, 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:49.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.880635744999999, 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:49.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.705796061999997, 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:49.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.453767368999998, 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:49.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:49.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.453531853000001, 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.452353791, 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:49.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:49.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.451771168000001, 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:49.428 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.451046241999997, 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:49.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:49.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.451011307000002, 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:49.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.450342958, 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:49.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.450124961, 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:49.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.448875125999997, 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:49.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:49.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.447997878000002, 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.453 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:49.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.225060852, 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:49.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0665136640000004, 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:49.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:49.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:49.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:16:49.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:49.468 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:49.470 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:49.470 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:49.468+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:49.570 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:49.569+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:49.616 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.616 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303537 5.f 5:fa43f0c2:::benchmark_data_smithi069_31227_object131880:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.608635+0000", 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055894880000000001, 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056138109999999998, 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303537 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608635+0000", 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608635+0000", 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608634+0000", 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608637+0000", 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.988e-06 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608645+0000", 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608650+0000", 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:16:49.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608679+0000", 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8271000000000001e-05 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608818+0000", 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013949700000000001 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303538 5.d 5:b9be4509:::benchmark_data_smithi069_31227_object131881:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.608659+0000", 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055650379999999996, 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056606850000000004, 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303538 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608659+0000", 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608659+0000", 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608659+0000", 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608662+0000", 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8210000000000002e-06 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608668+0000", 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.63e-06 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608674+0000", 2024-04-26T12:16:49.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3070000000000002e-06 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608709+0000", 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4980000000000001e-05 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608863+0000", 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015472399999999999 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.624 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303540 5.4 5:26d23881:::benchmark_data_smithi069_31227_object131883:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.608706+0000", 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055182180000000001, 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0056763079999999997, 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303540 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608706+0000", 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608706+0000", 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608706+0000", 2024-04-26T12:16:49.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608709+0000", 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8779999999999998e-06 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608715+0000", 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5220000000000004e-06 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608720+0000", 2024-04-26T12:16:49.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.164e-06 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.608749+0000", 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8498999999999999e-05 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609357+0000", 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000608246 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:49.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609455+0000", 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7811000000000003e-05 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613292+0000", 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038372390000000001 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303542 5.e 5:7cf75703:::benchmark_data_smithi069_31227_object131885:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.609302+0000", 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0049225650000000003, 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051520940000000003, 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303542 2024-04-26T12:16:49.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609302+0000", 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609302+0000", 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609301+0000", 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609305+0000", 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.641e-06 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609314+0000", 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.0010000000000007e-06 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609319+0000", 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5790000000000003e-06 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609356+0000", 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6806e-05 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609495+0000", 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013890699999999999 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.609595+0000", 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9926000000000005e-05 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613052+0000", 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034566449999999999 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303548 5.e 5:779c2e6b:::benchmark_data_smithi069_31227_object131891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.611342+0000", 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028822240000000001, 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0031831659999999999, 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303548 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611342+0000", 2024-04-26T12:16:49.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611342+0000", 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611341+0000", 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611347+0000", 2024-04-26T12:16:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611355+0000", 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6420000000000007e-06 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611361+0000", 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1340000000000001e-06 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611509+0000", 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000148035 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611663+0000", 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154623 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611772+0000", 2024-04-26T12:16:49.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000108661 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303550 5.9 5:914dfecd:::benchmark_data_smithi069_31227_object131893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.611371+0000", 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0028537359999999999, 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032196669999999998, 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303550 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611371+0000", 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611371+0000", 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611370+0000", 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611372+0000", 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1639999999999999e-06 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611378+0000", 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9220000000000002e-06 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611381+0000", 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.089e-06 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611409+0000", 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8047000000000001e-05 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611531+0000", 2024-04-26T12:16:49.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012174 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303551 5.0 5:0acb5e9c:::benchmark_data_smithi069_31227_object131894:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.611539+0000", 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002685237, 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003110551, 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.643 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303551 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611539+0000", 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611539+0000", 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611538+0000", 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611543+0000", 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0470000000000001e-06 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611553+0000", 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611559+0000", 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2040000000000002e-06 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611586+0000", 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6529999999999998e-05 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611683+0000", 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7800999999999994e-05 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611752+0000", 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8586999999999999e-05 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614316+0000", 2024-04-26T12:16:49.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002564401 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:303547 5.a e54/16 5:5fe55447:::benchmark_data_smithi069_31227_object131890:head v 54'18818, mlcod=54'18816)", 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.611736+0000", 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024888079999999999, 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002985672, 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:49.648 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611736+0000", 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611736+0000", 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611735+0000", 2024-04-26T12:16:49.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611740+0000", 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1830000000000002e-06 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611748+0000", 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7300000000000005e-06 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611754+0000", 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611788+0000", 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3973000000000002e-05 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.611817+0000", 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9583000000000001e-05 2024-04-26T12:16:49.651 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303553 5.e 5:7354a13f:::benchmark_data_smithi069_31227_object131896:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.613264+0000", 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00096062399999999998, 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00151278, 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303553 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613264+0000", 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613264+0000", 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613263+0000", 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613268+0000", 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3480000000000003e-06 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613281+0000", 2024-04-26T12:16:49.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2449999999999999e-05 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613288+0000", 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3490000000000003e-06 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613329+0000", 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0550000000000003e-05 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613516+0000", 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000187231 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613635+0000", 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000119262 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303554 5.b 5:d546bdfe:::benchmark_data_smithi069_31227_object131897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.613338+0000", 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00088638599999999997, 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0015031249999999999, 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303554 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613338+0000", 2024-04-26T12:16:49.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613338+0000", 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613337+0000", 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613343+0000", 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4920000000000001e-06 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613352+0000", 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6350000000000001e-06 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613359+0000", 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1060000000000002e-06 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613399+0000", 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9212999999999999e-05 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613549+0000", 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000150011 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613673+0000", 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000123962 2024-04-26T12:16:49.660 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303555 5.d 5:baf5418c:::benchmark_data_smithi069_31227_object131898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.613370+0000", 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00085398799999999997, 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001535151, 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.661 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303555 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613370+0000", 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613370+0000", 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.662 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613370+0000", 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613373+0000", 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0869999999999998e-06 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613379+0000", 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5289999999999997e-06 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.663 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613384+0000", 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0499999999999999e-06 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613424+0000", 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9538e-05 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613588+0000", 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016417999999999999 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.664 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303558 5.9 5:9cd4d68e:::benchmark_data_smithi069_31227_object131901:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.613905+0000", 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00031925900000000001, 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010682910000000001, 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303558 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613905+0000", 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613905+0000", 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613904+0000", 2024-04-26T12:16:49.666 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613909+0000", 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7960000000000003e-06 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613921+0000", 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.223e-05 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613928+0000", 2024-04-26T12:16:49.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4659999999999996e-06 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.613963+0000", 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5602000000000002e-05 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614098+0000", 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013476199999999999 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.668 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:303559 5.8 5:1c748a47:::benchmark_data_smithi069_31227_object131902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:49.614092+0000", 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.000132022, 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00094013699999999996, 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 303559 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614092+0000", 2024-04-26T12:16:49.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614092+0000", 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614092+0000", 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614096+0000", 2024-04-26T12:16:49.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1110000000000001e-06 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614104+0000", 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4840000000000004e-06 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614111+0000", 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3380000000000001e-06 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614146+0000", 2024-04-26T12:16:49.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5151000000000003e-05 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614720+0000", 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00057471499999999995 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:49.614780+0000", 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9428000000000001e-05 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:49.672 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 13 2024-04-26T12:16:49.673 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:49.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:49.675 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:49.672+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:49.777 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:49.774+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:49.856 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:49.856 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:49.856 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:49.857 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:49.857 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:49.869 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:49.910 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:49.909+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:49.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:16:49.976 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:49.975+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:50.028 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:50.058 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:50.058 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.421369717999994, 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.063 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.420254549999996, 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:50.068 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.419981965999995, 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:50.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.418715409000001, 2024-04-26T12:16:50.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:50.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.418507961000003, 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.080 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:50.081 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.082 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:50.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:50.085 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.418082476999999, 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.087 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:50.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.417811537000006, 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:50.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:50.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 73.416737538000007, 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.098 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:50.101 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.739078745999997, 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:50.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:50.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:50.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:50.106 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.732818967999997, 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:50.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:50.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.109 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:50.111 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.730392383999998, 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:50.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:50.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:50.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.117 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.730104597999997, 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:50.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:50.122 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.729873585, 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.127 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.727099447000001, 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:50.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:50.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.132 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:50.133 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.145976470999997, 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:50.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.138 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.145882585999999, 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.139 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.142565630999997, 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.145 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:50.150 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.141349505999997, 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.151 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:50.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:50.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.141331827000002, 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:50.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:50.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 35.137753089, 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:50.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:50.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:50.168 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:50.169 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:50.170 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:50.170 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:50.171 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:50.168+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:50.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:50.172 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:50.172 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:50.174 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:50.175 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:50.270 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:50.269+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:50.320 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:50.320 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:50.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:50.376 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:50.375+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:50.471 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:50.470+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:50.484 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:50.485 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:50.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:50.572 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:50.571+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:50.672 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:50.671+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:50.687 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:50.687 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:50.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:50.773 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:50.772+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:50.842 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:50.842 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:50.855 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:50.874 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:50.873+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:50.934 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:16:50.975 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:50.973+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:51.035 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:51.035 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:51.046 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:51.090 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:51.089+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:51.177 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:51.175+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:51.194 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:51.194 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:51.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:51.278 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:51.276+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:51.354 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:51.354 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:51.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:51.408 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:51.407+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:51.479 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:51.478+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:51.561 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:51.561 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:51.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:51.615 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:51.614+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:51.681 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:51.680+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:51.766 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:51.766 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:51.778 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:51.821 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:51.820+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:51.883 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:51.882+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:51.919 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:51.919 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:51.931 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:51.983 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:51.982+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.085 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:52.083+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.106 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:52.106 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:52.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:52.175 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:52.185 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:52.184+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.261 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:52.261 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:52.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:52.297 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:52.298 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:52.298 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:52.317 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:52.316+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.320 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:52.320 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:52.323 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:52.323 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:52.387 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:52.386+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311716 5.2 5:498f8c7b:::benchmark_data_smithi069_31227_object140059:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.416370+0000", 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0083549709999999992, 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083737029999999997, 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311716 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416370+0000", 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416370+0000", 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416370+0000", 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416374+0000", 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416381+0000", 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000005e-06 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416387+0000", 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417970+0000", 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015823180000000001 2024-04-26T12:16:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.418135+0000", 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165756 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311718 5.a 5:529b894a:::benchmark_data_smithi069_31227_object140061:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.416416+0000", 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0083096950000000006, 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083697609999999999, 2024-04-26T12:16:52.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311718 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416416+0000", 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416416+0000", 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416415+0000", 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416418+0000", 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416424+0000", 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.416429+0000", 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6500000000000004e-06 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.420272+0000", 2024-04-26T12:16:52.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038427380000000001 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.420426+0000", 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015488399999999999 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.420532+0000", 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010573600000000001 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311720 5.6 5:6c817fb9:::benchmark_data_smithi069_31227_object140063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.417314+0000", 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0074110189999999996, 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075098730000000002, 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311720 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417314+0000", 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417314+0000", 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417314+0000", 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417317+0000", 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9380000000000002e-06 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417328+0000", 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417334+0000", 2024-04-26T12:16:52.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:16:52.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419914+0000", 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025806879999999998 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.420048+0000", 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133473 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311722 5.a 5:51797708:::benchmark_data_smithi069_31227_object140065:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.417834+0000", 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0068907860000000003, 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070529390000000003, 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311722 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417834+0000", 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417834+0000", 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417834+0000", 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417838+0000", 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.771e-06 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417848+0000", 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9909999999999997e-06 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.417853+0000", 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1919999999999996e-06 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422958+0000", 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051051320000000001 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.423099+0000", 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014098600000000001 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.423201+0000", 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102538 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:311715 5.8 e55/16 5:1ac492cf:::benchmark_data_smithi069_31227_object140058:head v 55'19593, mlcod=55'19589)", 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.419490+0000", 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0052350019999999999, 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054798470000000004, 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419490+0000", 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419490+0000", 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419490+0000", 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419498+0000", 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2579999999999995e-06 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419508+0000", 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7580000000000004e-06 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419515+0000", 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2620000000000001e-06 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419883+0000", 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036775099999999998 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.419899+0000", 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6160000000000001e-05 2024-04-26T12:16:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311724 5.6 5:65b91917:::benchmark_data_smithi069_31227_object140067:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.421052+0000", 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0036735689999999998, 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003983627, 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311724 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421052+0000", 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421052+0000", 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421051+0000", 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421056+0000", 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1390000000000003e-06 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421067+0000", 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0672e-05 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421074+0000", 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0530000000000001e-06 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421489+0000", 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041485600000000001 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421664+0000", 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017550399999999999 2024-04-26T12:16:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311728 5.6 5:668d70d9:::benchmark_data_smithi069_31227_object140071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.421941+0000", 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027840289999999999, 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031662410000000002, 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311728 2024-04-26T12:16:52.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421941+0000", 2024-04-26T12:16:52.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421941+0000", 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421941+0000", 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421953+0000", 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2211999999999999e-05 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421964+0000", 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1192999999999999e-05 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421975+0000", 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0974e-05 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.423275+0000", 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013001219999999999 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.423416+0000", 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014048899999999999 2024-04-26T12:16:52.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311730 5.a 5:56195b2b:::benchmark_data_smithi069_31227_object140073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.421993+0000", 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00273267, 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031876169999999998, 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311730 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421993+0000", 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421993+0000", 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421992+0000", 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.421995+0000", 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8830000000000002e-06 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422002+0000", 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7959999999999998e-06 2024-04-26T12:16:52.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422007+0000", 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425124+0000", 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031167230000000001 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:311729 5.0 e55/16 5:0f8c5281:::benchmark_data_smithi069_31227_object140072:head v 55'19505, mlcod=55'19502)", 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.422215+0000", 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0025105589999999999, 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030269730000000001, 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422215+0000", 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422215+0000", 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422214+0000", 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422219+0000", 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422229+0000", 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0105999999999999e-05 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422234+0000", 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1989999999999997e-06 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422280+0000", 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5451999999999998e-05 2024-04-26T12:16:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422301+0000", 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1642e-05 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4546.0:311718 5.a e55/16 ondisk, result = 0)", 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.422492+0000", 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00223339, 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002809204, 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422492+0000", 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422492+0000", 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422491+0000", 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422495+0000", 2024-04-26T12:16:52.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.478e-06 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422503+0000", 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5450000000000003e-06 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422508+0000", 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2459999999999997e-06 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425062+0000", 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025546470000000002 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425067+0000", 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8659999999999997e-06 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:311731 5.8 e55/16 5:185f79da:::benchmark_data_smithi069_31227_object140074:head v 55'19594, mlcod=55'19591)", 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.422977+0000", 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001748639, 2024-04-26T12:16:52.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023825729999999998, 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422977+0000", 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422977+0000", 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422976+0000", 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422981+0000", 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8810000000000004e-06 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422989+0000", 2024-04-26T12:16:52.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8720000000000002e-06 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.422994+0000", 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.378e-06 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.423424+0000", 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000429825 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.423441+0000", 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6710000000000001e-05 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311733 5.3 5:c06994ef:::benchmark_data_smithi069_31227_object140076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.424002+0000", 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000723068, 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001416851, 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311733 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424002+0000", 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424002+0000", 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424001+0000", 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424006+0000", 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-04-26T12:16:52.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424016+0000", 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9019999999999994e-06 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424023+0000", 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424057+0000", 2024-04-26T12:16:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3890000000000002e-05 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424204+0000", 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014711999999999999 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311735 5.3 5.b9146d3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.424200+0000", 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00052559700000000004, 2024-04-26T12:16:52.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012832849999999999, 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311735 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424200+0000", 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424200+0000", 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424199+0000", 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424203+0000", 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4059999999999998e-06 2024-04-26T12:16:52.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424212+0000", 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424219+0000", 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.483 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:311732 5.0 e55/16)", 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.424375+0000", 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00034989800000000002, 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001159677, 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424375+0000", 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424375+0000", 2024-04-26T12:16:52.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424375+0000", 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424380+0000", 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5840000000000002e-06 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424390+0000", 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7070000000000004e-06 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424397+0000", 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:311734 5.b e55/16)", 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.424419+0000", 2024-04-26T12:16:52.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00030573299999999998, 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001159822, 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424419+0000", 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424419+0000", 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424419+0000", 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424422+0000", 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.05e-06 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424428+0000", 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5110000000000003e-06 2024-04-26T12:16:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.424432+0000", 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2579999999999997e-06 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311738 5.c 5:3d27da6d:::benchmark_data_smithi069_31227_object140081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.425304+0000", 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9994211, 2024-04-26T12:16:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000330592, 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311738 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425304+0000", 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425304+0000", 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425303+0000", 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425308+0000", 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425317+0000", 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0319999999999992e-06 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425324+0000", 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425372+0000", 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8130000000000002e-05 2024-04-26T12:16:52.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425499+0000", 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012727600000000001 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311739 5.1 5:89415cea:::benchmark_data_smithi069_31227_object140082:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.425342+0000", 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9993834, 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000362037, 2024-04-26T12:16:52.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311739 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425342+0000", 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425342+0000", 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425341+0000", 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425344+0000", 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.021e-06 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425351+0000", 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2760000000000003e-06 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425356+0000", 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1039999999999998e-06 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425392+0000", 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6059000000000002e-05 2024-04-26T12:16:52.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425528+0000", 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135277 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:311740 5.1 5.4a4ee741 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.425373+0000", 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.999352, 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039394799999999998, 2024-04-26T12:16:52.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 311740 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425373+0000", 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425373+0000", 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425373+0000", 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425376+0000", 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.022e-06 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425386+0000", 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8579999999999995e-06 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.425392+0000", 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5189999999999998e-06 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 18 2024-04-26T12:16:52.501 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:52.502 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:52.502 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:52.500+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.603 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:52.602+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:52.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:52.743 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:52.742+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:52.804 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:52.802+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:52.896 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.658804594000003, 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.259748771999995, 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:52.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.537420738000002, 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:52.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.537068177000002, 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:52.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.533277267000003, 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:52.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.925 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.410491223999998, 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:52.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:52.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:52.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:52.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.235651541000003, 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:52.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:52.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.983622848000003, 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:52.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:52.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:52.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.983387332, 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:52.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:52.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:52.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.982209269999998, 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:52.954 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.981626646999999, 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:52.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:52.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.980901721000002, 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:52.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:52.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:52.970 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.980866786, 2024-04-26T12:16:52.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:52.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:52.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:52.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.980198436999999, 2024-04-26T12:16:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:52.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:52.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:52.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.979980439999999, 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:52.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.978730605000003, 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:52.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.977853357000001, 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:52.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:52.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:52.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.754916331, 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:52.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:52.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:53.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5963691430000004, 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:16:53.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:16:53.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:16:53.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:16:53.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:16:53.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.34975520999999998, 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:16:53.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:53.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.014 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:53.015 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:16:53.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:53.017 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:53.014+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:53.116 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:53.115+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:53.155 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:53.155 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:53.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.155 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313892 5.9 5:9a1dbddb:::benchmark_data_smithi069_31227_object142235:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.155 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.149876+0000", 2024-04-26T12:16:53.155 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.003310903, 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0033276180000000001, 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313892 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149876+0000", 2024-04-26T12:16:53.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149876+0000", 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149875+0000", 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149879+0000", 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.839e-06 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149887+0000", 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.337e-06 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149893+0000", 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151136+0000", 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0012425279999999999 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151291+0000", 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015520599999999999 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.159 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313893 5.4 5:2e8a306e:::benchmark_data_smithi069_31227_object142236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.150610+0000", 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025769159999999998, 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026463820000000001, 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313893 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.160 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150610+0000", 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150610+0000", 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150609+0000", 2024-04-26T12:16:53.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150614+0000", 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6149999999999999e-06 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150625+0000", 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1821000000000001e-05 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150632+0000", 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3559999999999998e-06 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150658+0000", 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.6703000000000002e-05 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150822+0000", 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016323600000000001 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150916+0000", 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.4788000000000001e-05 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313894 5.8 5:1ba609ee:::benchmark_data_smithi069_31227_object142237:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.164 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.150646+0000", 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025408050000000001, 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026846449999999998, 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313894 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150646+0000", 2024-04-26T12:16:53.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150646+0000", 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150645+0000", 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150648+0000", 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.57e-06 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150654+0000", 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1659999999999999e-06 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150659+0000", 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150692+0000", 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3274e-05 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151677+0000", 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00098465800000000002 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151775+0000", 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8052000000000002e-05 2024-04-26T12:16:53.168 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313895 5.e 5:7205fcd0:::benchmark_data_smithi069_31227_object142238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.150665+0000", 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025217780000000001, 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027385560000000001, 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313895 2024-04-26T12:16:53.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150665+0000", 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150665+0000", 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150664+0000", 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150667+0000", 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.137e-06 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150672+0000", 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3179999999999997e-06 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150676+0000", 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4710000000000001e-06 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150720+0000", 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3878999999999998e-05 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150875+0000", 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000154838 2024-04-26T12:16:53.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150981+0000", 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105491 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.173 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313896 5.9 5:974e546e:::benchmark_data_smithi069_31227_object142239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.150755+0000", 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0024312439999999999, 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002724569, 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313896 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150755+0000", 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150755+0000", 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150755+0000", 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150758+0000", 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9629999999999998e-06 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150767+0000", 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7639999999999994e-06 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150772+0000", 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1900000000000003e-06 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.152949+0000", 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021767539999999999 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153068+0000", 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011900699999999999 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:313883 5.8 e55/16)", 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.151002+0000", 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0021847300000000002, 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025576750000000001, 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151002+0000", 2024-04-26T12:16:53.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151002+0000", 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151002+0000", 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151005+0000", 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.055e-06 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151013+0000", 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5860000000000005e-06 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.151018+0000", 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7620000000000003e-06 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153562+0000", 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025437889999999999 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313900 5.4 5:20d82193:::benchmark_data_smithi069_31227_object142243:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.153245+0000", 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9999418, 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00037170299999999997, 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.181 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313900 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153245+0000", 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153245+0000", 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153244+0000", 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153250+0000", 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4879999999999998e-06 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153258+0000", 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6039999999999993e-06 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153263+0000", 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.118e-06 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153307+0000", 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3470000000000002e-05 2024-04-26T12:16:53.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153513+0000", 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000206515 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153618+0000", 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010466 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313901 5.d 5:b2dff208:::benchmark_data_smithi069_31227_object142244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.153522+0000", 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996653, 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016631299999999999, 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313901 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.186 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153522+0000", 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153522+0000", 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153521+0000", 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153534+0000", 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3223e-05 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153543+0000", 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5760000000000006e-06 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153548+0000", 2024-04-26T12:16:53.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6230000000000002e-06 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153591+0000", 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2218999999999997e-05 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313902 5.8 5:1ca5beee:::benchmark_data_smithi069_31227_object142245:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.153564+0000", 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996228, 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00019541599999999999, 2024-04-26T12:16:53.189 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313902 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153564+0000", 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153564+0000", 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153563+0000", 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153566+0000", 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:16:53.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153573+0000", 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153577+0000", 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6880000000000001e-06 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.192 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153637+0000", 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0202999999999999e-05 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:313893 5.4 e55/16)", 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.153615+0000", 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9995718, 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00020309500000000001, 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153615+0000", 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153615+0000", 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153614+0000", 2024-04-26T12:16:53.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153618+0000", 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1700000000000001e-06 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153623+0000", 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4149999999999998e-06 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153628+0000", 2024-04-26T12:16:53.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.724e-06 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313904 5.d 5.917a2f9d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.153720+0000", 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9994669, 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014331700000000001, 2024-04-26T12:16:53.196 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313904 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153720+0000", 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153720+0000", 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153719+0000", 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153722+0000", 2024-04-26T12:16:53.198 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8480000000000001e-06 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153727+0000", 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1730000000000003e-06 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153731+0000", 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5219999999999999e-06 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.199 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313905 5.8 5.459625b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.153736+0000", 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9994507, 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00018202, 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313905 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153736+0000", 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153736+0000", 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153736+0000", 2024-04-26T12:16:53.201 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967296 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153737+0000", 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153741+0000", 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.636e-06 2024-04-26T12:16:53.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153745+0000", 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.313e-06 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313883 5.8 5:1a2929f0:::benchmark_data_smithi069_31227_object142226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.147874+0000", 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0053123570000000002, 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061029939999999996, 2024-04-26T12:16:53.203 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313883 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.147874+0000", 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.204 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.147874+0000", 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.147874+0000", 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.147878+0000", 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9489999999999998e-06 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.205 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.147885+0000", 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.678e-06 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.147892+0000", 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.206 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.147923+0000", 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1415000000000003e-05 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.148074+0000", 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015035 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.148173+0000", 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9587999999999996e-05 2024-04-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153611+0000", 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054374139999999998 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313890 5.9 5:97ce160e:::benchmark_data_smithi069_31227_object142233:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.149145+0000", 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0040414209999999999, 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.004902778, 2024-04-26T12:16:53.208 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313890 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149145+0000", 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.209 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149145+0000", 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149144+0000", 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149149+0000", 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.172e-06 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.210 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149159+0000", 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.028e-05 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149165+0000", 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2129999999999996e-06 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149203+0000", 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7469000000000003e-05 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.211 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149356+0000", 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000153454 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:313891 5.b 5:d8514d8a:::benchmark_data_smithi069_31227_object142234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:53.149259+0000", 2024-04-26T12:16:53.212 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0039274460000000002, 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0048475769999999996, 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 313891 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149259+0000", 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149259+0000", 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149259+0000", 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149262+0000", 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.794e-06 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149271+0000", 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8580000000000006e-06 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149277+0000", 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.361e-06 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.215 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.149949+0000", 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00067279500000000001 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150056+0000", 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106766 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.150117+0000", 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0606000000000002e-05 2024-04-26T12:16:53.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:53.153793+0000", 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0036760400000000002 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 15 2024-04-26T12:16:53.217 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:53.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:53.219 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:53.217+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:53.320 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:53.318+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:53.357 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:53.357 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:53.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:53.421 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:53.419+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:53.521 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:53.520+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:53.547 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.910769271999996, 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:53.550 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.551 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.552 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.909654103999998, 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:53.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:53.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.557 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.558 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.909381519999997, 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.559 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:53.561 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.562 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.908114963000003, 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.566 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.567 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.568 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:53.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.907907515000005, 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:53.570 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:53.572 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.573 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:53.574 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.575 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.907482031000001, 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.576 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.577 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.578 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.907211090999994, 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:53.582 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.583 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.584 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.585 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.586 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 76.906137091999994, 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.587 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.588 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.589 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:53.590 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:53.591 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:53.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.592 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.592 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.592 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:53.592 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:53.592 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.592 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.593 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.593 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.593 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:53.593 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:53.593 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.228478299999999, 2024-04-26T12:16:53.593 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:53.594 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.594 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.594 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.594 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.595 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.596 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:53.597 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.598 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.222218521999999, 2024-04-26T12:16:53.599 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.600 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:53.601 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.602 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.603 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:53.604 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.219791938, 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.606 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.607 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.608 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:53.609 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.219504151999999, 2024-04-26T12:16:53.610 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.611 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:53.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.614 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:53.615 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.219273139000002, 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:53.616 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.617 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:53.619 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.620 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:53.621 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.216499001000003, 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:53.622 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.623 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.624 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.625 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.635376024999999, 2024-04-26T12:16:53.627 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.628 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:53.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:53.630 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.631 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.632 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.635282140000001, 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.633 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:53.634 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.635 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.636 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.631965184999999, 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:53.639 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.640 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.643 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.630749059999999, 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.645 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.646 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.648 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.649 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.630731380999997, 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.652 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.653 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:53.654 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.655 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:53.656 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:53.656 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.656 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.656 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.656 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:53.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:53.657 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.657 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.657 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.657 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:53.657 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:53.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.658 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.658 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.658 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:53.658 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:53.658 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.659 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.659 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.659 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:53.659 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:53.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.660 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.660 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:53.660 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:53.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.660 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.661 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.661 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:53.661 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:53.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.661 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.661 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.662 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.662 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:53.662 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:53.662 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 38.627152643000002, 2024-04-26T12:16:53.662 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:53.663 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:53.663 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:53.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:53.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:53.663 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.663 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:53.664 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.664 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:53.664 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.664 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:53.664 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:53.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.665 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.665 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:53.665 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:53.665 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:53.666 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.666 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.666 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:53.666 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:53.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.667 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.667 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:53.667 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:53.667 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:53.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.668 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.668 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:53.668 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:53.668 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:53.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.669 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.669 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:53.669 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:53.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.669 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:53.670 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:53.670 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:53.670 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.670 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.670 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:53.671 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:53.671 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.673 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.674 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:53.674 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:53.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:53.677 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:53.674+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:53.776 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:53.775+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315903 5.3 5:c11ca844:::benchmark_data_smithi069_31227_object144246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.825719+0000", 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0058376139999999997, 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058616520000000002, 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315903 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825719+0000", 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825719+0000", 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825718+0000", 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825722+0000", 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825728+0000", 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825742+0000", 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743999999999999e-05 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825786+0000", 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3692000000000001e-05 2024-04-26T12:16:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.825933+0000", 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014690600000000001 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:315904 5.b e55/16 5:d6b16af7:::benchmark_data_smithi069_31227_object144247:head v 55'19829, mlcod=55'19827)", 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.826091+0000", 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0054651350000000003, 2024-04-26T12:16:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055595610000000002, 2024-04-26T12:16:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826091+0000", 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826091+0000", 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826091+0000", 2024-04-26T12:16:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826095+0000", 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749999999999998e-06 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826102+0000", 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3130000000000001e-06 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826107+0000", 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7759999999999997e-06 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826141+0000", 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3824e-05 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.826158+0000", 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6922000000000002e-05 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315906 5.3 5:c0fda654:::benchmark_data_smithi069_31227_object144249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.827073+0000", 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0044835550000000002, 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046325890000000003, 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315906 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827073+0000", 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827073+0000", 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827072+0000", 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827077+0000", 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.515e-06 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827085+0000", 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1359999999999997e-06 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827091+0000", 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0680000000000002e-06 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.828421+0000", 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013302749999999999 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.828581+0000", 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159715 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315907 5.3 5:cb26c77d:::benchmark_data_smithi069_31227_object144250:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.827504+0000", 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040522370000000002, 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042605500000000001, 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315907 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827504+0000", 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827504+0000", 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827503+0000", 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827511+0000", 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827520+0000", 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0990000000000005e-06 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.827526+0000", 2024-04-26T12:16:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830433+0000", 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029074190000000001 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830571+0000", 2024-04-26T12:16:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013761599999999999 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315909 5.6 5:610af323:::benchmark_data_smithi069_31227_object144252:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.829087+0000", 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002469279, 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027373359999999999, 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315909 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829087+0000", 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829087+0000", 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829086+0000", 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829090+0000", 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9339999999999999e-06 2024-04-26T12:16:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829101+0000", 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0916e-05 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829106+0000", 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8130000000000003e-06 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829808+0000", 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070169099999999995 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829976+0000", 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016873300000000001 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:315908 5.4 e55/16 5:2a14b3b7:::benchmark_data_smithi069_31227_object144251:head v 55'19451, mlcod=55'19449)", 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.829252+0000", 2024-04-26T12:16:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002304469, 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026299869999999999, 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829252+0000", 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829252+0000", 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829251+0000", 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829257+0000", 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4299999999999997e-06 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829266+0000", 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9619999999999999e-06 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829272+0000", 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829307+0000", 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4916999999999998e-05 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.829322+0000", 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4409e-05 2024-04-26T12:16:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315912 5.3 5.38a6e8f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.830208+0000", 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001348166, 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017241629999999999, 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315912 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830208+0000", 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830208+0000", 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830207+0000", 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830215+0000", 2024-04-26T12:16:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1710000000000002e-06 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830226+0000", 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0234000000000001e-05 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830233+0000", 2024-04-26T12:16:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0060000000000003e-06 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315915 5.5 5:a580c9eb:::benchmark_data_smithi069_31227_object144258:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.830243+0000", 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001313247, 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001745901, 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315915 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830243+0000", 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830243+0000", 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830242+0000", 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830246+0000", 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830253+0000", 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8410000000000002e-06 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830258+0000", 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9110000000000001e-06 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830300+0000", 2024-04-26T12:16:53.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2537000000000003e-05 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830510+0000", 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020991299999999999 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315916 5.7 5:e47fb1f9:::benchmark_data_smithi069_31227_object144259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.830268+0000", 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012883180000000001, 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017820309999999999, 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315916 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830268+0000", 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830268+0000", 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830267+0000", 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830270+0000", 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7369999999999998e-06 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830277+0000", 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830281+0000", 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7199999999999997e-06 2024-04-26T12:16:53.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830321+0000", 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9869000000000001e-05 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830481+0000", 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015967600000000001 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315918 5.5 5.d4312f95 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.830411+0000", 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011452389999999999, 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001694718, 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315918 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830411+0000", 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830411+0000", 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830410+0000", 2024-04-26T12:16:53.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830414+0000", 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0260000000000001e-06 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830426+0000", 2024-04-26T12:16:53.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1372000000000001e-05 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.830431+0000", 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999999e-06 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:315913 5.b e55/16)", 2024-04-26T12:16:53.878 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.831213+0000", 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00034301200000000002, 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093677500000000004, 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831213+0000", 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831213+0000", 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831213+0000", 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831217+0000", 2024-04-26T12:16:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6360000000000002e-06 2024-04-26T12:16:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831224+0000", 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7429999999999996e-06 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831228+0000", 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2239999999999997e-06 2024-04-26T12:16:53.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:315919 5.e e55/16 5:7295ff82:::benchmark_data_smithi069_31227_object144262:head v 55'19813, mlcod=55'19811)", 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.831233+0000", 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00032369899999999999, 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00095876000000000002, 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831233+0000", 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831233+0000", 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831232+0000", 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967296 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831235+0000", 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831238+0000", 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9720000000000001e-06 2024-04-26T12:16:53.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831240+0000", 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.429e-06 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831981+0000", 2024-04-26T12:16:53.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074075699999999998 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831998+0000", 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6894000000000001e-05 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:315920 5.2 5.db6b2042 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:53.831802+0000", 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997544, 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044047200000000002, 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 315920 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831802+0000", 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831802+0000", 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831801+0000", 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831805+0000", 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8659999999999999e-06 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831813+0000", 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0639999999999994e-06 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.831820+0000", 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.494e-06 2024-04-26T12:16:53.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:53.832235+0000", 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041570799999999998 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:53.892 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 13 2024-04-26T12:16:53.892 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:53.894 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:53.892+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:53.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:53.946 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:16:53.994 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:53.993+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:54.047 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:54.047 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:54.047 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:54.047 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:54.047 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:54.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:54.096 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:54.094+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:54.197 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:54.196+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:54.251 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:54.251 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:54.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.014333605000004, 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:54.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:54.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:54.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.615277782999996, 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:54.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.892949749000003, 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:54.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:54.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.892597188000003, 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:54.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.888806277999997, 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:54.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:54.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.766020234999999, 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:54.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:54.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:54.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:54.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:54.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:54.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.287 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:54.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:54.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.591180551999997, 2024-04-26T12:16:54.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:54.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.339151858999998, 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:54.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:54.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:54.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:54.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.338916343000001, 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:54.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:54.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.337738281, 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:54.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:54.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:54.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.337155658, 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:54.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:54.315 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.336430731999997, 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:54.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.336395797000002, 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:54.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.335727448, 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.326 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:54.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:54.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:54.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:54.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.335509451, 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:54.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.334259615999997, 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:54.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.333382368000002, 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:54.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.110445341999998, 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:54.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:54.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.9518981540000002, 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:16:54.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7052842209999999, 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:16:54.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:16:54.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:16:54.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:16:54.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:54.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:54.362 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:54.362 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:54.364 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:54.362+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:54.364 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:54.464 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:54.463+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:54.483 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:54.484 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:54.484 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:54.500 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.500 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:317871 5.4 5:2f10fbf2:::benchmark_data_smithi069_31227_object146214:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:54.494525+0000", 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0050849529999999997, 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0051010580000000003, 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.501 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 317871 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494525+0000", 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494525+0000", 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.502 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494524+0000", 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494527+0000", 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4779999999999998e-06 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:54.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494535+0000", 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8380000000000008e-06 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494540+0000", 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.622e-06 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494577+0000", 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6868e-05 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494683+0000", 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010624999999999999 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.494746+0000", 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2589000000000007e-05 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498242+0000", 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0034960740000000001 2024-04-26T12:16:54.505 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:317879 5.4 5:2951e863:::benchmark_data_smithi069_31227_object146222:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:54.496669+0000", 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0029404129999999998, 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030042799999999998, 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:54.506 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 317879 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496669+0000", 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496669+0000", 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496668+0000", 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496676+0000", 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496692+0000", 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496697+0000", 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4670000000000003e-06 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496731+0000", 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3568000000000001e-05 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496858+0000", 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012768400000000001 2024-04-26T12:16:54.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.496919+0000", 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0232000000000002e-05 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:317881 5.f 5:f8576887:::benchmark_data_smithi069_31227_object146224:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:54.498279+0000", 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0013306500000000001, 2024-04-26T12:16:54.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014329690000000001, 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 317881 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498279+0000", 2024-04-26T12:16:54.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498279+0000", 2024-04-26T12:16:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498278+0000", 2024-04-26T12:16:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498282+0000", 2024-04-26T12:16:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2010000000000001e-06 2024-04-26T12:16:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498290+0000", 2024-04-26T12:16:54.514 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.106e-06 2024-04-26T12:16:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498295+0000", 2024-04-26T12:16:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.8019999999999999e-06 2024-04-26T12:16:54.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498330+0000", 2024-04-26T12:16:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4433e-05 2024-04-26T12:16:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.516 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498506+0000", 2024-04-26T12:16:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017633199999999999 2024-04-26T12:16:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.518 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:317882 5.4 5:224d729d:::benchmark_data_smithi069_31227_object146225:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:16:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:54.498303+0000", 2024-04-26T12:16:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001306609, 2024-04-26T12:16:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001443059, 2024-04-26T12:16:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:54.519 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 317882 2024-04-26T12:16:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:54.520 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498303+0000", 2024-04-26T12:16:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.521 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498303+0000", 2024-04-26T12:16:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498303+0000", 2024-04-26T12:16:54.522 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498304+0000", 2024-04-26T12:16:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.7579999999999999e-06 2024-04-26T12:16:54.523 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498313+0000", 2024-04-26T12:16:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3659999999999992e-06 2024-04-26T12:16:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.524 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498316+0000", 2024-04-26T12:16:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3230000000000002e-06 2024-04-26T12:16:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:54.525 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498348+0000", 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1588999999999999e-05 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498507+0000", 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000158918 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.526 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498619+0000", 2024-04-26T12:16:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000112205 2024-04-26T12:16:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:54.527 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:317883 5.f 5.3635c73f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:16:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:54.498323+0000", 2024-04-26T12:16:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001286775, 2024-04-26T12:16:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0014596699999999999, 2024-04-26T12:16:54.528 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:54.529 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:54.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:54.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:54.529 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.529 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 317883 2024-04-26T12:16:54.529 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.530 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:54.530 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.530 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:54.530 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498323+0000", 2024-04-26T12:16:54.530 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.530 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498323+0000", 2024-04-26T12:16:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:54.532 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498322+0000", 2024-04-26T12:16:54.532 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.532 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.532 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.532 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:54.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498324+0000", 2024-04-26T12:16:54.533 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.5880000000000001e-06 2024-04-26T12:16:54.533 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.533 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.533 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:54.533 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498327+0000", 2024-04-26T12:16:54.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4599999999999999e-06 2024-04-26T12:16:54.534 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.534 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.534 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.534 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498330+0000", 2024-04-26T12:16:54.534 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7209999999999999e-06 2024-04-26T12:16:54.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.535 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:54.535 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.535 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.535 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.535 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:317887 5.f 5.7f0a22df (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:54.498800+0000", 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00080973000000000004, 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010096, 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:54.536 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 317887 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498800+0000", 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498800+0000", 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.537 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498799+0000", 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498804+0000", 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498814+0000", 2024-04-26T12:16:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0376e-05 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498820+0000", 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0839999999999997e-06 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:317871 5.4 e56/16)", 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:54.498841+0000", 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00076822700000000002, 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00099378399999999994, 2024-04-26T12:16:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498841+0000", 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498841+0000", 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:54.540 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498841+0000", 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498843+0000", 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4949999999999998e-06 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498851+0000", 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.25e-06 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:54.541 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:54.498855+0000", 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1690000000000002e-06 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 7 2024-04-26T12:16:54.542 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:54.543 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:54.544 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:54.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:54.545 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:54.545 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:54.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-26T12:16:54.586 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:54.585+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:54.666 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:54.665+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:54.723 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:54.724 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:54.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:54.777 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:54.776+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:54.868 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:54.867+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:54.920 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:54.920 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:54.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:54.977 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:54.976+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.071 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:55.069+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:55.084 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:55.084 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:55.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:55.183 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.181+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.272 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.271+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.291 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:55.292 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:55.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:55.391 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.390+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.475 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.473+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.500 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:55.500 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:55.513 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:55.575 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.574+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.650 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:55.650 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:55.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:55.676 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.675+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.777 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.776+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.804 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:55.805 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:55.815 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:55.878 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:55.877+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:55.959 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:55.959 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:55.961 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:16:55.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:55.978 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:55.977+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:56.079 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:56.078+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:56.127 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:56.127 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:56.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:56.180 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:56.179+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:56.281 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:56.280+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:56.293 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:56.293 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:56.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:56.382 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:56.381+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:56.459 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:56.459 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:56.472 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:56.516 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:56.515+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:56.546 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:16:56.584 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:56.582+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:56.611 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:56.611 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:56.624 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:56.669 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:56.669 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:56.669 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:56.685 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:56.683+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:56.689 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:56.689 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:56.691 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:56.692 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:56.786 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:56.784+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:56.805 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:56.805 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:56.805 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:56.805 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:56.805 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:56.817 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:56.887 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:56.886+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:56.961 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:16:56.964 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:56.964 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:56.964 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:56.964 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.326174433999995, 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.965 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:56.966 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.967 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:56.968 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:56.969 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.325059265999997, 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:56.970 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.971 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:56.971 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.971 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:56.971 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.972 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:56.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:56.973 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:56.973 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.973 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.973 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:56.973 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:56.974 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:56.975 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.324786681999996, 2024-04-26T12:16:56.976 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.977 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:56.978 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.980 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:56.981 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.982 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.323520125000002, 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:56.983 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:56.984 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.985 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:56.987 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.323312677000004, 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:56.988 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.989 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:56.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:56.992 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.322887193, 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:56.994 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.995 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:56.996 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:56.997 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.998 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.322616253000007, 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:57.001 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.002 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.003 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 80.321542253999993, 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:57.004 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.005 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.009 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.643883461999998, 2024-04-26T12:16:57.010 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:57.012 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.013 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:57.014 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.015 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.637623683999998, 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.016 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.017 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:57.018 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.019 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:57.020 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.635197099999999, 2024-04-26T12:16:57.021 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:57.023 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.024 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:57.025 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.026 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:57.027 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.634909313999998, 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:57.029 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.030 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.032 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.634678301000001, 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.033 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.035 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 45.631904163000002, 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.039 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:57.040 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:57.041 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.042 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.044 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.050781186999998, 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.045 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:57.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:57.048 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.049 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.050 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.050687302, 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:57.051 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:57.053 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.054 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.056 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.047370346999998, 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:57.057 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.058 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:57.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.046154221999998, 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.063 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.064 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.065 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:57.066 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.067 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:57.068 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.046136543000003, 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.069 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.070 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.071 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.072 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:57.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.074 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 42.042557805000001, 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.075 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:57.079 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.080 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:57.082 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:57.080+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:57.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:57.184 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:57.182+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:325994 5.5 5:a40a60b8:::benchmark_data_smithi069_31227_object154337:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:57.229696+0000", 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040931819999999999, 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041182379999999998, 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 325994 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.229696+0000", 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.229696+0000", 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.229696+0000", 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.229698+0000", 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4380000000000002e-06 2024-04-26T12:16:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.229709+0000", 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0959e-05 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.229713+0000", 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3379999999999998e-06 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231534+0000", 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018208949999999999 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231637+0000", 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102637 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:326001 5.b e57/16 5:d28c752e:::benchmark_data_smithi069_31227_object154344:head v 57'20446, mlcod=57'20444)", 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:57.231872+0000", 2024-04-26T12:16:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001917123, 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020225540000000002, 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231872+0000", 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231872+0000", 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231872+0000", 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231879+0000", 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7219999999999999e-06 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231890+0000", 2024-04-26T12:16:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0509000000000001e-05 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231896+0000", 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2110000000000003e-06 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231930+0000", 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4100000000000002e-05 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.231953+0000", 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2787000000000001e-05 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:326002 5.3 5:c2fbe0a6:::benchmark_data_smithi069_31227_object154345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:57.232680+0000", 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011096319999999999, 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012797380000000001, 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 326002 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232680+0000", 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232680+0000", 2024-04-26T12:16:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232679+0000", 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232684+0000", 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3070000000000002e-06 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232694+0000", 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0325e-05 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232701+0000", 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232748+0000", 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6712000000000003e-05 2024-04-26T12:16:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.232899+0000", 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015121700000000001 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:326004 5.5 5:a0197f26:::benchmark_data_smithi069_31227_object154347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:57.233446+0000", 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00034279500000000001, 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058272800000000002, 2024-04-26T12:16:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 326004 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233446+0000", 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233446+0000", 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233446+0000", 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233450+0000", 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5669999999999996e-06 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233456+0000", 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233461+0000", 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233496+0000", 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4819e-05 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233655+0000", 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015908799999999999 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:326005 5.8 e57/16 5:1c14d83d:::benchmark_data_smithi069_31227_object154348:head v 57'20521, mlcod=57'20519)", 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:57.233903+0000", 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.999886, 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019063000000000001, 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233903+0000", 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233903+0000", 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233903+0000", 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233907+0000", 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233914+0000", 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.469e-06 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233918+0000", 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:16:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233961+0000", 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.233973+0000", 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2318e-05 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:326003 5.b e57/16 5:da2d91af:::benchmark_data_smithi069_31227_object154346:head v 57'20447, mlcod=57'20444)", 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:57.234078+0000", 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997115, 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9258000000000006e-05, 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234078+0000", 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234078+0000", 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234077+0000", 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234085+0000", 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2459999999999997e-06 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234094+0000", 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1169999999999993e-06 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234099+0000", 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5269999999999998e-06 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234127+0000", 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7729000000000002e-05 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234143+0000", 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5794000000000002e-05 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:326006 5.4 e57/16 5:2bdda170:::benchmark_data_smithi069_31227_object154349:head v 57'20092, mlcod=57'20090)", 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:57.234106+0000", 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9996829, 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010886, 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234106+0000", 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234106+0000", 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234106+0000", 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967296 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234109+0000", 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234113+0000", 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7659999999999998e-06 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234118+0000", 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-06 2024-04-26T12:16:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234153+0000", 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5646999999999999e-05 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:57.234173+0000", 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9871999999999999e-05 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 7 2024-04-26T12:16:57.264 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:57.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:57.306 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:57.305+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:57.386 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:57.384+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:57.457 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:57.457 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:57.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:57.514 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:57.513+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:57.588 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:57.586+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 91.386683414999993, 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:16:57.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:16:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 80.987627592999999, 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.265299558999999, 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.264946997999999, 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:16:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:16:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:16:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.261156088000007, 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:16:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:16:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:16:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:16:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:16:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.138370045000002, 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:16:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:16:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:16:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:16:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.963530362, 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:16:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:16:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:16:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:16:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.711501669, 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:16:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:16:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.711266152999997, 2024-04-26T12:16:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:16:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.710088091000003, 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:16:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:16:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:16:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:16:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:16:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.709505468000003, 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:16:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.708780542, 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:16:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:16:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:16:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:16:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.708745606999997, 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.708077258000003, 2024-04-26T12:16:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:16:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:16:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:16:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:16:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.707859261000003, 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:16:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:16:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:16:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:16:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:16:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.706609426, 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:16:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.705732177999998, 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:16:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.482795152000001, 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:16:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.324247964, 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:16:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0776340309999997, 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:16:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:57.745 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:57.746 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:57.744+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:57.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:57.847 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:57.846+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327893 5.d 5:b7630444:::benchmark_data_smithi069_31227_object156236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.881242+0000", 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0044088950000000003, 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044328029999999999, 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327893 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881242+0000", 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881242+0000", 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881241+0000", 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881246+0000", 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7129999999999996e-06 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881255+0000", 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8750000000000006e-06 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881261+0000", 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881297+0000", 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5917999999999997e-05 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881451+0000", 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000153354 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327895 5.8 5:198e32b6:::benchmark_data_smithi069_31227_object156238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.881354+0000", 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042973320000000001, 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043954780000000004, 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327895 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881354+0000", 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881354+0000", 2024-04-26T12:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881353+0000", 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881356+0000", 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881362+0000", 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6840000000000001e-06 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881366+0000", 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.95e-06 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881492+0000", 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012547799999999999 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881634+0000", 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014208499999999999 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881728+0000", 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3851000000000007e-05 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327896 5.0 5:02f249f8:::benchmark_data_smithi069_31227_object156239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.881377+0000", 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042742429999999996, 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044350680000000003, 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327896 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881377+0000", 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881377+0000", 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881376+0000", 2024-04-26T12:16:57.898 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881379+0000", 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1e-06 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881385+0000", 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9340000000000003e-06 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881390+0000", 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.2030000000000002e-06 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881773+0000", 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00038305400000000002 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881945+0000", 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017217 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.900 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.882058+0000", 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000113538 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327897 5.8 5:174a2c1d:::benchmark_data_smithi069_31227_object156240:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.881394+0000", 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042570580000000002, 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044712839999999998, 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:57.901 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327897 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881394+0000", 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.902 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881394+0000", 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881394+0000", 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881396+0000", 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.4839999999999998e-06 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.903 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881402+0000", 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7370000000000003e-06 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881407+0000", 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6800000000000001e-06 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883669+0000", 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0022629 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.904 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883827+0000", 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000157868 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883927+0000", 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9253999999999995e-05 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327898 5.4 5:2bc85f5b:::benchmark_data_smithi069_31227_object156241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.881410+0000", 2024-04-26T12:16:57.905 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042407390000000003, 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045270149999999997, 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327898 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881410+0000", 2024-04-26T12:16:57.906 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881410+0000", 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881410+0000", 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.907 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881412+0000", 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0090000000000002e-06 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881418+0000", 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881422+0000", 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5109999999999997e-06 2024-04-26T12:16:57.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883305+0000", 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0018831049999999999 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883442+0000", 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013664600000000001 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883502+0000", 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9827000000000002e-05 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885411+0000", 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019092860000000001 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327900 5.0 5:0d7ed74b:::benchmark_data_smithi069_31227_object156243:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.910 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.881432+0000", 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0042194320000000004, 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0045870859999999998, 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327900 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881432+0000", 2024-04-26T12:16:57.911 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881432+0000", 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881431+0000", 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.912 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881434+0000", 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.48e-06 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881440+0000", 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3579999999999999e-06 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.881445+0000", 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5290000000000002e-06 2024-04-26T12:16:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883933+0000", 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0024886349999999999 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884089+0000", 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000155348 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884244+0000", 2024-04-26T12:16:57.914 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015540399999999999 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327903 5.8 5:1a9263b4:::benchmark_data_smithi069_31227_object156246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.883056+0000", 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0025952499999999999, 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0030333140000000001, 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.915 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327903 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883056+0000", 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883056+0000", 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883054+0000", 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883061+0000", 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.917 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883075+0000", 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4204e-05 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883083+0000", 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0129999999999993e-06 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885696+0000", 2024-04-26T12:16:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0026130569999999998 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885949+0000", 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00025265200000000002 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.886070+0000", 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000121644 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.919 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327904 5.8 5.4bb1e698 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.883279+0000", 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0023722410000000002, 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028833539999999999, 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.920 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327904 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883279+0000", 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883279+0000", 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.921 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883278+0000", 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883282+0000", 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1559999999999997e-06 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.922 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883295+0000", 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2429000000000001e-05 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883302+0000", 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9399999999999996e-06 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327905 5.d 5:be119227:::benchmark_data_smithi069_31227_object156248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.923 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.883838+0000", 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018131449999999999, 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023795069999999999, 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327905 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883838+0000", 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883838+0000", 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883837+0000", 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.925 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883842+0000", 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.583e-06 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883852+0000", 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0631999999999999e-05 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883860+0000", 2024-04-26T12:16:57.926 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.0989999999999999e-06 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.883912+0000", 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.1057999999999998e-05 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884713+0000", 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00080138300000000002 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.927 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327908 5.b 5:db6e475f:::benchmark_data_smithi069_31227_object156251:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.884009+0000", 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001642031, 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.002274051, 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327908 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.928 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884009+0000", 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884009+0000", 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884008+0000", 2024-04-26T12:16:57.929 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884013+0000", 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4839999999999998e-06 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884024+0000", 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0788000000000001e-05 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884031+0000", 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3540000000000002e-06 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884074+0000", 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3177999999999999e-05 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884286+0000", 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00021163900000000001 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.931 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.884385+0000", 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9172000000000005e-05 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:327906 5.a e57/16 5:57c51dc3:::benchmark_data_smithi069_31227_object156249:head v 57'20338, mlcod=57'20336)", 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.885160+0000", 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00049120900000000005, 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001180785, 2024-04-26T12:16:57.932 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885160+0000", 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885160+0000", 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.933 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885159+0000", 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885166+0000", 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885176+0000", 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.8439999999999993e-06 2024-04-26T12:16:57.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885183+0000", 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3200000000000002e-06 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885218+0000", 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5129000000000002e-05 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885237+0000", 2024-04-26T12:16:57.935 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8831e-05 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop_reply(client.4546.0:327895 5.8 e57/16)", 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.885741+0000", 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9999104, 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00065218999999999997, 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885741+0000", 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885741+0000", 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885740+0000", 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.937 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885744+0000", 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885753+0000", 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2779999999999993e-06 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.938 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885758+0000", 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4890000000000003e-06 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:327912 5.8 5.780601f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.885934+0000", 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9997168, 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00050390400000000001, 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 327912 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885934+0000", 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885934+0000", 2024-04-26T12:16:57.940 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885933+0000", 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999986 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885938+0000", 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4779999999999999e-06 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885948+0000", 2024-04-26T12:16:57.941 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.5270000000000004e-06 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.885954+0000", 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.4559999999999997e-06 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:327907 5.a e57/16)", 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:57.886220+0000", 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9994316, 2024-04-26T12:16:57.942 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000270716, 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.886220+0000", 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.886220+0000", 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.886219+0000", 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.886224+0000", 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2750000000000003e-06 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.886233+0000", 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5790000000000004e-06 2024-04-26T12:16:57.944 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:57.886238+0000", 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0100000000000003e-06 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 14 2024-04-26T12:16:57.945 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:57.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:57.948 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:57.946+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:58.048 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:58.047+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:58.086 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:16:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:16:58.086 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:16:58.087 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:58.098 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:58.149 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:58.147+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:58.251 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:58.248+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:58.284 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:16:58.284 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.647522753000004, 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:16:58.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.646407585000006, 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:16:58.290 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:16:58.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.295 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.646135001000005, 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.296 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:16:58.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:16:58.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:16:58.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.302 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.644868443999997, 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:16:58.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.644660995999999, 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:16:58.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.644235511999995, 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:16:58.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:16:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.643964572000002, 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:16:58.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:16:58.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 81.642890573000003, 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:16:58.324 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:16:58.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:16:58.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:16:58.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.330 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.965231781, 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:16:58.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.958972003, 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.336 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:16:58.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.956545419000001, 2024-04-26T12:16:58.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:16:58.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:16:58.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.956257633, 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.956026620000003, 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.352 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:16:58.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:16:58.358 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.953252482000003, 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:16:58.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:16:58.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.372129506, 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:16:58.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:16:58.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.372035621000002, 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:16:58.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:16:58.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:16:58.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.377 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.368718665999999, 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.378 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:16:58.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:16:58.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:16:58.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:58.384 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.367502541, 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:16:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.367484861999998, 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:16:58.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:16:58.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:16:58.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:16:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 43.363906124000003, 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:16:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:16:58.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:16:58.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:16:58.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:16:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:16:58.403 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:16:58.405 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:58.403+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:58.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:58.504 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:58.503+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:58.560 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:58.560 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:16:58.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.560 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:329945 5.b e57/16 5:d577addd:::benchmark_data_smithi069_31227_object158288:head v 57'20712, mlcod=57'20710)", 2024-04-26T12:16:58.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.553732+0000", 2024-04-26T12:16:58.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0048067650000000002, 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048235159999999999, 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553732+0000", 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553732+0000", 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553732+0000", 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553738+0000", 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553747+0000", 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1949999999999992e-06 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553753+0000", 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7219999999999996e-06 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553901+0000", 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014825600000000001 2024-04-26T12:16:58.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.553920+0000", 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8187999999999999e-05 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:329949 5.2 5:4a8eac9a:::benchmark_data_smithi069_31227_object158292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.554014+0000", 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0045246590000000003, 2024-04-26T12:16:58.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045785870000000003, 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 329949 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554014+0000", 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554014+0000", 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554014+0000", 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554016+0000", 2024-04-26T12:16:58.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554022+0000", 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554027+0000", 2024-04-26T12:16:58.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-04-26T12:16:58.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554992+0000", 2024-04-26T12:16:58.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00096595000000000003 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.555130+0000", 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000137785 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:329952 5.2 5:490a50df:::benchmark_data_smithi069_31227_object158295:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.554362+0000", 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0041772689999999999, 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042677110000000004, 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 329952 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554362+0000", 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554362+0000", 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554361+0000", 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554365+0000", 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999997e-06 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554373+0000", 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6190000000000002e-06 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554379+0000", 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6019999999999999e-06 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557223+0000", 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028440319999999998 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557415+0000", 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019232200000000001 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:329954 5.3 5:cdb73358:::benchmark_data_smithi069_31227_object158297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.554712+0000", 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0038272470000000002, 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039507880000000002, 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 329954 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554712+0000", 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554712+0000", 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554711+0000", 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554715+0000", 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554723+0000", 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9319999999999996e-06 2024-04-26T12:16:58.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554728+0000", 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6810000000000003e-06 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554787+0000", 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8631000000000002e-05 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554918+0000", 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130984 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:329955 5.2 5.a7d479e2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.554806+0000", 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0037329300000000002, 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038893769999999999, 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 329955 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554806+0000", 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554806+0000", 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554806+0000", 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554809+0000", 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8210000000000003e-06 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554817+0000", 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9379999999999992e-06 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554823+0000", 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9320000000000001e-06 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:329953 5.e e57/16 5:7bd08e0e:::benchmark_data_smithi069_31227_object158296:head v 57'20671, mlcod=57'20669)", 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.554862+0000", 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.003676824, 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003860699, 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554862+0000", 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554862+0000", 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554862+0000", 2024-04-26T12:16:58.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554867+0000", 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8770000000000001e-06 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554874+0000", 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554879+0000", 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3120000000000001e-06 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554920+0000", 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000003e-05 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.554938+0000", 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7869000000000001e-05 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:329950 5.b e57/16 5:d78435f9:::benchmark_data_smithi069_31227_object158293:head v 57'20713, mlcod=57'20710)", 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.555744+0000", 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0027951500000000002, 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030081349999999999, 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.555744+0000", 2024-04-26T12:16:58.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.555744+0000", 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.555744+0000", 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.555748+0000", 2024-04-26T12:16:58.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2150000000000003e-06 2024-04-26T12:16:58.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.555755+0000", 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4270000000000002e-06 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.555759+0000", 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557868+0000", 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021082509999999998 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557885+0000", 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7292e-05 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:329956 5.e e57/16 5:7c1eca01:::benchmark_data_smithi069_31227_object158299:head v 57'20672, mlcod=57'20669)", 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.556792+0000", 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001747277, 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019890709999999998, 2024-04-26T12:16:58.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.556792+0000", 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.556792+0000", 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.556791+0000", 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.556800+0000", 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0440000000000001e-06 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.556810+0000", 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3190000000000001e-06 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.556816+0000", 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3260000000000001e-06 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557142+0000", 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032572599999999998 2024-04-26T12:16:58.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557160+0000", 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8284e-05 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:329958 5.0 e57/16 5:0fdd3511:::benchmark_data_smithi069_31227_object158301:head v 57'20620, mlcod=57'20617)", 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.557717+0000", 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00082220100000000005, 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001110055, 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557717+0000", 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557717+0000", 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557717+0000", 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557731+0000", 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4352000000000001e-05 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557740+0000", 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6149999999999997e-06 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557744+0000", 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557779+0000", 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5015999999999998e-05 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557797+0000", 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8635e-05 2024-04-26T12:16:58.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:329959 5.8 e57/16 5:18c4e284:::benchmark_data_smithi069_31227_object158302:head v 57'20760, mlcod=57'20758)", 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:58.557752+0000", 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00078716699999999997, 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001131356, 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:16:58.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557752+0000", 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557752+0000", 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557752+0000", 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557755+0000", 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.512e-06 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557759+0000", 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0450000000000002e-06 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557762+0000", 2024-04-26T12:16:58.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3640000000000002e-06 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557820+0000", 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8692e-05 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:58.557838+0000", 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7920000000000001e-05 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:16:58.603 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:16:58.603 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 10 2024-04-26T12:16:58.603 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:58.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:58.647 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:58.644+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:58.693 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:16:58.706 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:58.704+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:58.799 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:16:58.799 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:16:58.799 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:16:58.799 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:16:58.799 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:16:58.806 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:58.805+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:58.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:58.814 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:16:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:16:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:16:58.833 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:16:58.833 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:16:58.836 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:16:58.836 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:16:58.907 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:58.905+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:59.003 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:59.003 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:59.008 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:59.007+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:59.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:16:59.083 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:16:59.109 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:59.108+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:59.161 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:59.161 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:59.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:16:59.210 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:59.209+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:59.308 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:59.308 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:59.311 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:59.310+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:59.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:16:59.412 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:59.411+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:59.499 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:59.499 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:59.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:16:59.512 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:59.511+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:59.614 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:59.612+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:59.660 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:59.660 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:59.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:16:59.717 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:59.715+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:59.816 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:16:59.815+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:16:59.822 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:16:59.822 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:16:59.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:16:59.917 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:16:59.916+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:16:59.963 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:17:00.018 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:00.017+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:00.025 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:00.026 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:00.038 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:00.119 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:00.118+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:00.179 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:00.179 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:00.191 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:00.234 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:00.233+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:00.321 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:00.320+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:00.330 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:00.330 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:00.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:00.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-26T12:17:00.428 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:00.427+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:00.523 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:00.522+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:00.528 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:00.528 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:00.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:00.624 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:00.623+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:00.694 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:00.695 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:00.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:00.725 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:00.723+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:00.825 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:00.824+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:00.837 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:17:00.902 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:00.902 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:00.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:00.926 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:00.924+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:00.961 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:17:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:17:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:17:00.981 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:17:00.981 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:17:00.984 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:17:00.984 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:17:01.027 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:01.025+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 94.876617590999999, 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:17:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:17:01.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:17:01.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:17:01.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 84.477561769000005, 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:17:01.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.755233735000004, 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:17:01.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.754881174000005, 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:01.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:17:01.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.751090263999998, 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:17:01.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:17:01.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.628304221, 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:17:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.453464537999999, 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:17:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:17:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.201435844999999, 2024-04-26T12:17:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:17:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:17:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.201200329000002, 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:17:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.200022267000001, 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:17:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:17:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:17:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:17:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.199439644000002, 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:17:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:17:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.198714717999998, 2024-04-26T12:17:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:17:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.198679783000003, 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:17:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.198011434000001, 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:17:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:17:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.197793437000001, 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:17:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.196543601999998, 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:17:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.195666353999997, 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:17:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.972729328, 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:17:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:17:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.81418214, 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:17:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5675682070000008, 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:01.223 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:01.225 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:01.225 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:01.223+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:01.325 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:01.324+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:01.362 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:01.362 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:01.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.362 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338140 5.4 5:24f6abda:::benchmark_data_smithi069_31227_object166483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.362 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.359324+0000", 2024-04-26T12:17:01.362 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001619536, 2024-04-26T12:17:01.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001647735, 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338140 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359324+0000", 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359324+0000", 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359324+0000", 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359328+0000", 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5040000000000004e-06 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359338+0000", 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0196e-05 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359346+0000", 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6009999999999997e-06 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359379+0000", 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3002e-05 2024-04-26T12:17:01.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359523+0000", 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014377500000000001 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359625+0000", 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102315 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338145 5.4 5.42367ec4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.359995+0000", 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00094886099999999995, 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0010387949999999999, 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338145 2024-04-26T12:17:01.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359995+0000", 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359995+0000", 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359994+0000", 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.360000+0000", 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.360009+0000", 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6679999999999996e-06 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.360016+0000", 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9840000000000004e-06 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.361039+0000", 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001022043 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338126 5.d 5:b009cdad:::benchmark_data_smithi069_31227_object166469:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.354082+0000", 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0068616509999999999, 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069876199999999999, 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338126 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.371 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.354082+0000", 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.354082+0000", 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.354082+0000", 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.354085+0000", 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8660000000000002e-06 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.354092+0000", 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7299999999999999e-06 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.354097+0000", 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7679999999999997e-06 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.355644+0000", 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001546684 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.355819+0000", 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017468599999999999 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338129 5.4 5:265aa790:::benchmark_data_smithi069_31227_object166472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.356160+0000", 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0047842930000000002, 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0049442899999999996, 2024-04-26T12:17:01.375 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338129 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356160+0000", 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356160+0000", 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356159+0000", 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356164+0000", 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.972e-06 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356177+0000", 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3396e-05 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356185+0000", 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.8380000000000002e-06 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356218+0000", 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2954999999999999e-05 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356379+0000", 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016068300000000001 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356531+0000", 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015245499999999999 2024-04-26T12:17:01.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.358571+0000", 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020398790000000001 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338131 5.0 5:0df27351:::benchmark_data_smithi069_31227_object166474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.356761+0000", 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0041829839999999998, 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043842949999999999, 2024-04-26T12:17:01.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338131 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356761+0000", 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356761+0000", 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356760+0000", 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356765+0000", 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6519999999999997e-06 2024-04-26T12:17:01.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356778+0000", 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.3108000000000001e-05 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356785+0000", 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3719999999999999e-06 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356825+0000", 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9439e-05 2024-04-26T12:17:01.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356990+0000", 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00016550399999999999 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357097+0000", 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106944 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.360899+0000", 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038015240000000001 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338132 5.0 5:09e5b6f9:::benchmark_data_smithi069_31227_object166475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.356796+0000", 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0041484879999999997, 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0043910019999999998, 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:01.385 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338132 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356796+0000", 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356796+0000", 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356795+0000", 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356798+0000", 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000002e-06 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356805+0000", 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0230000000000004e-06 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356810+0000", 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.2050000000000001e-06 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.358824+0000", 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020141780000000001 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.358924+0000", 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.9438999999999994e-05 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.358994+0000", 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.9944999999999995e-05 2024-04-26T12:17:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338136 5.f 5:f5c67eb6:::benchmark_data_smithi069_31227_object166479:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.356826+0000", 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00411759, 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044089910000000001, 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338136 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356826+0000", 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356826+0000", 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356826+0000", 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356829+0000", 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.089e-06 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356838+0000", 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.5750000000000001e-06 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356844+0000", 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.356876+0000", 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2555000000000003e-05 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357033+0000", 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015709400000000001 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338137 5.b 5:d1e2ea84:::benchmark_data_smithi069_31227_object166480:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.357374+0000", 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0035699500000000001, 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0038976150000000001, 2024-04-26T12:17:01.394 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338137 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357374+0000", 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357374+0000", 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357373+0000", 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357378+0000", 2024-04-26T12:17:01.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4479999999999996e-06 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357390+0000", 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2607e-05 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357398+0000", 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2400000000000001e-06 2024-04-26T12:17:01.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357440+0000", 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1978999999999999e-05 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357585+0000", 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000145842 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.357688+0000", 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103047 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359996+0000", 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0023076149999999998 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:338139 5.f 5:ffef21f7:::benchmark_data_smithi069_31227_object166482:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:01.359167+0000", 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.001776831, 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021431929999999998, 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 338139 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359167+0000", 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359167+0000", 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359166+0000", 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359171+0000", 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6380000000000003e-06 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359185+0000", 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4314999999999999e-05 2024-04-26T12:17:01.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359193+0000", 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359241+0000", 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7973000000000003e-05 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:01.359395+0000", 2024-04-26T12:17:01.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015447700000000001 2024-04-26T12:17:01.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.404 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.404 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.404 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:17:01.404 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-26T12:17:01.404 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:01.405 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:01.449 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:01.448+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:01.528 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:01.526+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:01.545 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:17:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:17:01.546 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:01.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:01.628 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:01.627+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:01.728 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:01.727+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:01.744 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:01.744 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:17:01.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:17:01.744 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.108455457999995, 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:17:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.748 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.107340289999996, 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.749 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.750 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.751 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:17:01.752 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:01.754 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.107067705999995, 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:17:01.756 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.757 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.758 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:17:01.759 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:01.760 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.105801149000001, 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:17:01.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.765 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.105593701000004, 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.766 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.767 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:17:01.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:17:01.769 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.770 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.105168216999999, 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.771 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.773 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:17:01.774 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.775 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.104897277000006, 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.776 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.777 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.778 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.779 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:17:01.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.781 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 85.103823277999993, 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.782 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:17:01.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:17:01.785 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.786 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.787 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.426164485999998, 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:01.788 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.789 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.790 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:17:01.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.792 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.419904707999997, 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.793 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:17:01.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.796 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:17:01.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.417478123999999, 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:17:01.798 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:17:01.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.801 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:17:01.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.417190337999997, 2024-04-26T12:17:01.804 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:17:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.808 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:01.809 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.416959325000001, 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.812 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.813 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:17:01.814 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.414185187000001, 2024-04-26T12:17:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.816 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:17:01.817 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.818 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:17:01.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.833062210999998, 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:17:01.821 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.822 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:17:01.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.824 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.825 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:17:01.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.832968326, 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.828 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:17:01.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:17:01.830 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.831 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:17:01.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.829651370999997, 2024-04-26T12:17:01.833 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:17:01.835 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.836 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.837 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.838 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.828435245999998, 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.839 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:01.840 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.841 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.842 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:17:01.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:17:01.844 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.828417567000002, 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.845 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.847 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.848 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:17:01.850 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 46.824838829000001, 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:01.851 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.852 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.854 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:17:01.855 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:01.857 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:01.858 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:01.856+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:01.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:01.959 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:01.958+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:01.978 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:17:02.017 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:02.031 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:17:02.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.031 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:340080 5.1 5:86d60a3d:::benchmark_data_smithi069_31227_object168423:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.013593+0000", 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019439570000000001, 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019666699999999998, 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 340080 2024-04-26T12:17:02.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013593+0000", 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013593+0000", 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013592+0000", 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013597+0000", 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013605+0000", 2024-04-26T12:17:02.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6410000000000008e-06 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013612+0000", 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013660+0000", 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219e-05 2024-04-26T12:17:02.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.013833+0000", 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172874 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:340081 5.8 e58/16 5:11c4825f:::benchmark_data_smithi069_31227_object168424:head v 58'21403, mlcod=58'21401)", 2024-04-26T12:17:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.014209+0000", 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0013280200000000001, 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001417555, 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014209+0000", 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014209+0000", 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014208+0000", 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014214+0000", 2024-04-26T12:17:02.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5720000000000002e-06 2024-04-26T12:17:02.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014224+0000", 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.042e-05 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014229+0000", 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.49e-06 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014273+0000", 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3939000000000001e-05 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014292+0000", 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8678e-05 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:340082 5.0 e58/16 5:01a17ef3:::benchmark_data_smithi069_31227_object168425:head v 58'21262, mlcod=58'21257)", 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.014275+0000", 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012617539999999999, 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014054099999999999, 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014275+0000", 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014275+0000", 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014274+0000", 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014278+0000", 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014284+0000", 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014289+0000", 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2359999999999998e-06 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014306+0000", 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7183000000000001e-05 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014316+0000", 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0332e-05 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.045 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:340083 5.a 5:58e87a25:::benchmark_data_smithi069_31227_object168426:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.014716+0000", 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00082081500000000002, 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010186080000000001, 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 340083 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014716+0000", 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014716+0000", 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014715+0000", 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014720+0000", 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014732+0000", 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014738+0000", 2024-04-26T12:17:02.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014779+0000", 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0714999999999999e-05 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014946+0000", 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016708399999999999 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015048+0000", 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010181199999999999 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:340084 5.1 5:8b16c04f:::benchmark_data_smithi069_31227_object168427:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.014748+0000", 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00078892999999999997, 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001053481, 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 340084 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014748+0000", 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014748+0000", 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014747+0000", 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014750+0000", 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014757+0000", 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6990000000000003e-06 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014762+0000", 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015746+0000", 2024-04-26T12:17:02.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098382799999999996 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:340086 5.c 5:3946caf8:::benchmark_data_smithi069_31227_object168429:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.014769+0000", 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00076793900000000003, 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010865440000000001, 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 340086 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014769+0000", 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014769+0000", 2024-04-26T12:17:02.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014768+0000", 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014770+0000", 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9690000000000001e-06 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014776+0000", 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3700000000000003e-06 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014780+0000", 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.155e-06 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014825+0000", 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5074999999999998e-05 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015005+0000", 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018056600000000001 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:340085 5.b e58/16 5:d111b1f3:::benchmark_data_smithi069_31227_object168428:head v 58'21372, mlcod=58'21370)", 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.014989+0000", 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00054753500000000004, 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092437599999999997, 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014989+0000", 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014989+0000", 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014989+0000", 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014994+0000", 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1510000000000003e-06 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015002+0000", 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9440000000000005e-06 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015006+0000", 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7500000000000003e-06 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015055+0000", 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8782000000000002e-05 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015072+0000", 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6614000000000001e-05 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.061 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:340087 5.1 5.57985cd1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.015659+0000", 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998775, 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000311756, 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 340087 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015659+0000", 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015659+0000", 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015659+0000", 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015667+0000", 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015676+0000", 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:17:02.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.015683+0000", 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3810000000000004e-06 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:340077 5.a 5:5e34f712:::benchmark_data_smithi069_31227_object168420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:17:02.012064+0000", 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0034724180000000001, 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039603889999999999, 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 340077 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012064+0000", 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012064+0000", 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012063+0000", 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012068+0000", 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.459e-06 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012079+0000", 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1131000000000001e-05 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012085+0000", 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012126+0000", 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1065000000000001e-05 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012274+0000", 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014770699999999999 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.012374+0000", 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100028 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:17:02.014512+0000", 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002137777 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-04-26T12:17:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 9 2024-04-26T12:17:02.070 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:02.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:02.073 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:02.070+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:02.172 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:02.171+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:02.227 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:17:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:17:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:17:02.228 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:02.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:02.281 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:02.280+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:02.374 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:02.373+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:02.438 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:17:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:17:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:17:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.200817473000001, 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:17:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 85.801761651000007, 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:17:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:17:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.079433617000007, 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:17:02.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.079081056000007, 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:17:02.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:17:02.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.075290146, 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:17:02.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:17:02.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:17:02.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:17:02.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:17:02.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:17:02.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:17:02.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.470 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:02.470 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:02.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.952504103000003, 2024-04-26T12:17:02.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:17:02.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:17:02.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:02.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:02.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:17:02.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:17:02.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:17:02.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:17:02.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:17:02.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:17:02.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:17:02.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:17:02.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:17:02.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:17:02.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:17:02.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:17:02.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:17:02.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:17:02.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:17:02.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:02.482 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.777664420000001, 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:17:02.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:02.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:17:02.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:17:02.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:17:02.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:02.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.525635727000001, 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:17:02.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:17:02.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.495 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.525400210999997, 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:17:02.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.524222149000003, 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:02.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:02.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.523639525999997, 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:02.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.5229146, 2024-04-26T12:17:02.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:17:02.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:17:02.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.522879664999998, 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:17:02.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.522211316000003, 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:17:02.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:17:02.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.521993319000003, 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.520743484, 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:17:02.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:17:02.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.519866235999999, 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:02.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:17:02.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:17:02.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.296929209999998, 2024-04-26T12:17:02.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:17:02.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:17:02.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:17:02.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:17:02.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:17:02.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:17:02.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.138382021999998, 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8917680889999993, 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:17:02.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:02.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:17:02.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:17:02.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:02.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:17:02.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:02.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:02.562 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:02.564 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:02.564 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:02.562+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:02.665 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:02.663+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342086 5.d 5:b6c60945:::benchmark_data_smithi069_31227_object170429:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.696424+0000", 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0061700039999999998, 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0061930149999999996, 2024-04-26T12:17:02.704 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342086 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696424+0000", 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.705 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696424+0000", 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696423+0000", 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.706 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696429+0000", 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2990000000000002e-06 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696441+0000", 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2140000000000001e-05 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696450+0000", 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3189999999999995e-06 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.707 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696494+0000", 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4019e-05 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696632+0000", 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000138467 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702510+0000", 2024-04-26T12:17:02.708 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0058776729999999999 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702552+0000", 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.1652e-05 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702624+0000", 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1977000000000006e-05 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342089 5.d 5:b03f8f1a:::benchmark_data_smithi069_31227_object170432:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.696709+0000", 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0058849100000000001, 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0059888160000000001, 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.710 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342089 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696709+0000", 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.711 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696709+0000", 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696708+0000", 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.712 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696713+0000", 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0030000000000002e-06 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696723+0000", 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.6250000000000002e-06 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.696729+0000", 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2160000000000003e-06 2024-04-26T12:17:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698658+0000", 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0019286209999999999 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:02.714 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698836+0000", 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017844399999999999 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342091 5.4 5:23c8a371:::benchmark_data_smithi069_31227_object170434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.715 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.697034+0000", 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0055602239999999999, 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057023539999999998, 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342091 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697034+0000", 2024-04-26T12:17:02.716 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697034+0000", 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697033+0000", 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.717 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697037+0000", 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7170000000000002e-06 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697044+0000", 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0049999999999998e-06 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697050+0000", 2024-04-26T12:17:02.718 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.767e-06 2024-04-26T12:17:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697083+0000", 2024-04-26T12:17:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.3420999999999997e-05 2024-04-26T12:17:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697220+0000", 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000136985 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.697292+0000", 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1400000000000001e-05 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.720 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.699349+0000", 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020578670000000001 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342096 5.d 5:bea87a75:::benchmark_data_smithi069_31227_object170439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.698779+0000", 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0038154180000000001, 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0040205450000000004, 2024-04-26T12:17:02.721 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "started", 2024-04-26T12:17:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342096 2024-04-26T12:17:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698779+0000", 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698779+0000", 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698778+0000", 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698782+0000", 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698789+0000", 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.2649999999999999e-06 2024-04-26T12:17:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.698794+0000", 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0860000000000001e-06 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700870+0000", 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020758360000000002 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.701032+0000", 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000162411 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342097 5.d 5.9e147e2d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.699258+0000", 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0033357719999999999, 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.003580986, 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "queued for pg", 2024-04-26T12:17:02.726 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342097 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.699258+0000", 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.727 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.699258+0000", 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.699258+0000", 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.699262+0000", 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5029999999999999e-06 2024-04-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.699273+0000", 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0655999999999999e-05 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.699279+0000", 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.729 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342099 5.b 5:d81093af:::benchmark_data_smithi069_31227_object170442:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.700057+0000", 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.002537143, 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0028205259999999998, 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342099 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.730 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700057+0000", 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700057+0000", 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700056+0000", 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700060+0000", 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9149999999999998e-06 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700070+0000", 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0164e-05 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700076+0000", 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5219999999999998e-06 2024-04-26T12:17:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700108+0000", 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2157999999999999e-05 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700214+0000", 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000105599 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700285+0000", 2024-04-26T12:17:02.733 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1686000000000004e-05 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342101 5.b 5:d4507719:::benchmark_data_smithi069_31227_object170444:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.700778+0000", 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.0018163980000000001, 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0021409210000000001, 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.734 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342101 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700778+0000", 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700778+0000", 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700777+0000", 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700782+0000", 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.7360000000000001e-06 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700790+0000", 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.8570000000000001e-06 2024-04-26T12:17:02.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.700797+0000", 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1500000000000004e-06 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.701886+0000", 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.001089635 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.701995+0000", 2024-04-26T12:17:02.737 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000109207 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702069+0000", 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3711e-05 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342105 5.e 5:7b61b295:::benchmark_data_smithi069_31227_object170448:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.702242+0000", 2024-04-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 0.00035185799999999998, 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00073724499999999998, 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342105 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702242+0000", 2024-04-26T12:17:02.739 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702242+0000", 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702242+0000", 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.740 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702245+0000", 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702254+0000", 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3729999999999999e-06 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702259+0000", 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9649999999999999e-06 2024-04-26T12:17:02.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702298+0000", 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9107999999999999e-05 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702457+0000", 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015919299999999999 2024-04-26T12:17:02.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702562+0000", 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000104763 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:342108 5.f 5.147a362f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:17:02.702954+0000", 2024-04-26T12:17:02.743 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 4294967295.9996405, 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2497999999999995e-05, 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "reached pg", 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 342108 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.744 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702954+0000", 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702954+0000", 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702953+0000", 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:02.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702958+0000", 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9049999999999996e-06 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702973+0000", 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.504e-05 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.746 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.702980+0000", 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.6129999999999998e-06 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:17:02.703025+0000", 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4864000000000003e-05 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: ], 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 9 2024-04-26T12:17:02.747 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:02.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:02.794 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:02.793+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:02.868 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:02.867+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:02.891 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:02.891 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:02.891 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:17:02.891 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:17:02.891 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:02.902 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:02.969 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:02.967+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is set 2024-04-26T12:17:02.985 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:17:03.069 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:03.068+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:03.081 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.445558925, 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.082 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:17:03.083 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.084 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:17:03.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.444443757000002, 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.087 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.089 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.090 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:17:03.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.444171173000001, 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.092 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.093 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:17:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.095 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.096 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:17:03.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.442904616000007, 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.100 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:17:03.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:17:03.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.103 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.442697167999995, 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.104 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.105 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:17:03.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.442271684000005, 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:17:03.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.110 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:17:03.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.112 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.113 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.442000743999998, 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:17:03.114 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.115 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.116 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.117 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.118 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.119 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 86.440926744999999, 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.121 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.124 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:17:03.125 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:03.126 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.763267953000003, 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.127 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:17:03.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.130 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:17:03.131 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.757008175000003, 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.132 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.133 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:17:03.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:17:03.135 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:17:03.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.137 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.754581590999997, 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.138 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:17:03.139 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:17:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:17:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.754293805000003, 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.144 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:17:03.147 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.148 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:03.149 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.754062791999999, 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.150 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:17:03.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.153 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.154 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.155 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.751288654, 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.156 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.158 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:17:03.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.160 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.170165677999996, 2024-04-26T12:17:03.161 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:17:03.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:17:03.164 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.165 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:17:03.166 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.170071792999998, 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:17:03.167 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.168 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:17:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.172 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.166754838000003, 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.173 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.174 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:17:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.176 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.177 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:17:03.178 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:03.179 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.165538712999997, 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:03.180 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.181 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:17:03.182 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.183 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:17:03.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.185 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.165521034000001, 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:17:03.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.187 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.188 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.189 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:17:03.190 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.191 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 48.161942295999999, 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.192 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.193 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:17:03.194 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:17:03.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:17:03.196 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:03.197 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:03.198 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:17:03.199 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:03.197+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:03.199 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:17:03.200 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Removed 171654 objects 2024-04-26T12:17:03.200 INFO:tasks.radosbench.radosbench.0.smithi069.stdout:Clean up completed and total clean up time :58.3455 2024-04-26T12:17:03.200 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:17:03.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:03.202 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:17:03.203 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:17:03.203 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:17:03.203 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:17:03.300 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:03.298+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:03.305 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:03.306 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:03.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:03.401 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:03.399+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:03.413 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:03.413 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:03.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:03.501 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:03.500+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:03.522 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:03.522 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:03.531 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:03.602 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:03.601+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:03.645 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:03.645 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:03.654 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:03.702 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:03.702+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:03.797 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:03.798 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:03.804 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:03.803+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:03.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:03.905 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:03.904+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:03.908 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:03.908 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:03.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:04.007 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:04.005+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:04.021 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.022 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:04.107 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:04.106+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:04.171 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.172 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:04.208 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:04.207+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:04.281 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.281 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.290 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:04.310 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:04.308+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:04.403 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.403 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.410 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:04.409+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:04.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:04.512 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:04.511+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:04.555 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.555 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.564 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:04.648 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:04.647+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:04.705 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.705 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.714 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:04.712+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:04.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:04.815 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:04.814+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:04.816 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.816 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:04.916 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:04.915+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:04.924 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:04.924 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:04.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:04.989 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:17:05.018 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.017+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.074 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:05.074 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:05.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:05.123 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.122+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.184 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:05.185 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:05.193 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:05.204 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:17:05.218 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.217+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.293 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:05.294 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:05.302 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:05.320 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.319+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.321 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:17:05.322 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:17:05.322 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:17:05.339 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:17:05.339 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:17:05.342 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:17:05.342 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:17:05.405 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.769583549000004, 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:17:05.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.768468381000005, 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:17:05.410 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:17:05.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:17:05.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:05.415 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.768195797000004, 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:17:05.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:17:05.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.766929239999996, 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:05.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:17:05.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:17:05.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.766721791999998, 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:17:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.428 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.429 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:17:05.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.766296307999994, 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:17:05.431 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.432 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:17:05.433 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.434 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.435 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.766025368000001, 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:17:05.436 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.437 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:17:05.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:17:05.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:17:05.440 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 88.764951369000002, 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.442 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.443 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.444 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:17:05.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.087292576999999, 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.447 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.448 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.449 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.450 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.451 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.081032798999999, 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.452 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.453 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:17:05.454 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:17:05.455 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.078606215000001, 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.457 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.458 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:17:05.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:17:05.460 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.461 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:05.462 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.078318428999999, 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:17:05.464 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:17:05.465 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.078087416000002, 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:17:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:17:05.470 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.471 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.472 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.075313278000003, 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.473 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:17:05.475 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.476 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.477 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.478 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.494190302, 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.479 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:17:05.481 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:17:05.482 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.483 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.484 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.494096417000002, 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.485 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.486 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.487 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.488 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:17:05.489 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.490779461999999, 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:17:05.490 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:05.491 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.492 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.493 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:17:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.489563337, 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.496 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.497 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.498 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.499 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:17:05.500 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.501 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.489545657999997, 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.502 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:17:05.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:17:05.505 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.506 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.507 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 50.485966920000003, 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.508 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.509 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:17:05.511 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:17:05.512 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:05.513 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:05.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:05.516 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.513+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.615 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.614+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.620 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:17:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-04-26T12:17:05.620 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:05.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:05.716 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:05.715+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:05.769 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:05.770 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:17:05.770 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:17:05.770 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:17:05.770 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:05.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:05.821 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.820+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.881 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:17:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:17:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:17:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 99.645144806999994, 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:17:05.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:17:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.246088985, 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:17:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:17:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.523760951, 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:17:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.52340839, 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:17:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.519617479999994, 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:17:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.396831437000003, 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.221991754000001, 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.969963061000001, 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:17:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.969727544999998, 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:17:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:17:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.968549482999997, 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:17:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:17:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.967966859999997, 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:17:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.967241934, 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:17:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.967206998999998, 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:17:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:17:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:17:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.966538649999997, 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:17:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.966320652999997, 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.965070818000001, 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:17:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.964193569999999, 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:17:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:17:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.741256543999999, 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.582709355999999, 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:17:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.336095423, 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:17:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:17:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:17:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:17:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:05.984 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:05.986 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:05.986 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:05.984+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:05.992 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is set 2024-04-26T12:17:06.086 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:06.086+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:06.090 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-26T12:17:06.091 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:06.099 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:06.188 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:06.187+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:06.199 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:06.200 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:06.200 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:17:06.200 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:17:06.200 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:06.208 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:06.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-26T12:17:06.289 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:06.287+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:06.311 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:06.311 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:17:06.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:17:06.311 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.675466739000001, 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:06.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:17:06.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.674351571000003, 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:17:06.316 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:17:06.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:06.321 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.674078987000001, 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:17:06.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:17:06.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.672812429999993, 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:17:06.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.672604981999996, 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.333 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:17:06.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.672179498000006, 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:17:06.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.671908557999998, 2024-04-26T12:17:06.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:17:06.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 89.670834558999999, 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:17:06.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.354 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.993175766999997, 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:17:06.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.986915989000003, 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:17:06.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.984489404999998, 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:17:06.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:17:06.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:17:06.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.984201618999997, 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.371 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:17:06.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.374 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.983970606, 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.376 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:17:06.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 54.981196468, 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.382 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:17:06.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.389 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.400073491999997, 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:17:06.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:06.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:17:06.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.399979606999999, 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:17:06.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.401 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.396662652000003, 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:06.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:17:06.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.395446526999997, 2024-04-26T12:17:06.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:17:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.395428848000002, 2024-04-26T12:17:06.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:17:06.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:06.419 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 51.39185011, 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:06.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:06.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:06.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:06.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:06.425 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:06.427 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:06.425+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:06.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:06.527 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:06.525+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:06.529 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:17:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-04-26T12:17:06.530 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:06.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:06.627 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:06.626+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:06.638 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:06.638 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:17:06.638 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:17:06.638 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:17:06.638 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:06.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:06.728 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:06.727+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:06.748 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:06.748 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:17:06.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:17:06.748 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:17:06.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 100.512366822, 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:17:06.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.753 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 90.113310999999996, 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:17:06.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:17:06.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.390982965999996, 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.390630404999996, 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:17:06.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:17:06.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.386839495000004, 2024-04-26T12:17:06.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:17:06.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:17:06.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.264053451999999, 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:06.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:17:06.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.089213768999997, 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.837185075999997, 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:17:06.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:17:06.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.836949560000001, 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:17:06.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.835771498, 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:06.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.835188875, 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:17:06.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.834463949000003, 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:17:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.834429014000001, 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:17:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.833760665, 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:17:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.833542668, 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:17:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.832292832999997, 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:17:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.831415585000002, 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:17:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:17:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.608478559000002, 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:17:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.449931371000002, 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.203317437999999, 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:17:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:06.853 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:06.853 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:06.851+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:06.954 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:06.952+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:06.955 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:06.955 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:06.956 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-26T12:17:06.956 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:06.964 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:07.054 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:07.053+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:07.065 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:07.066 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:07.066 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:17:07.066 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:17:07.066 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:07.074 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:07.158 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:07.157+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.583014793000004, 2024-04-26T12:17:07.219 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:07.220 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.221 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.222 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:17:07.223 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.581899625000005, 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:07.225 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.226 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.227 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.228 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.229 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.581627041000004, 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.230 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.232 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:17:07.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.234 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:17:07.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.580360483999996, 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.237 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.238 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:17:07.239 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.240 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:07.241 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.580153035999999, 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.242 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.243 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:17:07.245 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.246 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.579727551999994, 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.247 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:07.248 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.249 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:17:07.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:17:07.251 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:07.252 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.579456612000001, 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.253 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.254 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:17:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 90.578382613000002, 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:07.259 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.260 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.261 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:17:07.262 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.263 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.900723821, 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:17:07.264 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.267 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:07.269 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.894464042999999, 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:07.270 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.271 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:17:07.272 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.273 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.274 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.892037459000001, 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:17:07.275 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.276 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.277 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:17:07.278 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:17:07.279 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.280 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.281 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.282 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.891749673, 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.283 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:17:07.284 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.285 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:17:07.286 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.287 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.891518660000003, 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.288 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:07.289 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.290 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:17:07.291 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:17:07.292 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.888744522000003, 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.294 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.295 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.296 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.297 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.298 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:17:07.299 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:07.300 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.307621546, 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:07.301 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.303 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.304 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:17:07.305 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.306 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.307527661000002, 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.307 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:17:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.311 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.312 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.304210705999999, 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:17:07.313 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:07.314 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.315 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:17:07.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.302994581, 2024-04-26T12:17:07.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:17:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.302976901999997, 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:17:07.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:17:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 52.299398164000003, 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:07.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:07.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:17:07.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:07.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:07.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:07.340 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:07.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:07.343 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:07.340+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:07.343 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:17:07.442 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:07.441+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:07.447 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-04-26T12:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:07.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:07.473 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:17:07.473 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:17:07.473 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:17:07.490 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:17:07.491 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:17:07.494 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:17:07.494 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:17:07.542 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:07.541+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:07.556 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:07.556 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:07.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:07.648 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:07.647+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:07.704 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:07.705 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:07.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:07.754 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:07.753+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:07.827 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:07.844 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:07.843+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:07.939 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:07.945 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:07.944+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:08.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:17:08.043 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.043 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.046 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:08.045+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:08.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:08.147 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:08.146+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:08.248 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:08.247+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:08.262 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.262 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:08.355 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:08.354+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:08.412 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.412 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.420 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:08.464 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:08.463+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:08.522 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.522 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.531 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:08.572 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:08.571+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:08.651 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:08.650+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:08.673 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.673 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:08.752 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:08.752+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:08.783 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.783 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:08.854 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:08.852+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:08.873 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-26T12:17:08.873 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-26T12:17:08.894 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:08.895 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:08.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:08.954 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:08.953+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:09.004 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:09.004 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:09.010 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:17:09.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:09.056 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:09.055+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:09.155 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:09.155 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:09.156 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:09.155+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:09.164 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:09.258 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:09.256+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:09.266 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:09.267 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:09.276 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:09.359 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:09.358+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:09.378 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:09.378 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:09.387 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:09.462 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-04-26T12:17:09.461+0000 7f5f0f3ed640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28645) UID: 0 2024-04-26T12:17:09.487 INFO:teuthology.orchestra.run.smithi172.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:09.487 INFO:teuthology.orchestra.run.smithi172.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:09.494 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:17:09.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:17:09.562 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:09.562+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:09.597 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-04-26T12:17:09.597 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:17:09.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:17:09.613 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0: {} 2024-04-26T12:17:09.613 INFO:teuthology.orchestra.run.smithi069.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:17:09.613 INFO:teuthology.orchestra.run.smithi069.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:17:09.631 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2: {} 2024-04-26T12:17:09.631 INFO:teuthology.orchestra.run.smithi069.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:17:09.634 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:17:09.634 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:17:09.663 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:09.662+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:09.705 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-04-26T12:17:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-04-26T12:17:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-04-26T12:17:09.706 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:09.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:17:09.764 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:09.763+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:09.817 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-04-26T12:17:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-04-26T12:17:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-04-26T12:17:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-04-26T12:17:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:72179 5.c 5:336676ff:::benchmark_data_smithi069_31227_object72178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:17:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.581138237, 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021600174999999999, 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 72179 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233999+0000", 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.233998+0000", 2024-04-26T12:17:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234055+0000", 2024-04-26T12:17:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7324000000000002e-05 2024-04-26T12:17:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234065+0000", 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8379999999999997e-06 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.234072+0000", 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3620000000000002e-06 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.245929+0000", 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011857510999999999 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.246037+0000", 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010840000000000001 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255524+0000", 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094869340000000007 2024-04-26T12:17:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255554+0000", 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-05 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:26.255599+0000", 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5244999999999998e-05 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:99262 5.a 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.182082414999996, 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.098681647999999997, 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99262 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633054+0000", 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633096+0000", 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2506000000000003e-05 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633107+0000", 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633112+0000", 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.339e-06 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633192+0000", 2024-04-26T12:17:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9857000000000005e-05 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633325+0000", 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132566 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.633638+0000", 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031273199999999997 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028721689999999999 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731562+0000", 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.095052637999999995 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731694+0000", 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013133599999999999 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:36.731736+0000", 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2299000000000003e-05 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142115 5.3 5:c661d27b:::benchmark_data_smithi069_31227_object142114:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.459754380999996, 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022021219000000002, 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142115 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355382+0000", 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355501+0000", 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118695 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355509+0000", 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5459999999999992e-06 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355515+0000", 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4750000000000001e-06 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360149+0000", 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00463431 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.360273+0000", 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124299 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376712+0000", 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016438325 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.376759+0000", 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7392000000000003e-05 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377404+0000", 2024-04-26T12:17:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064473000000000004 2024-04-26T12:17:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142120 5.3 5:ceb33463:::benchmark_data_smithi069_31227_object142119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.459401819999997, 2024-04-26T12:17:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021802311000000001, 2024-04-26T12:17:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142120 2024-04-26T12:17:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355735+0000", 2024-04-26T12:17:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355765+0000", 2024-04-26T12:17:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0618999999999999e-05 2024-04-26T12:17:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355771+0000", 2024-04-26T12:17:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1840000000000004e-06 2024-04-26T12:17:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.355776+0000", 2024-04-26T12:17:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2849999999999996e-06 2024-04-26T12:17:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.363970+0000", 2024-04-26T12:17:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008193868 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.364089+0000", 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011909900000000001 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377412+0000", 2024-04-26T12:17:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013323521 2024-04-26T12:17:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377469+0000", 2024-04-26T12:17:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6449000000000001e-05 2024-04-26T12:17:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.377537+0000", 2024-04-26T12:17:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8715999999999997e-05 2024-04-26T12:17:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:142126 5.3 5:cf148857:::benchmark_data_smithi069_31227_object142125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:17:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.455610910000004, 2024-04-26T12:17:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021045155999999999, 2024-04-26T12:17:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 142126 2024-04-26T12:17:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359526+0000", 2024-04-26T12:17:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359525+0000", 2024-04-26T12:17:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359567+0000", 2024-04-26T12:17:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2005000000000002e-05 2024-04-26T12:17:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359578+0000", 2024-04-26T12:17:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0709e-05 2024-04-26T12:17:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.359584+0000", 2024-04-26T12:17:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:17:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366071+0000", 2024-04-26T12:17:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064875180000000003 2024-04-26T12:17:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.366184+0000", 2024-04-26T12:17:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112537 2024-04-26T12:17:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380445+0000", 2024-04-26T12:17:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014261495000000001 2024-04-26T12:17:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380505+0000", 2024-04-26T12:17:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9332e-05 2024-04-26T12:17:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:15:53.380571+0000", 2024-04-26T12:17:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6314000000000002e-05 2024-04-26T12:17:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:188792 5.2 5:4497b8d2:::benchmark_data_smithi069_31227_object17135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.332824866999999, 2024-04-26T12:17:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021828404999999999, 2024-04-26T12:17:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 188792 2024-04-26T12:17:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482312+0000", 2024-04-26T12:17:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482311+0000", 2024-04-26T12:17:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482316+0000", 2024-04-26T12:17:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7169999999999999e-06 2024-04-26T12:17:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482328+0000", 2024-04-26T12:17:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-04-26T12:17:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.482334+0000", 2024-04-26T12:17:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485100+0000", 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027654020000000001 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.485369+0000", 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026907 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504034+0000", 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018665126000000001 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504076+0000", 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2001e-05 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.504140+0000", 2024-04-26T12:17:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4562999999999998e-05 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:189302 5.c 5:3b606c6f:::benchmark_data_smithi069_31227_object17645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.157985183999998, 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022142242999999999, 2024-04-26T12:17:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 189302 2024-04-26T12:17:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657152+0000", 2024-04-26T12:17:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657151+0000", 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657156+0000", 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657165+0000", 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0149999999999992e-06 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.657171+0000", 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6680000000000004e-06 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664142+0000", 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006970464 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.664273+0000", 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013087600000000001 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679150+0000", 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877559 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679225+0000", 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4398000000000002e-05 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:10.679294+0000", 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9170000000000004e-05 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201826 5.3 5:c5031cf7:::benchmark_data_smithi069_31227_object30169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.905956490999998, 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084585847000000006, 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201826 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909180+0000", 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909183+0000", 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909190+0000", 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909195+0000", 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909222+0000", 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6259999999999999e-05 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909390+0000", 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000168827 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993585+0000", 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084195019999999995 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993669+0000", 2024-04-26T12:17:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3214000000000007e-05 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993766+0000", 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7628999999999996e-05 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201823 5.b e43/16 5:da337836:::benchmark_data_smithi069_31227_object30166:head v 43'12717, mlcod=43'12715)", 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.905720975000001, 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.088742281000000006, 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909416+0000", 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909415+0000", 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909421+0000", 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909430+0000", 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1970000000000002e-06 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.909436+0000", 2024-04-26T12:17:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-06 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911309+0000", 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001873045 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911326+0000", 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6833e-05 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998096+0000", 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086770620000000007 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998158+0000", 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1877000000000004e-05 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201833 5.3 5:c43837d6:::benchmark_data_smithi069_31227_object30176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.904542913, 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.093258598999999998, 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201833 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910594+0000", 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910593+0000", 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910597+0000", 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910607+0000", 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.910613+0000", 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995866+0000", 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085253141000000005 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.996030+0000", 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163685 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003674+0000", 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076436330000000004 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003774+0000", 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100177 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003853+0000", 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8621000000000005e-05 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201828 5.b e43/16 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head v 43'12718, mlcod=43'12715)", 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.903960290000001, 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.087033431999999994, 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911177+0000", 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911176+0000", 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911181+0000", 2024-04-26T12:17:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911190+0000", 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911196+0000", 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912995+0000", 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799623 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.913013+0000", 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7518999999999999e-05 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998162+0000", 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085149328999999996 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998210+0000", 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7682000000000002e-05 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201834 5.3 5:cd81ba72:::benchmark_data_smithi069_31227_object30177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.903235363999997, 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.092321756000000005, 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201834 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911901+0000", 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911905+0000", 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911924+0000", 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8247999999999999e-05 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911930+0000", 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997964+0000", 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.086033420999999999 2024-04-26T12:17:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998104+0000", 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014049200000000001 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004112+0000", 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060076560000000001 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004165+0000", 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3347999999999998e-05 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004223+0000", 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8019999999999997e-05 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201835 5.7 5:e822ba28:::benchmark_data_smithi069_31227_object30178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.903200429000002, 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085720500000000005, 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201835 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911936+0000", 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911939+0000", 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911956+0000", 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.749e-05 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.911960+0000", 2024-04-26T12:17:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:17:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912257+0000", 2024-04-26T12:17:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000296197 2024-04-26T12:17:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912353+0000", 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6788999999999998e-05 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997542+0000", 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085188050000000001 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997587+0000", 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5453e-05 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997657+0000", 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9948000000000002e-05 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201839 5.7 5:ec47d9d2:::benchmark_data_smithi069_31227_object30182:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.90253208, 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085175704000000005, 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201839 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912605+0000", 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912604+0000", 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912611+0000", 2024-04-26T12:17:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912620+0000", 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4970000000000007e-06 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912626+0000", 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:17:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993379+0000", 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080752552000000005 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993573+0000", 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019482700000000001 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997669+0000", 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040951260000000001 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997715+0000", 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6059000000000001e-05 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997780+0000", 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5796000000000005e-05 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201837 5.b e43/16)", 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.902314083, 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085425896000000001, 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912823+0000", 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912822+0000", 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912827+0000", 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3470000000000001e-06 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912834+0000", 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.912839+0000", 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993619+0000", 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.080779904999999999 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993640+0000", 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0911e-05 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998226+0000", 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004585759 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998249+0000", 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2891000000000002e-05 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4546.0:201841 5.b e43/16 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head v 43'12720, mlcod=43'12715)", 2024-04-26T12:17:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.901064247999997, 2024-04-26T12:17:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.090027900999999994, 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914073+0000", 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914072+0000", 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914077+0000", 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:17:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993346+0000", 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.079269257999999995 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993371+0000", 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5466999999999999e-05 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995873+0000", 2024-04-26T12:17:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002501199 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995891+0000", 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8071999999999999e-05 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.003857+0000", 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079662750000000001 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:15.004101+0000", 2024-04-26T12:17:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000243639 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:201842 5.7 5:efdffe8d:::benchmark_data_smithi069_31227_object30185:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.900187000000003, 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.083104534999999993, 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 201842 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914950+0000", 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914949+0000", 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.914953+0000", 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2490000000000003e-06 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993357+0000", 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.078403426999999998 2024-04-26T12:17:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.993369+0000", 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1745e-05 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995629+0000", 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022604029999999998 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.995805+0000", 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017551700000000001 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997948+0000", 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021430030000000001 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.997989+0000", 2024-04-26T12:17:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1408000000000001e-05 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:14.998054+0000", 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5474000000000004e-05 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:264233 5.6 5:629b9cd0:::benchmark_data_smithi069_31227_object92576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.677249973999999, 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593775000000002, 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 264233 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137887+0000", 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137886+0000", 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137891+0000", 2024-04-26T12:17:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137901+0000", 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6180000000000001e-06 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.137907+0000", 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000001e-06 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145294+0000", 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073867289999999999 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.145458+0000", 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164296 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158330+0000", 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012871273000000001 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158417+0000", 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969e-05 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:36.158481+0000", 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4034000000000004e-05 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:288128 5.6 5:621579a6:::benchmark_data_smithi069_31227_object116471:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:17:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.518702785999999, 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020261211000000001, 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 288128 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296434+0000", 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296433+0000", 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296438+0000", 2024-04-26T12:17:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:17:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296448+0000", 2024-04-26T12:17:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9869999999999994e-06 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.296455+0000", 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-06 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303658+0000", 2024-04-26T12:17:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072030250000000001 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.303808+0000", 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014997900000000001 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316541+0000", 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012733352999999999 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316621+0000", 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0284000000000006e-05 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:44.316695+0000", 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3838999999999996e-05 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4546.0:312123 5.2 5:4d0ca876:::benchmark_data_smithi069_31227_object140466:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.272088853, 2024-04-26T12:17:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020914888999999999, 2024-04-26T12:17:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-04-26T12:17:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-04-26T12:17:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4546", 2024-04-26T12:17:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312123 2024-04-26T12:17:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-04-26T12:17:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-04-26T12:17:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-04-26T12:17:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543048+0000", 2024-04-26T12:17:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-04-26T12:17:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-04-26T12:17:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543047+0000", 2024-04-26T12:17:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4294967295.999999 2024-04-26T12:17:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-04-26T12:17:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543054+0000", 2024-04-26T12:17:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1849999999999998e-06 2024-04-26T12:17:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-04-26T12:17:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543067+0000", 2024-04-26T12:17:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:17:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-04-26T12:17:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.543074+0000", 2024-04-26T12:17:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:17:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-04-26T12:17:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554235+0000", 2024-04-26T12:17:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011161719000000001 2024-04-26T12:17:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-04-26T12:17:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.554367+0000", 2024-04-26T12:17:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013148599999999999 2024-04-26T12:17:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-04-26T12:17:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563794+0000", 2024-04-26T12:17:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094273959999999993 2024-04-26T12:17:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-04-26T12:17:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563878+0000", 2024-04-26T12:17:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4195000000000003e-05 2024-04-26T12:17:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-04-26T12:17:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-04-26T12:17:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-04-26T12:16:52.563963+0000", 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4485000000000002e-05 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-04-26T12:17:09.952 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-04-26T12:17:09.955 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-26T12:17:09.953+0000 7fdc15247640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28761) UID: 0 2024-04-26T12:17:09.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:17:10.016 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'unique_pool_0' removed 2024-04-26T12:17:10.030 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T12:17:10.040 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T12:17:10.083 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:10.083 INFO:teuthology.orchestra.run.smithi172.stdout: "num_ops": 0 2024-04-26T12:17:10.083 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:10.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:17:10.204 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [], 2024-04-26T12:17:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "complaint_time": 30, 2024-04-26T12:17:10.204 INFO:teuthology.orchestra.run.smithi172.stdout: "num_blocked_ops": 0 2024-04-26T12:17:10.204 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:10.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:17:10.316 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T12:17:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "size": 20, 2024-04-26T12:17:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 600, 2024-04-26T12:17:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: "ops": [ 2024-04-26T12:17:10.316 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_repop(client.4546.0:99262 5.a e30/16 5:5c49c160:::benchmark_data_smithi069_31227_object99261:head v 30'6190, mlcod=30'6188)", 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.679908462, 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097478758999999998, 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.317 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633759+0000", 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633758+0000", 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633845+0000", 2024-04-26T12:17:10.318 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6162999999999995e-05 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633854+0000", 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.1020000000000003e-06 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633859+0000", 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.319 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633896+0000", 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.6159999999999999e-05 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.633914+0000", 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8839e-05 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731208+0000", 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097293837999999994 2024-04-26T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731238+0000", 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9522999999999998e-05 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99266 5.9 5:98353925:::benchmark_data_smithi069_31227_object99265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.678793294000002, 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104615892, 2024-04-26T12:17:10.321 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99266 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.322 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634874+0000", 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634873+0000", 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634960+0000", 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6429999999999997e-05 2024-04-26T12:17:10.323 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634974+0000", 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.4562000000000001e-05 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.634981+0000", 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.029e-06 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635027+0000", 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5459e-05 2024-04-26T12:17:10.324 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635160+0000", 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013308499999999999 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739395+0000", 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.104235445 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739434+0000", 2024-04-26T12:17:10.325 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8825000000000002e-05 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739490+0000", 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.6039999999999999e-05 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99268 5.0 5:0f627607:::benchmark_data_smithi069_31227_object99267:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.678520710000001, 2024-04-26T12:17:10.326 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098383203000000002, 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99268 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635147+0000", 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635146+0000", 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635200+0000", 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4302000000000003e-05 2024-04-26T12:17:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635207+0000", 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635212+0000", 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635237+0000", 2024-04-26T12:17:10.329 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5644e-05 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635344+0000", 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010655899999999999 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.635459+0000", 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011483499999999999 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.330 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638014+0000", 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0025557599999999998 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733435+0000", 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.095420263000000005 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733485+0000", 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.0260000000000003e-05 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.331 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733530+0000", 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4926999999999999e-05 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99272 5.d 5:b956b57c:::benchmark_data_smithi069_31227_object99271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.677254153000007, 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097880830000000002, 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.332 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99272 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636413+0000", 2024-04-26T12:17:10.333 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636412+0000", 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636499+0000", 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.7074e-05 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.334 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636510+0000", 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636517+0000", 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8850000000000001e-06 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636547+0000", 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9689e-05 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.335 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4243000000000001e-05 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734144+0000", 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.097522602 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734187+0000", 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3451999999999997e-05 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.734294+0000", 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106896 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99273 5.9 5:9bcf265f:::benchmark_data_smithi069_31227_object99272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.677046704999995, 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10294576699999999, 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99273 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636621+0000", 2024-04-26T12:17:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636620+0000", 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636688+0000", 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8028000000000007e-05 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636696+0000", 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.9810000000000003e-06 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.636701+0000", 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3079999999999998e-06 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637409+0000", 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00070788199999999996 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637482+0000", 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739498+0000", 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10201534800000001 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739522+0000", 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3830999999999999e-05 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739566+0000", 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.4966999999999998e-05 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99274 5.9 5:9473c83a:::benchmark_data_smithi069_31227_object99273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.676621221000005, 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10260678600000001, 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99274 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637046+0000", 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637147+0000", 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00010093499999999999 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637153+0000", 2024-04-26T12:17:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6919999999999996e-06 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637158+0000", 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.442e-06 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731119+0000", 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.093961601000000006 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731244+0000", 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00012430199999999999 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739572+0000", 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0083285630000000006 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739603+0000", 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1235999999999997e-05 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739653+0000", 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9657000000000002e-05 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99276 5.9 5:9c20e087:::benchmark_data_smithi069_31227_object99275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.676350280999998, 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.10245470299999999, 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99276 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637317+0000", 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637437+0000", 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120239 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637444+0000", 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.328e-06 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.637449+0000", 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5190000000000003e-06 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733789+0000", 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.096340523999999997 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.350 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.733895+0000", 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000106028 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739661+0000", 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0057661350000000004 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739702+0000", 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.351 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.739772+0000", 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0261999999999999e-05 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:99279 5.b 5:d478e5c8:::benchmark_data_smithi069_31227_object99278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 93.675276281999999, 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.098931831999999997, 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.352 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 99279 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:10.353 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638391+0000", 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.638452+0000", 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1043999999999994e-05 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.354 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730576+0000", 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092124231000000001 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730611+0000", 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5349000000000003e-05 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.730740+0000", 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000129123 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.355 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731014+0000", 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00027348699999999999 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.731165+0000", 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015140299999999999 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737166+0000", 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060007599999999999 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.356 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737219+0000", 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3288000000000002e-05 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737288+0000", 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8856000000000006e-05 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:15:36.737323+0000", 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.4916000000000002e-05 2024-04-26T12:17:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191347 5.d 5:b88ac33e:::benchmark_data_smithi069_31227_object19690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.997617490000003, 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.068869538999999994, 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.358 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191347 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316050+0000", 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.359 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316049+0000", 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316054+0000", 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316062+0000", 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.4460000000000001e-06 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.360 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.316067+0000", 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319340+0000", 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0032725160000000001 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.319485+0000", 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014564600000000001 2024-04-26T12:17:10.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.326184+0000", 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0066987690000000003 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384833+0000", 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.058648325000000001 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384919+0000", 2024-04-26T12:17:10.362 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.6971000000000005e-05 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191367 5.d 5:b51ed2f3:::benchmark_data_smithi069_31227_object19710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.991357712000003, 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067278182000000006, 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.363 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191367 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322310+0000", 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322309+0000", 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322312+0000", 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.118e-06 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322319+0000", 2024-04-26T12:17:10.365 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.322324+0000", 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.536e-06 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324373+0000", 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0020488009999999998 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.366 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324520+0000", 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00014669699999999999 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389504+0000", 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064984181000000002 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389532+0000", 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8600999999999999e-05 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.367 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.389588+0000", 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.5578000000000002e-05 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191374 5.b 5:dbbd81a4:::benchmark_data_smithi069_31227_object19717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.988931127999997, 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067723824000000002, 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.368 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191374 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.369 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324736+0000", 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324735+0000", 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324741+0000", 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.8189999999999997e-06 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.370 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324751+0000", 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.7089999999999997e-06 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324757+0000", 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324796+0000", 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.9011000000000003e-05 2024-04-26T12:17:10.371 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.324935+0000", 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013857 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325055+0000", 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000120455 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.372 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385110+0000", 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060054812999999999 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392403+0000", 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0072928689999999996 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392426+0000", 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2819e-05 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.373 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392460+0000", 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.417e-05 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191378 5.d 5:b65b6a24:::benchmark_data_smithi069_31227_object19721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.988643342000003, 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.065957329999999995, 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191378 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.375 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325024+0000", 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325023+0000", 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325027+0000", 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8619999999999996e-06 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.376 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325038+0000", 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0528e-05 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325043+0000", 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385173+0000", 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.060130080000000002 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.377 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385347+0000", 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00017380499999999999 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390827+0000", 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0054799059999999997 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390909+0000", 2024-04-26T12:17:10.378 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.2387999999999998e-05 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.390981+0000", 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.1972999999999997e-05 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191379 5.b 5:d171dd57:::benchmark_data_smithi069_31227_object19722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.988412328999999, 2024-04-26T12:17:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.067273690999999997, 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191379 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.380 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325255+0000", 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325254+0000", 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325259+0000", 2024-04-26T12:17:10.381 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3549999999999998e-06 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325269+0000", 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.0002e-05 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.325275+0000", 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:17:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385225+0000", 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.059950245999999999 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385367+0000", 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000141645 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.383 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.385479+0000", 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011189800000000001 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392396+0000", 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0069171789999999999 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392470+0000", 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.4350999999999993e-05 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.384 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392501+0000", 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392529+0000", 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8163000000000001e-05 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:191384 5.b 5:de32f22d:::benchmark_data_smithi069_31227_object19727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 58.985638191, 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.064577787999999997, 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 191384 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.386 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328029+0000", 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328028+0000", 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.387 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.328035+0000", 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5950000000000004e-06 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384782+0000", 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.056746895999999998 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.384802+0000", 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0428000000000002e-05 2024-04-26T12:17:10.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387569+0000", 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0027669119999999998 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.387725+0000", 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00015622100000000001 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.389 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.388101+0000", 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000375495 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392535+0000", 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044342549999999998 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392556+0000", 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.0993999999999999e-05 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.390 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392578+0000", 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2036e-05 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:11.392607+0000", 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9054999999999999e-05 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201823 5.b 5:da337836:::benchmark_data_smithi069_31227_object30166:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.404515215000004, 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089131862000000006, 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201823 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.392 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909152+0000", 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.393 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909156+0000", 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.0509999999999998e-06 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909164+0000", 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 8.3380000000000005e-06 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909169+0000", 2024-04-26T12:17:10.394 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.9790000000000001e-06 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909197+0000", 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7650000000000001e-05 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909299+0000", 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000102475 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.395 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909359+0000", 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.9747000000000002e-05 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914919+0000", 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0055606730000000004 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998242+0000", 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083322150999999997 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.396 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998266+0000", 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.3981e-05 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998284+0000", 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8507000000000001e-05 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201828 5.b 5:d2b8fcec:::benchmark_data_smithi069_31227_object30171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:10.397 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.404421329999998, 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.089129703000000005, 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201828 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909246+0000", 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.399 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909248+0000", 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.627e-06 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909254+0000", 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.909259+0000", 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.3059999999999999e-06 2024-04-26T12:17:10.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.910931+0000", 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0016727020000000001 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911049+0000", 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00011788799999999999 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.401 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.911120+0000", 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917193+0000", 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060726970000000002 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998309+0000", 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081116267000000006 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.402 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998346+0000", 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.7344e-05 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998376+0000", 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9374999999999999e-05 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201837 5.b 5:d9d10595:::benchmark_data_smithi069_31227_object30180:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.401104375000003, 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.085879678000000001, 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201837 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912563+0000", 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912562+0000", 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.405 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912569+0000", 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 7.046e-06 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912580+0000", 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.1007e-05 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912587+0000", 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.212e-06 2024-04-26T12:17:10.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912622+0000", 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.5283000000000001e-05 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912716+0000", 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 9.3772999999999998e-05 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.912773+0000", 2024-04-26T12:17:10.407 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.7615000000000003e-05 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917213+0000", 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0044398179999999999 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998401+0000", 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.081188276000000004 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.408 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998424+0000", 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.2459999999999998e-05 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.998443+0000", 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.8915000000000001e-05 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201840 5.4 5:2fe497b4:::benchmark_data_smithi069_31227_object30183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:10.409 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.399888249999997, 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.084206703999999993, 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201840 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.410 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913779+0000", 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913778+0000", 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.411 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913781+0000", 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913788+0000", 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.5150000000000003e-06 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913792+0000", 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8099999999999999e-06 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913824+0000", 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2722999999999998e-05 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913958+0000", 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.00013382699999999999 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7050000000000003e-05 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920120+0000", 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.006094253 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997926+0000", 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.077806207000000002 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997956+0000", 2024-04-26T12:17:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0162999999999999e-05 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.997986+0000", 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.0001e-05 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201841 5.b 5:d33e9a80:::benchmark_data_smithi069_31227_object30184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.399870571000001, 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.092460335000000005, 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.415 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201841 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:10.416 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913797+0000", 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.9999995 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913798+0000", 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.48e-06 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913801+0000", 2024-04-26T12:17:10.417 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913804+0000", 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.5629999999999999e-06 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913832+0000", 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.418 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.913957+0000", 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000124506 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.914025+0000", 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.8214999999999997e-05 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.920102+0000", 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0060772889999999996 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.419 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006180+0000", 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.086077446000000002 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006225+0000", 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4.5498999999999999e-05 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.006257+0000", 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.1945e-05 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.420 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "description": "osd_op(client.4546.0:201846 5.4 5:291e9915:::benchmark_data_smithi069_31227_object30189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "initiated_at": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "age": 55.396291832999999, 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.083508771999999995, 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "type_data": { 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_info": { 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client": "client.4546", 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "client_addr": "172.21.15.69:0/240268588", 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: "tid": 201846 2024-04-26T12:17:10.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "events": [ 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "initiated", 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "throttled", 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917376+0000", 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "header_read", 2024-04-26T12:17:10.422 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917375+0000", 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 4294967295.999999 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "all_read", 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917380+0000", 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 5.3730000000000001e-06 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "dispatched", 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917393+0000", 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 1.2424e-05 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "queued_for_pg", 2024-04-26T12:17:10.423 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917399+0000", 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "reached_pg", 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917438+0000", 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 3.8634999999999999e-05 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "started", 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917541+0000", 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.000103342 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.424 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "waiting for subops from 0", 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.917604+0000", 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 6.2260000000000004e-05 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "op_commit", 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:14.922659+0000", 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.0050558139999999996 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000836+0000", 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 0.078176464000000001 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.425 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "commit_sent", 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000863+0000", 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.7010000000000001e-05 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: "event": "done", 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: "time": "2024-04-26T12:16:15.000884+0000", 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: "duration": 2.1488000000000002e-05 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-26T12:17:10.426 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T12:17:11.024 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:17:12.026 INFO:teuthology.orchestra.run.smithi069.stderr:noscrub is unset 2024-04-26T12:17:12.043 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:17:12.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-26T12:17:13.041 INFO:teuthology.orchestra.run.smithi069.stderr:nodeep-scrub is unset 2024-04-26T12:17:17.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-04-26T12:17:23.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2024-04-26T12:17:29.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~141s 2024-04-26T12:17:34.124 DEBUG:teuthology.orchestra.console.smithi113:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.-  21.15.113 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d7:c1)... Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   Configuring (net0 0c:c4:7a:8f:d7:c1).... Configuring (net0 0c:c4:7a:8f:d7:c1)..... PXE-E61: Media test failure, check cable  [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9               The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.     The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      Probing EDD (edd=off to disable)... ok [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eaffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f62000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.916 MHz processor [ 0.000408] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000412] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000414] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000737] last_pfn = 0x78eb0 max_arch_pfn = 0x400000000 [ 0.006533] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006541] Using GB pages for direct mapping [ 0.006687] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006690] ACPI: Early table checksum verification disabled [ 0.006692] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006695] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.006700] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006704] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006707] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.006709] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006712] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006714] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006716] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006719] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006721] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006723] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006726] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006728] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006730] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006733] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006735] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006737] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006740] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006742] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006744] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006747] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006749] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.006750] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.006750] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.006751] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.006752] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.006752] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.006753] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.006754] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.006754] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.006755] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.006755] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.006756] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.006756] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.006757] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.006758] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.006758] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.006759] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.006759] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.006760] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.006761] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.006806] No NUMA configuration found [ 0.006807] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006816] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.007012] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007047] Zone ranges: [ 0.007048] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007049] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007051] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007052] Device empty [ 0.007052] Movable zone start for each node [ 0.007055] Early memory node ranges [ 0.007055] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007056] node 0: [mem 0x0000000000100000-0x0000000078eaffff] [ 0.007057] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007061] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007065] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007103] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011879] On node 0, zone Normal: 29008 pages in unavailable ranges [ 0.011990] ACPI: PM-Timer IO Port: 0x408 [ 0.011998] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012011] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012015] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012017] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012019] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012023] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012023] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012028] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012029] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012038] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012040] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x78eb0000-0x78f61fff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x78f62000-0x798affff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012046] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012047] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012048] Booting paravirtualized kernel on bare hardware [ 0.012050] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016375] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016593] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016618] Fallback order for Node 0: 0 [ 0.016620] Built 1 zonelists, mobility grouping on. Total pages: 8228725 [ 0.016621] Policy zone: Normal [ 0.016622] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016678] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016694] random: crng init done [ 0.018870] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020008] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020258] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020265] software IO TLB: area num 8. [ 0.047682] Memory: 1750092K/33437928K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989200K reserved, 0K cma-reserved) [ 0.047781] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047789] Kernel/User page tables isolation: enabled [ 0.047813] ftrace: allocating 46993 entries in 184 pages [ 0.065936] ftrace: allocated 184 pages with 4 groups [ 0.066442] Dynamic Preempt: voluntary [ 0.066471] rcu: Preemptible hierarchical RCU implementation. [ 0.066472] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066473] Trampoline variant of Tasks RCU enabled. [ 0.066473] Rude variant of Tasks RCU enabled. [ 0.066474] Tracing variant of Tasks RCU enabled. [ 0.066474] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066475] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069696] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069856] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.069961] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075200] Console: colour VGA+ 80x25 [ 1.096580] printk: console [ttyS1] enabled [ 1.100770] ACPI: Core revision 20230331 [ 1.104862] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.113991] APIC: Switch to symmetric I/O mode setup [ 1.118963] DMAR: Host address width 46 [ 1.122807] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128122] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136125] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142392] DMAR: ATSR flags: 0x0 [ 1.145712] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.151980] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158330] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.164682] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170083] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170083] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185106] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190409] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196635] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.206993] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327301f09f4, max_idle_ns: 440795304515 ns [ 1.217505] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.83 BogoMIPS (lpj=3499916) [ 1.218523] CPU0: Thermal monitoring enabled (TM1) [ 1.219561] process: using mwait in idle threads [ 1.220506] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221504] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222506] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223505] Spectre V2 : Mitigation: Retpolines [ 1.224504] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225504] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226505] Speculative Store Bypass: Vulnerable [ 1.227510] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228504] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229504] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230507] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231504] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232504] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233505] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234504] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.246922] Freeing SMP alternatives memory: 36K [ 1.247505] pid_max: default: 32768 minimum: 301 [ 1.248523] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249509] Yama: becoming mindful. [ 1.250508] SELinux: Initializing. [ 1.251521] LSM support for eBPF active [ 1.252562] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253542] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357343] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358600] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359504] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360516] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361514] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362513] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363505] ... version: 3 [ 1.364504] ... bit width: 48 [ 1.365504] ... generic registers: 4 [ 1.366504] ... value mask: 0000ffffffffffff [ 1.367504] ... max period: 00007fffffffffff [ 1.368504] ... fixed-purpose events: 3 [ 1.369505] ... event mask: 000000070000000f [ 1.370587] signal: max sigframe size: 1776 [ 1.371515] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372530] rcu: Hierarchical SRCU implementation. [ 1.372530] rcu: Max phase no-delay instances is 400. [ 1.372538] printk: console [ttyS1] printing thread started [ 1.377107] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377171] smp: Bringing up secondary CPUs ... [ 1.377238] smpboot: x86: Booting SMP configuration: [ 1.377239] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.383765] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.383765] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.383765] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.383765] smp: Brought up 1 node, 8 CPUs [ 1.383765] smpboot: Max logical packages: 1 [ 1.383765] smpboot: Total of 8 processors activated (55998.65 BogoMIPS) [ 1.429525] node 0 deferred pages initialised in 37ms [ 1.431538] devtmpfs: initialized [ 1.431544] x86/mm: Memory block size: 128MB [ 1.433099] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.433099] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.433099] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.433099] pinctrl core: initialized pinctrl subsystem [ 1.442746] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.442834] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.442845] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.442853] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.442861] audit: initializing netlink subsys (disabled) [ 1.442866] audit: type=2000 audit(1714133825.245:1): state=initialized audit_enabled=0 res=1 [ 1.442866] thermal_sys: Registered thermal governor 'fair_share' [ 1.442866] thermal_sys: Registered thermal governor 'step_wise' [ 1.442866] thermal_sys: Registered thermal governor 'user_space' [ 1.450507] cpuidle: using governor menu [ 1.460523] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.460524] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.460572] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.460575] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.460584] PCI: Using configuration type 1 for base access [ 1.478534] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.478539] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.478539] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.478539] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.478539] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.486507] cryptd: max_cpu_qlen set to 1000 [ 1.502202] ACPI: Added _OSI(Module Device) [ 1.502202] ACPI: Added _OSI(Processor Device) [ 1.502203] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.502203] ACPI: Added _OSI(Processor Aggregator Device) [ 1.502204] ACPI: Added _OSI(Linux-Dell-Video) [ 1.502205] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.502205] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.525901] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.528053] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.530632] ACPI: Dynamic OEM Table Load: [ 1.548095] ACPI: _OSC evaluated successfully for all CPUs [ 1.548358] ACPI: Interpreter enabled [ 1.548368] ACPI: PM: (supports S0 S4 S5) [ 1.548369] ACPI: Using IOAPIC for interrupt routing [ 1.549879] HEST: Enabling Firmware First mode for corrected errors. [ 1.596457] HEST: Table parsing has been initialized. [ 1.596576] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.596578] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.596579] PCI: Using E820 reservations for host bridge windows [ 1.597023] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.619514] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.619518] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.620630] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.621156] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.621157] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.621183] PCI host bridge to bus 0000:ff [ 1.621185] pci_bus 0000:ff: root bus resource [bus ff] [ 1.621195] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.621238] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.621269] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.621297] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.621326] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.621354] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.621382] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.621410] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.621439] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.621466] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.621495] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.621525] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.621553] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.621581] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.621609] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.621637] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.621664] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.621691] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.621719] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.621740] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.621775] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621834] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621893] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621950] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622008] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622065] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622122] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.622167] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.622215] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622273] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622332] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622389] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622446] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.622492] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.622526] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.622556] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.622587] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622627] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622669] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.62270] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622751] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.622785] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.622814] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.622844] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.622879] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.622909] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.622940] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.622970] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.623002] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.623030] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.623059] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.623088] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.623109] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.623141] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.623171] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.625394] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.625397] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.625530] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.625773] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.625774] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.626175] PCI host bridge to bus 0000:00 [ 1.626176] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.626178] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.626178] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.626179] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.626180] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.626181] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.626182] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.626201] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.626301] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.626313] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.626348] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.626438] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.626449] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.626452] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.626485] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.626573] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.626584] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.626586] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.626588] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.626592] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.626621] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.626702] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626709] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.626784] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626792] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.626864] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626871] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.626944] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626951] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.627025] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627032] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.627102] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627109] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.627180] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627187] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.627261] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627269] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.627338] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627398] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627477] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627534] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.627539] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.627617] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.627853] p] type 00 class [ 1.627872] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.627884] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.627895] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.627906] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.627917] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.627928] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.627986] pci 0000:00:11.4: PME# supported from D3hot [ 1.628061] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.628085] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.628170] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.628256] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.628280] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.628367] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.628431] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.628455] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.628544]upported from D0 D3hot D3cold [ 1.62d] type 00 classt [ 1.628651] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.628765] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.628843] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.628880] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.628971] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.629068] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.629107] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.629113] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.629116] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.629204] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.629298] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.629334] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.629340] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.629343] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.629430] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.629533] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.629553] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.629668] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.629748] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 convention58] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.629975] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.629986] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.629996] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.630007] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.630017] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.630028] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.630081] pci 0000:00:1f.2: PME# supported from D3hot [ 1.630139] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.630162] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.630191] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.6303 Slot [1] registered [ 1.630363] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.630467] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.630476] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.630492] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.630495] pci 0000:02:00.0: enabling Extended Tags [ 1.630598] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.630704] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630714] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.63ci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.630729] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.630734] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.630770] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.630786] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630787] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.630796] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630797] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.630948] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630958] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.630962] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.630972] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.630977] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.631012] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.631026] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.631027] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.631035] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.631036] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.631170] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.631214] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.631307] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.631379] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.631392] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.631397] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.631450] pci 0000:05:00.0: enabling Extended Tags [ 1.631573] pci 0000:05:00.0: supports D1 D2 [ 1.631574] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.631705] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.631792] pci_bus 0000:06: extended config space not accessible [ 1.631825] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.631862] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.631881] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.631901] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.631999] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.632069] pci 0000:06:00.0: supports D1 D2 [ 1.632070] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.632219] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.632364] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.632397] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.632433] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.632452] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.632676] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.632738] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632739] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.632773] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632773] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.633104] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.633138] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.633174] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.633192] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.633409] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.633470] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633470] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.633505] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633505] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.633816] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.633828] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.634731] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.634772] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.634814] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.634852] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.634892] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.634893] ACPI: PCI: Interrupt link LNKE disabled [ 1.634932] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.634933] ACPI: PCI: Interrupt link LNKF disabled [ 1.634972] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.634973] ACPI: PCI: Interrupt link LNKG disabled [ 1.635010] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.635012] ACPI: PCI: Interrupt link LNKH disabled [ 1.635515] iommu: Default domain type: Translated [ 1.635515] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.635609] SCSI subsystem initialized [ 1.635629] ACPI: bus type USB registered [ 1.635643] usbcore: registered new interface driver usbfs [ 1.635650] usbcore: registered new interface driver hub [ 1.635656] usbcore: registered new device driver usb [ 1.635680] pps_core: LinuxPPS API ver. 1 registered [ 1.635681] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.635683] PTP clock support registered [ 1.635699] EDAC MC: Ver: 3.0.0 [ 1.635713] NetLabel: Initializing [ 1.635714] NetLabel: domain hash size = 128 [ 1.635714] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.635729] NetLabel: unlabeled traffic allowed by default [ 1.635730] PCI: Using ACPI for IRQ routing [ 1.646567] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.646567] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.646567] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.646567] vgaarb: loaded [ 1.646567] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.646567] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.654924] clocksource: Switched to clocksource tsc-early [ 1.663308] VFS: Disk quotas dquot_6.6.0 [ 1.663316] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.663365] pnp: PnP ACPI init [ 1.663687] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.663689] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.663690] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.663691] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.663692] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.663693] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.663694] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.663695] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.663696] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.663697] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.663698] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.663699] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.663700] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.663854] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.663855] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.663856] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.663857] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.663857] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.664538] pnp: PnP ACPI: found 5 devices [ 1.669913] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.669974] NET: Registered PF_INET protocol family [ 1.670157] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.672568] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.672595] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.672599] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.672812] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.672923] TCP: Hash tables configured (established 262144 bind 65536) [ 1.673038] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.673122] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.673175] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.673249] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.673255] NET: Registered PF_XDP protocol family [ 1.673275] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.673285] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.673287] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.673292] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.673294] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.673299] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673301] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673302] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673303] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673304] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673305] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673306] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673307] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673308] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673309] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673310] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673311] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673312] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673313] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673314] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673315] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673316] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.673317] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.673319] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.673321] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.673324] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.673337] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.673340] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.673348] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673363] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673365] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.673371] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673380] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.673388] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.673394] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.673400] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.673407] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.673408] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.673414] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.673417] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.673423] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.673424] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.673425] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.673426] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.673426] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.673427] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.673428] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.673429] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.673430] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.673430] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.673431] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.673432] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.673433] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.673434] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.673435] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.673435] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.673436] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.673437] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.673602] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.690553] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16392 usecs [ 1.706546] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15601 usecs [ 1.706560] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.706594] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.706595] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.706600] ACPI: bus type thunderbolt registered [ 1.706605] Trying to unpack rootfs image as initramfs... [ 1.770724] Initialise system trusted keyrings [ 1.770733] Key type blacklist registered [ 1.770780] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.772666] zbud: loaded [ 1.878855] integrity: Platform Keyring initialized [ 1.878860] integrity: Machine keyring initialized [ 1.886751] NET: Registered PF_ALG protocol family [ 1.886753] xor: automatically using best checksumming function avx [ 1.886756] Key type asymmetric registered [ 1.886757] Asymmetric key parser 'x509' registered [ 1.886757] Running certificate verification selftests [ 1.888029] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.888515] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.888543] io scheduler mq-deadline registered [ 1.888544] io scheduler kyber registered [ 1.888584] io scheduler bfq registered [ 1.920091] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.920430] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.920590] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.920735] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.920869] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.921024] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.921170] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.921328] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.921398] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.928714] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.928734] ACPI: button: Power Button [PWRB] [ 1.928755] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.928783] ACPI: button: Power Button [PWRF] [ 1.937268] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.937270] pstore: Registered erst as persistent store backend [ 1.937354] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.937439] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.944905] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.954575] Non-volatile memory driver v1.3 [ 1.963720] rdac: device handler registered [ 1.963751] hp_sw: device handler registered [ 1.963752] emc: device handler registered [ 1.963770] alua: device handler registered [ 1.964058] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.964099] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 1.964112] ehci-pci 0000:00:1a.0: debug port 2 [ 1.968030] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.974519] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.974564] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.974566] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.974568] usb usb1: Product: EHCI Host Controller [ 1.974569] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.974570] usb usb1: SerialNumber: 0000:00:1a.0 [ 1.974671] hub 1-0:1.0: USB hub found [ 1.974678] hub 1-0:1.0: 2 ports detected [ 1.974840] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.974878] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.975968] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.976198] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.976202] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.976253] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4 [ 1.976255] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.976261] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.976271] ehci-pci 0000:00:1d.0: debug port 2 [ 1.976303] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.976305] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.976306] usb usb2: Product: xHCI Host Controller [ 1.976307] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.976308] usb usb2: SerialNumber: 0000:00:14.0 [ 1.976412] hub 2-0:1.0: USB hub found [ 1.976446] hub 2-0:1.0: 15 ports detected [ 1.979834] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.979836] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.979838] usb usb3: Product: xHCI Host Controller [ 1.979839] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.979840] usb usb3: SerialNumber: 0000:00:14.0 [ 1.979940] hub 3-0:1.0: USB hub found [ 1.979959] hub 3-0:1.0: 6 ports detected [ 1.980199] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.981733] usbcore: registered new interface driver usbserial_generic [ 1.981737] usbserial: USB Serial support registered for generic [ 1.981768] i8042: PNP: No PS/2 controller found. [ 1.981829] mousedev: PS/2 mouse device common for all mice [ 1.981899] rtc_cmos 00:00: RTC can wake from S4 [ 1.982182] rtc_cmos 00:00: registered as rtc0 [ 1.982229] rtc_cmos 00:00: setting system clock to 2024-04-26T12:17:07 UTC (1714133827) [ 1.982255] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.986534] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.986566] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.986568] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.986569] usb usb4: Product: EHCI Host Controller [ 1.986569] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.986570] usb usb4: SerialNumber: 0000:00:1d.0 [ 1.986647] hub 4-0:1.0: USB hub found [ 1.986650] hub 4-0:1.0: 2 ports detected [ 2.026552] intel_pstate: Intel P-state driver initializing [ 2.030141] Freeing initrd memory: 33136K [ 2.158211] hid: raw HID events driver (C) Jiri Kosina [ 2.158246] usbcore: registered new interface driver usbhid [ 2.158247] usbhid: USB HID core driver [ 2.158286] drop_monitor: Initializing network drop monitor service [ 2.166660] Initializing XFRM netlink socket [ 2.166733] NET: Registered PF_INET6 protocol family [ 2.171250] Segment Routing with IPv6 [ 2.171265] NET: Registered PF_PACKET protocol family [ 2.171285] mpls_gso: MPLS GSO support [ 2.190965] microcode: Current revision: 0x0b000010 [ 2.215690] resctrl: L3 allocation detected [ 2.215692] resctrl: L3 monitoring detected [ 2.215703] IPI shorthand broadcast: enabled [ 2.215707] AVX2 version of gcm_enc/dec engaged. [ 2.228541] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.228552] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.232150] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.254897] AES CTR mode by8 optimization enabled [ 2.254935] sched_clock: Marking stable (1126885109, 1127619621)->(2655761556, -401256826) [ 2.272307] registered taskstats version 1 [ 2.288179] Loading compiled-in X.509 certificates [ 2.288689] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.288975] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.289240] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.289378] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.289387] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.289617] zswap: loaded using pool lzo/zbud [ 2.298988] page_owner is disabled [ 2.299160] pstore: Using crash dump compression: deflate [ 2.299169] Key type big_key registered [ 2.356700] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.356703] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.357279] hub 2-12:1.0: USB hub found [ 2.357360] hub 2-12:1.0: 4 ports detected [ 2.361829] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.361831] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.361990] hub 1-1:1.0: USB hub found [ 2.362078] hub 1-1:1.0: 6 ports detected [ 2.381321] Key type encrypted registered [ 2.381328] ima: No TPM chip found, activating TPM-bypass! [ 2.381330] Loading compiled-in module X.509 certificates [ 2.381617] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.381619] ima: Allocated hash algorithm: sha256 [ 2.381628] ima: No architecture policies found [ 2.381634] evm: Initialising EVM extended attributes: [ 2.381635] evm: security.selinux [ 2.381635] evm: security.SMACK64 (disabled) [ 2.381636] evm: security.SMACK64EXEC (disabled) [ 2.381636] evm: security.SMACK64TRANSMUTE (disabled) [ 2.381636] evm: security.SMACK64MMAP (disabled) [ 2.381637] evm: security.apparmor (disabled) [ 2.381637] evm: security.ima [ 2.381637] evm: security.capability [ 2.381638] evm: HMAC attrs: 0x1 [ 2.392458] usb 4-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.392461] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.392619] hub 4-1:1.0: USB hub found [ 2.392705] hub 4-1:1.0: 8 ports detected [ 2.706529] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.764515] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 2.764519] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 2.768310] clocksource: Switched to clocksource tsc [ 2.865705] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.865707] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.912609] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.964655] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.977347] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.977420] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.253792] Freeing unused decrypted memory: 2028K [ 5.254259] Freeing unused kernel image (initmem) memory: 3928K [ 5.263536] Write protecting the kernel read-only data: 28672k [ 5.271145] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.312981] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.312982] x86/mm: Checking user space page tables [ 5.350409] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.350421] Run /init as init process [ 5.363368] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.363469] systemd[1]: Detected architecture x86-64. [ 5.363470] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.414746] systemd[1]: Hostname set to . [ OK [[ 5.470180] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.470286] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.491638] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.505602] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.517689] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.528619] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.540784] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.555711] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.569834] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.581840] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.595701] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.609592] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.628196] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.643880] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.655683] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.656221] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.678083] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.690055] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.703436] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. [ 6.077071] dca service started, version 1.12.1 Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen[[ 6.118987] igb: Intel(R) Gigabit Ethernet Network Driver 0m. [ [ 6.118989] igb: Copyright (c) 2007-2014 Intel Corporation. OK ] Starte[ 6.119602] nvme nvme0: pci function 0000:02:00.0 d Forwa[ 6.125718] nvme nvme0: 8/0/0 default/read/poll queues rd Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units.[ 6.153309] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ OK [ 6.153312] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ] Reached target B[ 6.169028] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.169031] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst asic System.[ 6.177898] scsi host0: ahci [ 6.178200] scsi host1: ahci [ 6.178453] scsi host2: ahci [ 6.178720] scsi host3: ahci [ 6.178758] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 6.178761] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 6.178764] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 6.178766] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 6.179093] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.179096] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.185150] igb 0000:07:00.0: added PHC on eth0 [ 6.185181] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.185182] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:44 [ 6.185257] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.185258] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.192636] ACPI: bus type drm_connector registered [ 6.194352] scsi host4: ahci [ 6.194782] scsi host5: ahci [ 6.195016] scsi host6: ahci [ 6.195101] scsi host7: ahci [ 6.195429] scsi host8: ahci [ 6.195560] scsi host9: ahci [ 6.195617] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 lpm-pol 0 [ 6.195620] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 lpm-pol 0 [ 6.195623] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 lpm-pol 0 [ 6.195625] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 lpm-pol 0 [ 6.195628] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 lpm-pol 0 [ 6.195630] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 lpm-pol 0 [ 6.240984] igb 0000:07:00.1: added PHC on eth1 [ 6.241010] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.241012] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:45 [ 6.241088] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.241089] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.254198] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.260183] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.263839] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.285629] Console: switching to colour dummy device 80x25 [ 6.285776] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.285778] ast 0000:06:00.0: [drm] AST 2400 detected [rm] Using analog VGA [ 6.285793] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.285939] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.297959] fbcon: astdrmfb (fb0) is primary device [ 6.322837] Console: switching to colour frame buffer device 128x48 [ 6.341559] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.489853] ata3: SATA link down (SStatus 0 SControl 300) [ 6.490080] ata4: SATA link down (SStatus 0 SControl 300) [ 6.490556] ata1: SATA link down (SStatus 0 SControl 300) [ 6.490842] ata2: SATA link down (SStatus 0 SControl 300) [ 6.506867] ata6: SATA link down (SStatus 0 SControl 300) [ 6.506909] ata7: SATA link down (SStatus 0 SControl 300) [ 6.506968] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.507017] ata10: SATA link down (SStatus 0 SControl 300) [ 6.507160] ata9: SATA link down (SStatus 0 SControl 300) [ 6.507523] ata8: SATA link down (SStatus 0 SControl 300) [ 6.508045] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.508534] ata5.00: NCQ Send/Recv Log not supported [ 6.508535] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.509936] ata5.00: NCQ Send/Recv Log not supported [ 6.509939] ata5.00: cUDMA/133 [ 6: Direct-Access 0NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.584608] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.653485] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.653499] sd 4:0:0:0: [sda] Write Protect is off [ 6.653518] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.653541] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.670874] sda: sda1 [ 6.670929] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.289918] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.290207] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.290289] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.290290] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d7:c0 [ 7.293340] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.449882] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.450169] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.450251] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.450252] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d7:c1 [ 7.453249] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.469785] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.495388] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ OK [[ 7.711688] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. 0m] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Start[ 8.038777] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). ing Switch Root... [ 8.569800] SELinux: policy capability network_peer_controls=1 [ 8.569803] SELinux: policy capability open_perms=1 [ 8.569804] SELinux: policy capability extended_socket_class=1 [ 8.569804] SELinux: policy capability always_check_network=0 [ 8.569805] SELinux: policy capability cgroup_seclabel=1 [ 8.569805] SELinux: policy capability nnp_nosuid_transition=1 [ 8.569805] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.612933] audit: type=1403 audit(1714133834.130:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.615248] systemd[1]: Successfully loaded SELinux policy in 108.634ms. [ 8.666141] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.118ms. [ 8.674322] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.674424] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.727541] systemd[1]: Hostname set to . [ OK [[ 9.664800] systemd[1]: initrd-switch-root.service: Deactivated successfully. 0m] Stopped [0;[ 9.664896] systemd[1]: Stopped Switch Root. [ 9.665353] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.665690] systemd[1]: Created slice Slice /system/getty. 1;39mSwitch Root[ 9.693980] systemd[1]: Created slice Slice /system/modprobe. . [[ 9.694315] systemd[1]: Created slice Slice /system/serial-getty. [ 9.694587] systemd[1]: Created slice Slice /system/sshd-keygen. OK ] Crea[ 9.714642] systemd[1]: Created slice User and Session Slice. [ 9.714674] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.714774] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.715100] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.715143] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.715167] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.715183] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.715200] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.715216] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.715232] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.715250] systemd[1]: Reached target Local Encrypted Volumes. [ 9.715275] systemd[1]: Stopped target Switch Root. [ 9.715297] systemd[1]: Stopped target Initrd File Systems. [ 9.715312] systemd[1]: Stopped target Initrd Root File System. [ 9.715340] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.715378] systemd[1]: Reached target Path Units. [ 9.715407] systemd[1]: Reached target Slice Units. [ 9.715428] systemd[1]: Reached target Swaps. [ 9.715447] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.715825] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.840019] systemd[1]: Listening on LVM2 poll daemon socket. [ 9.868675] systemd[1]: Listening on RPCbind Server Activation Socket. ted slice [0;1;[ 9.884744] systemd[1]: Reached target RPC Port Mapper. [ 9.886033] systemd[1]: Listening on Process Core Dump Socket. 39mSlice /system[ 9.897294] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.897728] systemd[1]: Listening on udev Control Socket. /getty. [[ 9.910736] systemd[1]: Listening on udev Kernel Socket. [ 9.911532] systemd[1]: Mounting Huge Pages File System... [0;32m OK [ 9.912350] systemd[1]: Mounting POSIX Message Queue File System... [ 9.923434] systemd[1]: Mounting Kernel Debug File System... ] Created slice Slice /[ 9.936910] systemd[1]: Mounting Kernel Trace File System... [ 9.937027] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). system/modprobe. [ OK ] Created slice Slice /system/serial-getty[ 9.964690] systemd[1]: Starting Create List of Static Device Nodes... [ 9.965465] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... . [ OK[ 9.966282] systemd[1]: Starting Load Kernel Module configfs... ] Created slice S[ 9.990844] systemd[1]: Starting Load Kernel Module drm... [ 9.991592] systemd[1]: Starting Load Kernel Module fuse... lice /system/sshd-keygen. [ OK [[ 10.005516] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 10.005587] systemd[1]: plymouth-switch-root.service: Deactivated successfully. 0m] Created slic[ 10.005636] systemd[1]: Stopped Plymouth switch root service. [ 10.005827] systemd[1]: Stopped Journal Service. e User [ 10.035961] systemd[1]: Starting Journal Service... [ 10.037793] systemd[1]: Starting Load Kernel Modules... and Session Slice. [[0;32[ 10.047704] systemd[1]: Starting Generate network units from Kernel command line... m OK ] Sta[ 10.047753] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.048502] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.048576] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.049327] systemd[1]: Starting Coldplug All udev Devices... [ 10.075934] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. [ 10.078848] systemd[1]: Mounted Huge Pages File System. [ 10.093521] systemd[1]: Mounted POSIX Message Queue File System. [ 10.108174] systemd[1]: Mounted Kernel Debug File System. rted Fo[ 10.124782] systemd[1]: Mounted Kernel Trace File System. [ 10.125296] systemd[1]: Finished Create List of Static Device Nodes. [ 10.125699] systemd[1]: modprobe@drm.service: Deactivated successfully. [ 10.125826] systemd[1]: Finished Load Kernel Module drm. [ 10.144548] systemd[1]: Started Journal Service. rward Password R…uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ OK ] Reached target ceph target…on@.service instances at once. [ OK ] Reache[ 10.176393] fuse: init (API version 7.36) d target [0;1;3[ 10.180799] systemd-journald[572]: Received client request to flush runtime journal. 9mceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [[0[ 10.290044] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.290061] device-mapper: uevent: version 1.0.3 [ 10.290119] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ;32m OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Flush Journal to Persistent Storage. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.710226] IPMI message handler: version 39.2 [ 10.715286] ipmi device interface [ 10.728760] ipmi_si: IPMI System Interface driver [ 10.728774] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.728776] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.728779] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.728833] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.728916] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.729210] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.729211] ipmi_si: Adding ACPI-specified kcs state machine [ 10.729258] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.792622] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.799690] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.800596] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.801251] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.801253] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 10.802166] igb 0000:07:00.0: DCA enabled [ 10.802181] igb 0000:07:00.1: DCA enabled [ 10.809518] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.847753] power_meter ACPI000D:00: Found ACPI power meter. [ 10.847773] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.847779] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.860602] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.889024] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting [ 10.912738] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer RPC Bin[ 10.912741] RAPL PMU: hw unit of domain package 2^-14 Joules d... [ 10.912741] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.915206] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started [0;[ 10.943417] ipmi_ssif: IPMI SSIF Interface driver 1;39m/usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK [[ 10.987411] iTCO_vendor_support: vendor-support=0 0m] Found device[ 10.989897] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) /dev/v[ 10.993673] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) g_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.223993] RPC: Registered named UNIX socket transport module. [ OK [[ 11.223996] RPC: Registered udp transport module. 0m] Started [0;[ 11.223997] RPC: Registered tcp transport module. 1;39mRPC Bind[0[ 11.223997] RPC: Registered tcp-with-tls transport module. m. [ O[ 11.223998] RPC: Registered tcp NFSv4.1 backchannel transport module. K ] Mounted[ 11.244236] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) RPC Pi[ 11.244238] EDAC sbridge: Ver: 1.1.2 pe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Security Auditing Service. [ 11.441669] intel_rapl_common: Found RAPL domain package [ 11.441675] intel_rapl_common: Found RAPL domain dram Starting Record System Boot/Shutdown in UTMP... [ 11.459379] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.467852] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 11.467959] XFS (dm-4): Mounting V4 Filesystem 06f73296-8d0e-41ab-9a58-dada525e34bb [ 11.471793] XFS (dm-4): Ending clean mount 0m] Mounted [0;[ 11.471831] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 1;39m/var/lib/ceph. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.127889] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.289049] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.505149] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.604581] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.604702] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.113 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 21.815177] block sda: the capability attribute has been deprecated. + '[' 172.21.15.113 '!=' '' ']' + set -e + '[' -n 172.21.15.113 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.113 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.113 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi113.front.sepia.ceph.com + '[' -n smithi113.front.sepia.ceph.com ']' + hostname smithi113.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi113 + echo smithi113 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.113 smithi113.front.sepia.ceph.com smithi113\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:17:34.126 DEBUG:teuthology.orchestra.console.smithi113:expect after: smithi113 login: 2024-04-26T12:17:34.177 DEBUG:teuthology.orchestra.console.smithi113:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.-  21.15.113 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d7:c1)... Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   Configuring (net0 0c:c4:7a:8f:d7:c1).... Configuring (net0 0c:c4:7a:8f:d7:c1)..... PXE-E61: Media test failure, check cable  [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9               The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.     The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      Probing EDD (edd=off to disable)... ok [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eaffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f62000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.916 MHz processor [ 0.000408] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000412] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000414] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000737] last_pfn = 0x78eb0 max_arch_pfn = 0x400000000 [ 0.006533] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006541] Using GB pages for direct mapping [ 0.006687] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006690] ACPI: Early table checksum verification disabled [ 0.006692] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006695] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.006700] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006704] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006707] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.006709] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006712] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006714] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006716] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006719] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006721] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006723] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006726] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006728] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006730] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006733] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006735] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006737] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006740] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006742] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006744] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006747] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006749] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.006750] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.006750] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.006751] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.006752] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.006752] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.006753] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.006754] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.006754] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.006755] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.006755] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.006756] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.006756] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.006757] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.006758] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.006758] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.006759] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.006759] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.006760] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.006761] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.006806] No NUMA configuration found [ 0.006807] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006816] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.007012] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007047] Zone ranges: [ 0.007048] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007049] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007051] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007052] Device empty [ 0.007052] Movable zone start for each node [ 0.007055] Early memory node ranges [ 0.007055] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007056] node 0: [mem 0x0000000000100000-0x0000000078eaffff] [ 0.007057] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007061] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007065] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007103] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011879] On node 0, zone Normal: 29008 pages in unavailable ranges [ 0.011990] ACPI: PM-Timer IO Port: 0x408 [ 0.011998] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012011] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012015] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012017] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012019] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012023] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012023] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012028] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012029] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012038] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012040] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x78eb0000-0x78f61fff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x78f62000-0x798affff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012046] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012047] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012048] Booting paravirtualized kernel on bare hardware [ 0.012050] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016375] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016593] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016618] Fallback order for Node 0: 0 [ 0.016620] Built 1 zonelists, mobility grouping on. Total pages: 8228725 [ 0.016621] Policy zone: Normal [ 0.016622] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016678] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016694] random: crng init done [ 0.018870] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020008] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020258] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020265] software IO TLB: area num 8. [ 0.047682] Memory: 1750092K/33437928K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989200K reserved, 0K cma-reserved) [ 0.047781] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047789] Kernel/User page tables isolation: enabled [ 0.047813] ftrace: allocating 46993 entries in 184 pages [ 0.065936] ftrace: allocated 184 pages with 4 groups [ 0.066442] Dynamic Preempt: voluntary [ 0.066471] rcu: Preemptible hierarchical RCU implementation. [ 0.066472] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066473] Trampoline variant of Tasks RCU enabled. [ 0.066473] Rude variant of Tasks RCU enabled. [ 0.066474] Tracing variant of Tasks RCU enabled. [ 0.066474] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066475] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069696] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069856] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.069961] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075200] Console: colour VGA+ 80x25 [ 1.096580] printk: console [ttyS1] enabled [ 1.100770] ACPI: Core revision 20230331 [ 1.104862] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.113991] APIC: Switch to symmetric I/O mode setup [ 1.118963] DMAR: Host address width 46 [ 1.122807] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128122] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136125] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142392] DMAR: ATSR flags: 0x0 [ 1.145712] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.151980] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158330] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.164682] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170083] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170083] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185106] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190409] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196635] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.206993] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327301f09f4, max_idle_ns: 440795304515 ns [ 1.217505] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.83 BogoMIPS (lpj=3499916) [ 1.218523] CPU0: Thermal monitoring enabled (TM1) [ 1.219561] process: using mwait in idle threads [ 1.220506] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221504] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222506] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223505] Spectre V2 : Mitigation: Retpolines [ 1.224504] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225504] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226505] Speculative Store Bypass: Vulnerable [ 1.227510] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228504] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229504] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230507] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231504] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232504] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233505] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234504] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.246922] Freeing SMP alternatives memory: 36K [ 1.247505] pid_max: default: 32768 minimum: 301 [ 1.248523] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249509] Yama: becoming mindful. [ 1.250508] SELinux: Initializing. [ 1.251521] LSM support for eBPF active [ 1.252562] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253542] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357343] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358600] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359504] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360516] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361514] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362513] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363505] ... version: 3 [ 1.364504] ... bit width: 48 [ 1.365504] ... generic registers: 4 [ 1.366504] ... value mask: 0000ffffffffffff [ 1.367504] ... max period: 00007fffffffffff [ 1.368504] ... fixed-purpose events: 3 [ 1.369505] ... event mask: 000000070000000f [ 1.370587] signal: max sigframe size: 1776 [ 1.371515] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372530] rcu: Hierarchical SRCU implementation. [ 1.372530] rcu: Max phase no-delay instances is 400. [ 1.372538] printk: console [ttyS1] printing thread started [ 1.377107] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377171] smp: Bringing up secondary CPUs ... [ 1.377238] smpboot: x86: Booting SMP configuration: [ 1.377239] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.383765] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.383765] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.383765] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.383765] smp: Brought up 1 node, 8 CPUs [ 1.383765] smpboot: Max logical packages: 1 [ 1.383765] smpboot: Total of 8 processors activated (55998.65 BogoMIPS) [ 1.429525] node 0 deferred pages initialised in 37ms [ 1.431538] devtmpfs: initialized [ 1.431544] x86/mm: Memory block size: 128MB [ 1.433099] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.433099] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.433099] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.433099] pinctrl core: initialized pinctrl subsystem [ 1.442746] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.442834] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.442845] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.442853] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.442861] audit: initializing netlink subsys (disabled) [ 1.442866] audit: type=2000 audit(1714133825.245:1): state=initialized audit_enabled=0 res=1 [ 1.442866] thermal_sys: Registered thermal governor 'fair_share' [ 1.442866] thermal_sys: Registered thermal governor 'step_wise' [ 1.442866] thermal_sys: Registered thermal governor 'user_space' [ 1.450507] cpuidle: using governor menu [ 1.460523] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.460524] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.460572] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.460575] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.460584] PCI: Using configuration type 1 for base access [ 1.478534] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.478539] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.478539] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.478539] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.478539] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.486507] cryptd: max_cpu_qlen set to 1000 [ 1.502202] ACPI: Added _OSI(Module Device) [ 1.502202] ACPI: Added _OSI(Processor Device) [ 1.502203] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.502203] ACPI: Added _OSI(Processor Aggregator Device) [ 1.502204] ACPI: Added _OSI(Linux-Dell-Video) [ 1.502205] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.502205] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.525901] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.528053] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.530632] ACPI: Dynamic OEM Table Load: [ 1.548095] ACPI: _OSC evaluated successfully for all CPUs [ 1.548358] ACPI: Interpreter enabled [ 1.548368] ACPI: PM: (supports S0 S4 S5) [ 1.548369] ACPI: Using IOAPIC for interrupt routing [ 1.549879] HEST: Enabling Firmware First mode for corrected errors. [ 1.596457] HEST: Table parsing has been initialized. [ 1.596576] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.596578] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.596579] PCI: Using E820 reservations for host bridge windows [ 1.597023] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.619514] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.619518] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.620630] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.621156] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.621157] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.621183] PCI host bridge to bus 0000:ff [ 1.621185] pci_bus 0000:ff: root bus resource [bus ff] [ 1.621195] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.621238] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.621269] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.621297] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.621326] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.621354] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.621382] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.621410] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.621439] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.621466] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.621495] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.621525] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.621553] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.621581] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.621609] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.621637] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.621664] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.621691] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.621719] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.621740] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.621775] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621834] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621893] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621950] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622008] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622065] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622122] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.622167] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.622215] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622273] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622332] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622389] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622446] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.622492] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.622526] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.622556] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.622587] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622627] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622669] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.62270] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622751] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.622785] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.622814] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.622844] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.622879] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.622909] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.622940] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.622970] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.623002] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.623030] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.623059] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.623088] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.623109] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.623141] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.623171] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.625394] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.625397] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.625530] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.625773] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.625774] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.626175] PCI host bridge to bus 0000:00 [ 1.626176] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.626178] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.626178] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.626179] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.626180] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.626181] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.626182] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.626201] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.626301] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.626313] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.626348] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.626438] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.626449] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.626452] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.626485] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.626573] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.626584] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.626586] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.626588] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.626592] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.626621] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.626702] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626709] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.626784] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626792] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.626864] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626871] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.626944] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626951] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.627025] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627032] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.627102] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627109] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.627180] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627187] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.627261] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627269] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.627338] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627398] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627477] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627534] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.627539] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.627617] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.627853] p] type 00 class [ 1.627872] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.627884] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.627895] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.627906] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.627917] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.627928] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.627986] pci 0000:00:11.4: PME# supported from D3hot [ 1.628061] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.628085] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.628170] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.628256] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.628280] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.628367] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.628431] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.628455] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.628544]upported from D0 D3hot D3cold [ 1.62d] type 00 classt [ 1.628651] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.628765] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.628843] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.628880] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.628971] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.629068] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.629107] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.629113] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.629116] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.629204] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.629298] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.629334] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.629340] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.629343] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.629430] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.629533] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.629553] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.629668] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.629748] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 convention58] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.629975] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.629986] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.629996] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.630007] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.630017] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.630028] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.630081] pci 0000:00:1f.2: PME# supported from D3hot [ 1.630139] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.630162] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.630191] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.6303 Slot [1] registered [ 1.630363] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.630467] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.630476] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.630492] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.630495] pci 0000:02:00.0: enabling Extended Tags [ 1.630598] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.630704] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630714] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.63ci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.630729] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.630734] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.630770] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.630786] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630787] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.630796] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630797] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.630948] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630958] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.630962] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.630972] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.630977] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.631012] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.631026] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.631027] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.631035] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.631036] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.631170] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.631214] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.631307] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.631379] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.631392] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.631397] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.631450] pci 0000:05:00.0: enabling Extended Tags [ 1.631573] pci 0000:05:00.0: supports D1 D2 [ 1.631574] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.631705] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.631792] pci_bus 0000:06: extended config space not accessible [ 1.631825] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.631862] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.631881] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.631901] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.631999] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.632069] pci 0000:06:00.0: supports D1 D2 [ 1.632070] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.632219] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.632364] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.632397] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.632433] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.632452] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.632676] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.632738] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632739] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.632773] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632773] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.633104] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.633138] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.633174] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.633192] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.633409] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.633470] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633470] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.633505] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633505] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.633816] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.633828] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.634731] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.634772] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.634814] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.634852] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.634892] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.634893] ACPI: PCI: Interrupt link LNKE disabled [ 1.634932] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.634933] ACPI: PCI: Interrupt link LNKF disabled [ 1.634972] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.634973] ACPI: PCI: Interrupt link LNKG disabled [ 1.635010] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.635012] ACPI: PCI: Interrupt link LNKH disabled [ 1.635515] iommu: Default domain type: Translated [ 1.635515] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.635609] SCSI subsystem initialized [ 1.635629] ACPI: bus type USB registered [ 1.635643] usbcore: registered new interface driver usbfs [ 1.635650] usbcore: registered new interface driver hub [ 1.635656] usbcore: registered new device driver usb [ 1.635680] pps_core: LinuxPPS API ver. 1 registered [ 1.635681] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.635683] PTP clock support registered [ 1.635699] EDAC MC: Ver: 3.0.0 [ 1.635713] NetLabel: Initializing [ 1.635714] NetLabel: domain hash size = 128 [ 1.635714] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.635729] NetLabel: unlabeled traffic allowed by default [ 1.635730] PCI: Using ACPI for IRQ routing [ 1.646567] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.646567] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.646567] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.646567] vgaarb: loaded [ 1.646567] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.646567] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.654924] clocksource: Switched to clocksource tsc-early [ 1.663308] VFS: Disk quotas dquot_6.6.0 [ 1.663316] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.663365] pnp: PnP ACPI init [ 1.663687] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.663689] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.663690] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.663691] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.663692] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.663693] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.663694] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.663695] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.663696] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.663697] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.663698] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.663699] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.663700] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.663854] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.663855] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.663856] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.663857] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.663857] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.664538] pnp: PnP ACPI: found 5 devices [ 1.669913] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.669974] NET: Registered PF_INET protocol family [ 1.670157] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.672568] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.672595] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.672599] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.672812] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.672923] TCP: Hash tables configured (established 262144 bind 65536) [ 1.673038] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.673122] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.673175] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.673249] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.673255] NET: Registered PF_XDP protocol family [ 1.673275] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.673285] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.673287] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.673292] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.673294] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.673299] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673301] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673302] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673303] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673304] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673305] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673306] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673307] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673308] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673309] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673310] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673311] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673312] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673313] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673314] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.673315] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.673316] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.673317] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.673319] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.673321] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.673324] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.673337] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.673340] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.673348] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673363] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673365] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.673371] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673380] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.673388] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.673394] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.673400] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.673407] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.673408] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.673414] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.673417] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.673423] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.673424] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.673425] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.673426] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.673426] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.673427] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.673428] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.673429] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.673430] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.673430] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.673431] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.673432] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.673433] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.673434] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.673435] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.673435] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.673436] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.673437] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.673602] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.690553] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16392 usecs [ 1.706546] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15601 usecs [ 1.706560] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.706594] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.706595] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.706600] ACPI: bus type thunderbolt registered [ 1.706605] Trying to unpack rootfs image as initramfs... [ 1.770724] Initialise system trusted keyrings [ 1.770733] Key type blacklist registered [ 1.770780] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.772666] zbud: loaded [ 1.878855] integrity: Platform Keyring initialized [ 1.878860] integrity: Machine keyring initialized [ 1.886751] NET: Registered PF_ALG protocol family [ 1.886753] xor: automatically using best checksumming function avx [ 1.886756] Key type asymmetric registered [ 1.886757] Asymmetric key parser 'x509' registered [ 1.886757] Running certificate verification selftests [ 1.888029] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.888515] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.888543] io scheduler mq-deadline registered [ 1.888544] io scheduler kyber registered [ 1.888584] io scheduler bfq registered [ 1.920091] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.920430] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.920590] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.920735] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.920869] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.921024] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.921170] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.921328] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.921398] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.928714] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.928734] ACPI: button: Power Button [PWRB] [ 1.928755] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.928783] ACPI: button: Power Button [PWRF] [ 1.937268] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.937270] pstore: Registered erst as persistent store backend [ 1.937354] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.937439] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.944905] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.954575] Non-volatile memory driver v1.3 [ 1.963720] rdac: device handler registered [ 1.963751] hp_sw: device handler registered [ 1.963752] emc: device handler registered [ 1.963770] alua: device handler registered [ 1.964058] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.964099] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 1.964112] ehci-pci 0000:00:1a.0: debug port 2 [ 1.968030] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.974519] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.974564] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.974566] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.974568] usb usb1: Product: EHCI Host Controller [ 1.974569] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.974570] usb usb1: SerialNumber: 0000:00:1a.0 [ 1.974671] hub 1-0:1.0: USB hub found [ 1.974678] hub 1-0:1.0: 2 ports detected [ 1.974840] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.974878] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.975968] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.976198] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.976202] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.976253] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4 [ 1.976255] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.976261] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.976271] ehci-pci 0000:00:1d.0: debug port 2 [ 1.976303] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.976305] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.976306] usb usb2: Product: xHCI Host Controller [ 1.976307] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.976308] usb usb2: SerialNumber: 0000:00:14.0 [ 1.976412] hub 2-0:1.0: USB hub found [ 1.976446] hub 2-0:1.0: 15 ports detected [ 1.979834] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.979836] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.979838] usb usb3: Product: xHCI Host Controller [ 1.979839] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.979840] usb usb3: SerialNumber: 0000:00:14.0 [ 1.979940] hub 3-0:1.0: USB hub found [ 1.979959] hub 3-0:1.0: 6 ports detected [ 1.980199] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.981733] usbcore: registered new interface driver usbserial_generic [ 1.981737] usbserial: USB Serial support registered for generic [ 1.981768] i8042: PNP: No PS/2 controller found. [ 1.981829] mousedev: PS/2 mouse device common for all mice [ 1.981899] rtc_cmos 00:00: RTC can wake from S4 [ 1.982182] rtc_cmos 00:00: registered as rtc0 [ 1.982229] rtc_cmos 00:00: setting system clock to 2024-04-26T12:17:07 UTC (1714133827) [ 1.982255] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.986534] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.986566] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.986568] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.986569] usb usb4: Product: EHCI Host Controller [ 1.986569] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.986570] usb usb4: SerialNumber: 0000:00:1d.0 [ 1.986647] hub 4-0:1.0: USB hub found [ 1.986650] hub 4-0:1.0: 2 ports detected [ 2.026552] intel_pstate: Intel P-state driver initializing [ 2.030141] Freeing initrd memory: 33136K [ 2.158211] hid: raw HID events driver (C) Jiri Kosina [ 2.158246] usbcore: registered new interface driver usbhid [ 2.158247] usbhid: USB HID core driver [ 2.158286] drop_monitor: Initializing network drop monitor service [ 2.166660] Initializing XFRM netlink socket [ 2.166733] NET: Registered PF_INET6 protocol family [ 2.171250] Segment Routing with IPv6 [ 2.171265] NET: Registered PF_PACKET protocol family [ 2.171285] mpls_gso: MPLS GSO support [ 2.190965] microcode: Current revision: 0x0b000010 [ 2.215690] resctrl: L3 allocation detected [ 2.215692] resctrl: L3 monitoring detected [ 2.215703] IPI shorthand broadcast: enabled [ 2.215707] AVX2 version of gcm_enc/dec engaged. [ 2.228541] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.228552] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.232150] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.254897] AES CTR mode by8 optimization enabled [ 2.254935] sched_clock: Marking stable (1126885109, 1127619621)->(2655761556, -401256826) [ 2.272307] registered taskstats version 1 [ 2.288179] Loading compiled-in X.509 certificates [ 2.288689] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.288975] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.289240] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.289378] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.289387] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.289617] zswap: loaded using pool lzo/zbud [ 2.298988] page_owner is disabled [ 2.299160] pstore: Using crash dump compression: deflate [ 2.299169] Key type big_key registered [ 2.356700] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.356703] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.357279] hub 2-12:1.0: USB hub found [ 2.357360] hub 2-12:1.0: 4 ports detected [ 2.361829] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.361831] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.361990] hub 1-1:1.0: USB hub found [ 2.362078] hub 1-1:1.0: 6 ports detected [ 2.381321] Key type encrypted registered [ 2.381328] ima: No TPM chip found, activating TPM-bypass! [ 2.381330] Loading compiled-in module X.509 certificates [ 2.381617] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.381619] ima: Allocated hash algorithm: sha256 [ 2.381628] ima: No architecture policies found [ 2.381634] evm: Initialising EVM extended attributes: [ 2.381635] evm: security.selinux [ 2.381635] evm: security.SMACK64 (disabled) [ 2.381636] evm: security.SMACK64EXEC (disabled) [ 2.381636] evm: security.SMACK64TRANSMUTE (disabled) [ 2.381636] evm: security.SMACK64MMAP (disabled) [ 2.381637] evm: security.apparmor (disabled) [ 2.381637] evm: security.ima [ 2.381637] evm: security.capability [ 2.381638] evm: HMAC attrs: 0x1 [ 2.392458] usb 4-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.392461] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.392619] hub 4-1:1.0: USB hub found [ 2.392705] hub 4-1:1.0: 8 ports detected [ 2.706529] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.764515] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 2.764519] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 2.768310] clocksource: Switched to clocksource tsc [ 2.865705] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.865707] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.912609] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.964655] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.977347] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.977420] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.253792] Freeing unused decrypted memory: 2028K [ 5.254259] Freeing unused kernel image (initmem) memory: 3928K [ 5.263536] Write protecting the kernel read-only data: 28672k [ 5.271145] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.312981] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.312982] x86/mm: Checking user space page tables [ 5.350409] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.350421] Run /init as init process [ 5.363368] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.363469] systemd[1]: Detected architecture x86-64. [ 5.363470] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.414746] systemd[1]: Hostname set to . [ OK [[ 5.470180] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.470286] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.491638] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.505602] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.517689] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.528619] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.540784] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.555711] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.569834] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.581840] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.595701] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.609592] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.628196] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.643880] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.655683] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.656221] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.678083] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.690055] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.703436] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. [ 6.077071] dca service started, version 1.12.1 Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen[[ 6.118987] igb: Intel(R) Gigabit Ethernet Network Driver 0m. [ [ 6.118989] igb: Copyright (c) 2007-2014 Intel Corporation. OK ] Starte[ 6.119602] nvme nvme0: pci function 0000:02:00.0 d Forwa[ 6.125718] nvme nvme0: 8/0/0 default/read/poll queues rd Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units.[ 6.153309] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ OK [ 6.153312] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ] Reached target B[ 6.169028] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.169031] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst asic System.[ 6.177898] scsi host0: ahci [ 6.178200] scsi host1: ahci [ 6.178453] scsi host2: ahci [ 6.178720] scsi host3: ahci [ 6.178758] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 6.178761] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 6.178764] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 6.178766] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 6.179093] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.179096] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.185150] igb 0000:07:00.0: added PHC on eth0 [ 6.185181] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.185182] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:44 [ 6.185257] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.185258] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.192636] ACPI: bus type drm_connector registered [ 6.194352] scsi host4: ahci [ 6.194782] scsi host5: ahci [ 6.195016] scsi host6: ahci [ 6.195101] scsi host7: ahci [ 6.195429] scsi host8: ahci [ 6.195560] scsi host9: ahci [ 6.195617] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 lpm-pol 0 [ 6.195620] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 lpm-pol 0 [ 6.195623] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 lpm-pol 0 [ 6.195625] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 lpm-pol 0 [ 6.195628] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 lpm-pol 0 [ 6.195630] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 lpm-pol 0 [ 6.240984] igb 0000:07:00.1: added PHC on eth1 [ 6.241010] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.241012] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:45 [ 6.241088] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.241089] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.254198] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.260183] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.263839] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.285629] Console: switching to colour dummy device 80x25 [ 6.285776] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.285778] ast 0000:06:00.0: [drm] AST 2400 detected [rm] Using analog VGA [ 6.285793] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.285939] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.297959] fbcon: astdrmfb (fb0) is primary device [ 6.322837] Console: switching to colour frame buffer device 128x48 [ 6.341559] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.489853] ata3: SATA link down (SStatus 0 SControl 300) [ 6.490080] ata4: SATA link down (SStatus 0 SControl 300) [ 6.490556] ata1: SATA link down (SStatus 0 SControl 300) [ 6.490842] ata2: SATA link down (SStatus 0 SControl 300) [ 6.506867] ata6: SATA link down (SStatus 0 SControl 300) [ 6.506909] ata7: SATA link down (SStatus 0 SControl 300) [ 6.506968] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.507017] ata10: SATA link down (SStatus 0 SControl 300) [ 6.507160] ata9: SATA link down (SStatus 0 SControl 300) [ 6.507523] ata8: SATA link down (SStatus 0 SControl 300) [ 6.508045] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.508534] ata5.00: NCQ Send/Recv Log not supported [ 6.508535] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.509936] ata5.00: NCQ Send/Recv Log not supported [ 6.509939] ata5.00: cUDMA/133 [ 6: Direct-Access 0NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.584608] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.653485] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.653499] sd 4:0:0:0: [sda] Write Protect is off [ 6.653518] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.653541] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.670874] sda: sda1 [ 6.670929] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.289918] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.290207] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.290289] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.290290] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d7:c0 [ 7.293340] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.449882] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.450169] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.450251] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.450252] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d7:c1 [ 7.453249] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.469785] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.495388] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ OK [[ 7.711688] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. 0m] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Start[ 8.038777] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). ing Switch Root... [ 8.569800] SELinux: policy capability network_peer_controls=1 [ 8.569803] SELinux: policy capability open_perms=1 [ 8.569804] SELinux: policy capability extended_socket_class=1 [ 8.569804] SELinux: policy capability always_check_network=0 [ 8.569805] SELinux: policy capability cgroup_seclabel=1 [ 8.569805] SELinux: policy capability nnp_nosuid_transition=1 [ 8.569805] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.612933] audit: type=1403 audit(1714133834.130:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.615248] systemd[1]: Successfully loaded SELinux policy in 108.634ms. [ 8.666141] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.118ms. [ 8.674322] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.674424] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.727541] systemd[1]: Hostname set to . [ OK [[ 9.664800] systemd[1]: initrd-switch-root.service: Deactivated successfully. 0m] Stopped [0;[ 9.664896] systemd[1]: Stopped Switch Root. [ 9.665353] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.665690] systemd[1]: Created slice Slice /system/getty. 1;39mSwitch Root[ 9.693980] systemd[1]: Created slice Slice /system/modprobe. . [[ 9.694315] systemd[1]: Created slice Slice /system/serial-getty. [ 9.694587] systemd[1]: Created slice Slice /system/sshd-keygen. OK ] Crea[ 9.714642] systemd[1]: Created slice User and Session Slice. [ 9.714674] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.714774] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.715100] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.715143] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.715167] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.715183] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.715200] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.715216] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.715232] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.715250] systemd[1]: Reached target Local Encrypted Volumes. [ 9.715275] systemd[1]: Stopped target Switch Root. [ 9.715297] systemd[1]: Stopped target Initrd File Systems. [ 9.715312] systemd[1]: Stopped target Initrd Root File System. [ 9.715340] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.715378] systemd[1]: Reached target Path Units. [ 9.715407] systemd[1]: Reached target Slice Units. [ 9.715428] systemd[1]: Reached target Swaps. [ 9.715447] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.715825] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.840019] systemd[1]: Listening on LVM2 poll daemon socket. [ 9.868675] systemd[1]: Listening on RPCbind Server Activation Socket. ted slice [0;1;[ 9.884744] systemd[1]: Reached target RPC Port Mapper. [ 9.886033] systemd[1]: Listening on Process Core Dump Socket. 39mSlice /system[ 9.897294] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.897728] systemd[1]: Listening on udev Control Socket. /getty. [[ 9.910736] systemd[1]: Listening on udev Kernel Socket. [ 9.911532] systemd[1]: Mounting Huge Pages File System... [0;32m OK [ 9.912350] systemd[1]: Mounting POSIX Message Queue File System... [ 9.923434] systemd[1]: Mounting Kernel Debug File System... ] Created slice Slice /[ 9.936910] systemd[1]: Mounting Kernel Trace File System... [ 9.937027] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). system/modprobe. [ OK ] Created slice Slice /system/serial-getty[ 9.964690] systemd[1]: Starting Create List of Static Device Nodes... [ 9.965465] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... . [ OK[ 9.966282] systemd[1]: Starting Load Kernel Module configfs... ] Created slice S[ 9.990844] systemd[1]: Starting Load Kernel Module drm... [ 9.991592] systemd[1]: Starting Load Kernel Module fuse... lice /system/sshd-keygen. [ OK [[ 10.005516] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 10.005587] systemd[1]: plymouth-switch-root.service: Deactivated successfully. 0m] Created slic[ 10.005636] systemd[1]: Stopped Plymouth switch root service. [ 10.005827] systemd[1]: Stopped Journal Service. e User [ 10.035961] systemd[1]: Starting Journal Service... [ 10.037793] systemd[1]: Starting Load Kernel Modules... and Session Slice. [[0;32[ 10.047704] systemd[1]: Starting Generate network units from Kernel command line... m OK ] Sta[ 10.047753] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.048502] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.048576] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.049327] systemd[1]: Starting Coldplug All udev Devices... [ 10.075934] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. [ 10.078848] systemd[1]: Mounted Huge Pages File System. [ 10.093521] systemd[1]: Mounted POSIX Message Queue File System. [ 10.108174] systemd[1]: Mounted Kernel Debug File System. rted Fo[ 10.124782] systemd[1]: Mounted Kernel Trace File System. [ 10.125296] systemd[1]: Finished Create List of Static Device Nodes. [ 10.125699] systemd[1]: modprobe@drm.service: Deactivated successfully. [ 10.125826] systemd[1]: Finished Load Kernel Module drm. [ 10.144548] systemd[1]: Started Journal Service. rward Password R…uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ OK ] Reached target ceph target…on@.service instances at once. [ OK ] Reache[ 10.176393] fuse: init (API version 7.36) d target [0;1;3[ 10.180799] systemd-journald[572]: Received client request to flush runtime journal. 9mceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [[0[ 10.290044] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.290061] device-mapper: uevent: version 1.0.3 [ 10.290119] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ;32m OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Flush Journal to Persistent Storage. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.710226] IPMI message handler: version 39.2 [ 10.715286] ipmi device interface [ 10.728760] ipmi_si: IPMI System Interface driver [ 10.728774] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.728776] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.728779] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.728833] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.728916] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.729210] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.729211] ipmi_si: Adding ACPI-specified kcs state machine [ 10.729258] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.792622] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.799690] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.800596] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.801251] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.801253] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 10.802166] igb 0000:07:00.0: DCA enabled [ 10.802181] igb 0000:07:00.1: DCA enabled [ 10.809518] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.847753] power_meter ACPI000D:00: Found ACPI power meter. [ 10.847773] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.847779] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.860602] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.889024] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting [ 10.912738] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer RPC Bin[ 10.912741] RAPL PMU: hw unit of domain package 2^-14 Joules d... [ 10.912741] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.915206] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started [0;[ 10.943417] ipmi_ssif: IPMI SSIF Interface driver 1;39m/usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK [[ 10.987411] iTCO_vendor_support: vendor-support=0 0m] Found device[ 10.989897] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) /dev/v[ 10.993673] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) g_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.223993] RPC: Registered named UNIX socket transport module. [ OK [[ 11.223996] RPC: Registered udp transport module. 0m] Started [0;[ 11.223997] RPC: Registered tcp transport module. 1;39mRPC Bind[0[ 11.223997] RPC: Registered tcp-with-tls transport module. m. [ O[ 11.223998] RPC: Registered tcp NFSv4.1 backchannel transport module. K ] Mounted[ 11.244236] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) RPC Pi[ 11.244238] EDAC sbridge: Ver: 1.1.2 pe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Security Auditing Service. [ 11.441669] intel_rapl_common: Found RAPL domain package [ 11.441675] intel_rapl_common: Found RAPL domain dram Starting Record System Boot/Shutdown in UTMP... [ 11.459379] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.467852] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 11.467959] XFS (dm-4): Mounting V4 Filesystem 06f73296-8d0e-41ab-9a58-dada525e34bb [ 11.471793] XFS (dm-4): Ending clean mount 0m] Mounted [0;[ 11.471831] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 1;39m/var/lib/ceph. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.127889] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.289049] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.505149] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.604581] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.604702] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.113 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 21.815177] block sda: the capability attribute has been deprecated. + '[' 172.21.15.113 '!=' '' ']' + set -e + '[' -n 172.21.15.113 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.113 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.113 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi113.front.sepia.ceph.com + '[' -n smithi113.front.sepia.ceph.com ']' + hostname smithi113.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi113 + echo smithi113 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.113 smithi113.front.sepia.ceph.com smithi113\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi113 login: [disconnect] 2024-04-26T12:17:34.279 INFO:teuthology.misc:Re-opening connections... 2024-04-26T12:17:34.279 INFO:teuthology.misc:trying to connect to ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:17:34.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-26T12:17:34.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:17:34.758 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-04-26T12:17:35.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-26T12:17:35.270 DEBUG:teuthology.misc:waited 0.9911994934082031 2024-04-26T12:17:35.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-04-26T12:17:36.272 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:17:36.272 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi113.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-26T12:17:36.273 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:17:36.429 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:17:36.501 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:17:36.501 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:17:36.504 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:17:36.504 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:17:36.597 INFO:teuthology.orchestra.run.smithi113.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T12:17:36.599 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:17:36.600 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T12:17:37.467 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:17:37.465+0000 7fbc5e9c4640 -1 Falling back to public interface 2024-04-26T12:17:41.224 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:17:41.222+0000 7fbc5e9c4640 -1 osd.1 18 log_to_monitors true 2024-04-26T12:17:41.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T12:17:41.601 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:17:41.699 INFO:teuthology.orchestra.run.smithi113.stderr:no valid command found; 10 closest matches: 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:0 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:1 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:2 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:abort 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:assert 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:bluefs debug_inject_read_zeros 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:bluefs files list 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:bluefs stats 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:bluestore allocator dump block 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:bluestore allocator fragmentation block 2024-04-26T12:17:41.700 INFO:teuthology.orchestra.run.smithi113.stderr:admin_socket: invalid command 2024-04-26T12:17:41.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:17:41.702 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T12:17:42.155 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:17:42.153+0000 7fbc52761640 -1 osd.1 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:17:46.703 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:17:46.816 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-26T12:17:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "ops": [], 2024-04-26T12:17:46.816 INFO:teuthology.orchestra.run.smithi113.stdout: "num_ops": 0 2024-04-26T12:17:46.817 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-26T12:17:46.825 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:17:48.115 INFO:teuthology.orchestra.run.smithi069.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:17:48.131 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:17:49.121 INFO:teuthology.orchestra.run.smithi069.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:17:49.135 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:17:50.122 INFO:teuthology.orchestra.run.smithi069.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:17:50.137 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:17:50.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:17:50.429 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:17:50.431 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:17:50.435 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-04-26T12:17:50.118527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":833800,"kb_used_data":3416,"kb_used_omap":10,"kb_used_meta":830325,"kb_avail":282281720,"statfs":{"total":289910292480,"available":289056481280,"internally_reserved":0,"allocated":3497984,"data_stored":2046831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10264,"internal_metadata":850253800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.026516"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097942+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:17:43.097942+0000","last_peered":"2024-04-26T12:17:43.097942+0000","last_clean":"2024-04-26T12:17:43.097942+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:17:43.097942+0000","last_undegraded":"2024-04-26T12:17:43.097942+0000","last_fullsized":"2024-04-26T12:17:43.097942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097186+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:17:43.097186+0000","last_peered":"2024-04-26T12:17:43.097186+0000","last_clean":"2024-04-26T12:17:43.097186+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:17:43.097186+0000","last_undegraded":"2024-04-26T12:17:43.097186+0000","last_fullsized":"2024-04-26T12:17:43.097186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109808+0000","last_change":"2024-04-26T12:17:44.109808+0000","last_active":"2024-04-26T12:17:44.109808+0000","last_peered":"2024-04-26T12:17:44.109808+0000","last_clean":"2024-04-26T12:17:44.109808+0000","last_became_active":"2024-04-26T12:17:44.108039+0000","last_became_peered":"2024-04-26T12:17:44.108039+0000","last_unstale":"2024-04-26T12:17:44.109808+0000","last_undegraded":"2024-04-26T12:17:44.109808+0000","last_fullsized":"2024-04-26T12:17:44.109808+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:42.283308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100480+0000","last_change":"2024-04-26T12:17:44.100480+0000","last_active":"2024-04-26T12:17:44.100480+0000","last_peered":"2024-04-26T12:17:44.100480+0000","last_clean":"2024-04-26T12:17:44.100480+0000","last_became_active":"2024-04-26T12:17:44.100006+0000","last_became_peered":"2024-04-26T12:17:44.100006+0000","last_unstale":"2024-04-26T12:17:44.100480+0000","last_undegraded":"2024-04-26T12:17:44.100480+0000","last_fullsized":"2024-04-26T12:17:44.100480+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:48.064571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.096684+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:17:43.096684+0000","last_peered":"2024-04-26T12:17:43.096684+0000","last_clean":"2024-04-26T12:17:43.096684+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:17:43.096684+0000","last_undegraded":"2024-04-26T12:17:43.096684+0000","last_fullsized":"2024-04-26T12:17:43.096684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105887+0000","last_change":"2024-04-26T12:17:44.105887+0000","last_active":"2024-04-26T12:17:44.105887+0000","last_peered":"2024-04-26T12:17:44.105887+0000","last_clean":"2024-04-26T12:17:44.105887+0000","last_became_active":"2024-04-26T12:17:44.104771+0000","last_became_peered":"2024-04-26T12:17:44.104771+0000","last_unstale":"2024-04-26T12:17:44.105887+0000","last_undegraded":"2024-04-26T12:17:44.105887+0000","last_fullsized":"2024-04-26T12:17:44.105887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:45.218679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104383+0000","last_change":"2024-04-26T12:17:44.104383+0000","last_active":"2024-04-26T12:17:44.104383+0000","last_peered":"2024-04-26T12:17:44.104383+0000","last_clean":"2024-04-26T12:17:44.104383+0000","last_became_active":"2024-04-26T12:17:44.103584+0000","last_became_peered":"2024-04-26T12:17:44.103584+0000","last_unstale":"2024-04-26T12:17:44.104383+0000","last_undegraded":"2024-04-26T12:17:44.104383+0000","last_fullsized":"2024-04-26T12:17:44.104383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:42.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102070+0000","last_change":"2024-04-26T12:17:44.102070+0000","last_active":"2024-04-26T12:17:44.102070+0000","last_peered":"2024-04-26T12:17:44.102070+0000","last_clean":"2024-04-26T12:17:44.102070+0000","last_became_active":"2024-04-26T12:17:44.100825+0000","last_became_peered":"2024-04-26T12:17:44.100825+0000","last_unstale":"2024-04-26T12:17:44.102070+0000","last_undegraded":"2024-04-26T12:17:44.102070+0000","last_fullsized":"2024-04-26T12:17:44.102070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:49.320867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.102289+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:17:43.102289+0000","last_peered":"2024-04-26T12:17:43.102289+0000","last_clean":"2024-04-26T12:17:43.102289+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:17:43.102289+0000","last_undegraded":"2024-04-26T12:17:43.102289+0000","last_fullsized":"2024-04-26T12:17:43.102289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097325+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:17:43.097325+0000","last_peered":"2024-04-26T12:17:43.097325+0000","last_clean":"2024-04-26T12:17:43.097325+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:17:43.097325+0000","last_undegraded":"2024-04-26T12:17:43.097325+0000","last_fullsized":"2024-04-26T12:17:43.097325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106580+0000","last_change":"2024-04-26T12:17:44.106580+0000","last_active":"2024-04-26T12:17:44.106580+0000","last_peered":"2024-04-26T12:17:44.106580+0000","last_clean":"2024-04-26T12:17:44.106580+0000","last_became_active":"2024-04-26T12:17:44.104450+0000","last_became_peered":"2024-04-26T12:17:44.104450+0000","last_unstale":"2024-04-26T12:17:44.106580+0000","last_undegraded":"2024-04-26T12:17:44.106580+0000","last_fullsized":"2024-04-26T12:17:44.106580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:46.199335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105500+0000","last_change":"2024-04-26T12:17:44.105500+0000","last_active":"2024-04-26T12:17:44.105500+0000","last_peered":"2024-04-26T12:17:44.105500+0000","last_clean":"2024-04-26T12:17:44.105500+0000","last_became_active":"2024-04-26T12:17:44.104398+0000","last_became_peered":"2024-04-26T12:17:44.104398+0000","last_unstale":"2024-04-26T12:17:44.105500+0000","last_undegraded":"2024-04-26T12:17:44.105500+0000","last_fullsized":"2024-04-26T12:17:44.105500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.095959+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:17:43.095959+0000","last_peered":"2024-04-26T12:17:43.095959+0000","last_clean":"2024-04-26T12:17:43.095959+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:17:43.095959+0000","last_undegraded":"2024-04-26T12:17:43.095959+0000","last_fullsized":"2024-04-26T12:17:43.095959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108572+0000","last_change":"2024-04-26T12:17:44.108572+0000","last_active":"2024-04-26T12:17:44.108572+0000","last_peered":"2024-04-26T12:17:44.108572+0000","last_clean":"2024-04-26T12:17:44.108572+0000","last_became_active":"2024-04-26T12:17:44.106664+0000","last_became_peered":"2024-04-26T12:17:44.106664+0000","last_unstale":"2024-04-26T12:17:44.108572+0000","last_undegraded":"2024-04-26T12:17:44.108572+0000","last_fullsized":"2024-04-26T12:17:44.108572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:10.139675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107371+0000","last_change":"2024-04-26T12:17:44.107371+0000","last_active":"2024-04-26T12:17:44.107371+0000","last_peered":"2024-04-26T12:17:44.107371+0000","last_clean":"2024-04-26T12:17:44.107371+0000","last_became_active":"2024-04-26T12:17:44.105812+0000","last_became_peered":"2024-04-26T12:17:44.105812+0000","last_unstale":"2024-04-26T12:17:44.107371+0000","last_undegraded":"2024-04-26T12:17:44.107371+0000","last_fullsized":"2024-04-26T12:17:44.107371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:42.134380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105349+0000","last_change":"2024-04-26T12:17:44.105349+0000","last_active":"2024-04-26T12:17:44.105349+0000","last_peered":"2024-04-26T12:17:44.105349+0000","last_clean":"2024-04-26T12:17:44.105349+0000","last_became_active":"2024-04-26T12:17:44.104601+0000","last_became_peered":"2024-04-26T12:17:44.104601+0000","last_unstale":"2024-04-26T12:17:44.105349+0000","last_undegraded":"2024-04-26T12:17:44.105349+0000","last_fullsized":"2024-04-26T12:17:44.105349+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:08.232303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.105932+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:17:43.105932+0000","last_peered":"2024-04-26T12:17:43.105932+0000","last_clean":"2024-04-26T12:17:43.105932+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:17:43.105932+0000","last_undegraded":"2024-04-26T12:17:43.105932+0000","last_fullsized":"2024-04-26T12:17:43.105932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097693+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:17:43.097693+0000","last_peered":"2024-04-26T12:17:43.097693+0000","last_clean":"2024-04-26T12:17:43.097693+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:17:43.097693+0000","last_undegraded":"2024-04-26T12:17:43.097693+0000","last_fullsized":"2024-04-26T12:17:43.097693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.102370+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:17:43.102370+0000","last_peered":"2024-04-26T12:17:43.102370+0000","last_clean":"2024-04-26T12:17:43.102370+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:17:43.102370+0000","last_undegraded":"2024-04-26T12:17:43.102370+0000","last_fullsized":"2024-04-26T12:17:43.102370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104892+0000","last_change":"2024-04-26T12:17:44.104892+0000","last_active":"2024-04-26T12:17:44.104892+0000","last_peered":"2024-04-26T12:17:44.104892+0000","last_clean":"2024-04-26T12:17:44.104892+0000","last_became_active":"2024-04-26T12:17:44.103880+0000","last_became_peered":"2024-04-26T12:17:44.103880+0000","last_unstale":"2024-04-26T12:17:44.104892+0000","last_undegraded":"2024-04-26T12:17:44.104892+0000","last_fullsized":"2024-04-26T12:17:44.104892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:30.680921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106482+0000","last_change":"2024-04-26T12:17:44.106482+0000","last_active":"2024-04-26T12:17:44.106482+0000","last_peered":"2024-04-26T12:17:44.106482+0000","last_clean":"2024-04-26T12:17:44.106482+0000","last_became_active":"2024-04-26T12:17:44.105141+0000","last_became_peered":"2024-04-26T12:17:44.105141+0000","last_unstale":"2024-04-26T12:17:44.106482+0000","last_undegraded":"2024-04-26T12:17:44.106482+0000","last_fullsized":"2024-04-26T12:17:44.106482+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:19.098834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105075+0000","last_change":"2024-04-26T12:17:44.105075+0000","last_active":"2024-04-26T12:17:44.105075+0000","last_peered":"2024-04-26T12:17:44.105075+0000","last_clean":"2024-04-26T12:17:44.105075+0000","last_became_active":"2024-04-26T12:17:44.104629+0000","last_became_peered":"2024-04-26T12:17:44.104629+0000","last_unstale":"2024-04-26T12:17:44.105075+0000","last_undegraded":"2024-04-26T12:17:44.105075+0000","last_fullsized":"2024-04-26T12:17:44.105075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:29.767394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107876+0000","last_change":"2024-04-26T12:17:44.107876+0000","last_active":"2024-04-26T12:17:44.107876+0000","last_peered":"2024-04-26T12:17:44.107876+0000","last_clean":"2024-04-26T12:17:44.107876+0000","last_became_active":"2024-04-26T12:17:44.106778+0000","last_became_peered":"2024-04-26T12:17:44.106778+0000","last_unstale":"2024-04-26T12:17:44.107876+0000","last_undegraded":"2024-04-26T12:17:44.107876+0000","last_fullsized":"2024-04-26T12:17:44.107876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.095615+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:17:43.095615+0000","last_peered":"2024-04-26T12:17:43.095615+0000","last_clean":"2024-04-26T12:17:43.095615+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:17:43.095615+0000","last_undegraded":"2024-04-26T12:17:43.095615+0000","last_fullsized":"2024-04-26T12:17:43.095615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105270+0000","last_change":"2024-04-26T12:17:44.105270+0000","last_active":"2024-04-26T12:17:44.105270+0000","last_peered":"2024-04-26T12:17:44.105270+0000","last_clean":"2024-04-26T12:17:44.105270+0000","last_became_active":"2024-04-26T12:17:44.104452+0000","last_became_peered":"2024-04-26T12:17:44.104452+0000","last_unstale":"2024-04-26T12:17:44.105270+0000","last_undegraded":"2024-04-26T12:17:44.105270+0000","last_fullsized":"2024-04-26T12:17:44.105270+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:22.685511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106877+0000","last_change":"2024-04-26T12:17:44.106877+0000","last_active":"2024-04-26T12:17:44.106877+0000","last_peered":"2024-04-26T12:17:44.106877+0000","last_clean":"2024-04-26T12:17:44.106877+0000","last_became_active":"2024-04-26T12:17:44.106322+0000","last_became_peered":"2024-04-26T12:17:44.106322+0000","last_unstale":"2024-04-26T12:17:44.106877+0000","last_undegraded":"2024-04-26T12:17:44.106877+0000","last_fullsized":"2024-04-26T12:17:44.106877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:10.112402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109143+0000","last_change":"2024-04-26T12:17:44.109143+0000","last_active":"2024-04-26T12:17:44.109143+0000","last_peered":"2024-04-26T12:17:44.109143+0000","last_clean":"2024-04-26T12:17:44.109143+0000","last_became_active":"2024-04-26T12:17:44.107515+0000","last_became_peered":"2024-04-26T12:17:44.107515+0000","last_unstale":"2024-04-26T12:17:44.109143+0000","last_undegraded":"2024-04-26T12:17:44.109143+0000","last_fullsized":"2024-04-26T12:17:44.109143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:27.955070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105498+0000","last_change":"2024-04-26T12:17:44.105498+0000","last_active":"2024-04-26T12:17:44.105498+0000","last_peered":"2024-04-26T12:17:44.105498+0000","last_clean":"2024-04-26T12:17:44.105498+0000","last_became_active":"2024-04-26T12:17:44.104599+0000","last_became_peered":"2024-04-26T12:17:44.104599+0000","last_unstale":"2024-04-26T12:17:44.105498+0000","last_undegraded":"2024-04-26T12:17:44.105498+0000","last_fullsized":"2024-04-26T12:17:44.105498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:02.689137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.104392+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:17:43.104392+0000","last_peered":"2024-04-26T12:17:43.104392+0000","last_clean":"2024-04-26T12:17:43.104392+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:17:43.104392+0000","last_undegraded":"2024-04-26T12:17:43.104392+0000","last_fullsized":"2024-04-26T12:17:43.104392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105524+0000","last_change":"2024-04-26T12:17:44.105524+0000","last_active":"2024-04-26T12:17:44.105524+0000","last_peered":"2024-04-26T12:17:44.105524+0000","last_clean":"2024-04-26T12:17:44.105524+0000","last_became_active":"2024-04-26T12:17:44.104812+0000","last_became_peered":"2024-04-26T12:17:44.104812+0000","last_unstale":"2024-04-26T12:17:44.105524+0000","last_undegraded":"2024-04-26T12:17:44.105524+0000","last_fullsized":"2024-04-26T12:17:44.105524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:51.792918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107407+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:17:43.107407+0000","last_peered":"2024-04-26T12:17:43.107407+0000","last_clean":"2024-04-26T12:17:43.107407+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:17:43.107407+0000","last_undegraded":"2024-04-26T12:17:43.107407+0000","last_fullsized":"2024-04-26T12:17:43.107407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100660+0000","last_change":"2024-04-26T12:17:44.100660+0000","last_active":"2024-04-26T12:17:44.100660+0000","last_peered":"2024-04-26T12:17:44.100660+0000","last_clean":"2024-04-26T12:17:44.100660+0000","last_became_active":"2024-04-26T12:17:44.099937+0000","last_became_peered":"2024-04-26T12:17:44.099937+0000","last_unstale":"2024-04-26T12:17:44.100660+0000","last_undegraded":"2024-04-26T12:17:44.100660+0000","last_fullsized":"2024-04-26T12:17:44.100660+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:45.974578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097532+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:17:43.097532+0000","last_peered":"2024-04-26T12:17:43.097532+0000","last_clean":"2024-04-26T12:17:43.097532+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:17:43.097532+0000","last_undegraded":"2024-04-26T12:17:43.097532+0000","last_fullsized":"2024-04-26T12:17:43.097532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104913+0000","last_change":"2024-04-26T12:17:44.104913+0000","last_active":"2024-04-26T12:17:44.104913+0000","last_peered":"2024-04-26T12:17:44.104913+0000","last_clean":"2024-04-26T12:17:44.104913+0000","last_became_active":"2024-04-26T12:17:44.103912+0000","last_became_peered":"2024-04-26T12:17:44.103912+0000","last_unstale":"2024-04-26T12:17:44.104913+0000","last_undegraded":"2024-04-26T12:17:44.104913+0000","last_fullsized":"2024-04-26T12:17:44.104913+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:25.791295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.100890+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:17:43.100890+0000","last_peered":"2024-04-26T12:17:43.100890+0000","last_clean":"2024-04-26T12:17:43.100890+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:17:43.100890+0000","last_undegraded":"2024-04-26T12:17:43.100890+0000","last_fullsized":"2024-04-26T12:17:43.100890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106383+0000","last_change":"2024-04-26T12:17:44.106383+0000","last_active":"2024-04-26T12:17:44.106383+0000","last_peered":"2024-04-26T12:17:44.106383+0000","last_clean":"2024-04-26T12:17:44.106383+0000","last_became_active":"2024-04-26T12:17:44.105933+0000","last_became_peered":"2024-04-26T12:17:44.105933+0000","last_unstale":"2024-04-26T12:17:44.106383+0000","last_undegraded":"2024-04-26T12:17:44.106383+0000","last_fullsized":"2024-04-26T12:17:44.106383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:44.468143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107030+0000","last_change":"2024-04-26T12:17:44.107030+0000","last_active":"2024-04-26T12:17:44.107030+0000","last_peered":"2024-04-26T12:17:44.107030+0000","last_clean":"2024-04-26T12:17:44.107030+0000","last_became_active":"2024-04-26T12:17:44.106665+0000","last_became_peered":"2024-04-26T12:17:44.106665+0000","last_unstale":"2024-04-26T12:17:44.107030+0000","last_undegraded":"2024-04-26T12:17:44.107030+0000","last_fullsized":"2024-04-26T12:17:44.107030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:21.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102219+0000","last_change":"2024-04-26T12:17:44.102219+0000","last_active":"2024-04-26T12:17:44.102219+0000","last_peered":"2024-04-26T12:17:44.102219+0000","last_clean":"2024-04-26T12:17:44.102219+0000","last_became_active":"2024-04-26T12:17:44.101964+0000","last_became_peered":"2024-04-26T12:17:44.101964+0000","last_unstale":"2024-04-26T12:17:44.102219+0000","last_undegraded":"2024-04-26T12:17:44.102219+0000","last_fullsized":"2024-04-26T12:17:44.102219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.014776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106530+0000","last_change":"2024-04-26T12:17:44.106530+0000","last_active":"2024-04-26T12:17:44.106530+0000","last_peered":"2024-04-26T12:17:44.106530+0000","last_clean":"2024-04-26T12:17:44.106530+0000","last_became_active":"2024-04-26T12:17:44.106158+0000","last_became_peered":"2024-04-26T12:17:44.106158+0000","last_unstale":"2024-04-26T12:17:44.106530+0000","last_undegraded":"2024-04-26T12:17:44.106530+0000","last_fullsized":"2024-04-26T12:17:44.106530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:04.919616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":26,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107770+0000","last_change":"2024-04-26T12:17:44.107770+0000","last_active":"2024-04-26T12:17:44.107770+0000","last_peered":"2024-04-26T12:17:44.107770+0000","last_clean":"2024-04-26T12:17:44.107770+0000","last_became_active":"2024-04-26T12:17:44.106627+0000","last_became_peered":"2024-04-26T12:17:44.106627+0000","last_unstale":"2024-04-26T12:17:44.107770+0000","last_undegraded":"2024-04-26T12:17:44.107770+0000","last_fullsized":"2024-04-26T12:17:44.107770+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:23.758364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109545+0000","last_change":"2024-04-26T12:17:44.109545+0000","last_active":"2024-04-26T12:17:44.109545+0000","last_peered":"2024-04-26T12:17:44.109545+0000","last_clean":"2024-04-26T12:17:44.109545+0000","last_became_active":"2024-04-26T12:17:44.108869+0000","last_became_peered":"2024-04-26T12:17:44.108869+0000","last_unstale":"2024-04-26T12:17:44.109545+0000","last_undegraded":"2024-04-26T12:17:44.109545+0000","last_fullsized":"2024-04-26T12:17:44.109545+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:32.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102225+0000","last_change":"2024-04-26T12:17:44.102225+0000","last_active":"2024-04-26T12:17:44.102225+0000","last_peered":"2024-04-26T12:17:44.102225+0000","last_clean":"2024-04-26T12:17:44.102225+0000","last_became_active":"2024-04-26T12:17:44.101899+0000","last_became_peered":"2024-04-26T12:17:44.101899+0000","last_unstale":"2024-04-26T12:17:44.102225+0000","last_undegraded":"2024-04-26T12:17:44.102225+0000","last_fullsized":"2024-04-26T12:17:44.102225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:06.908520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104669+0000","last_change":"2024-04-26T12:17:44.104669+0000","last_active":"2024-04-26T12:17:44.104669+0000","last_peered":"2024-04-26T12:17:44.104669+0000","last_clean":"2024-04-26T12:17:44.104669+0000","last_became_active":"2024-04-26T12:17:44.103914+0000","last_became_peered":"2024-04-26T12:17:44.103914+0000","last_unstale":"2024-04-26T12:17:44.104669+0000","last_undegraded":"2024-04-26T12:17:44.104669+0000","last_fullsized":"2024-04-26T12:17:44.104669+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:40.889006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.095726+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:17:43.095726+0000","last_peered":"2024-04-26T12:17:43.095726+0000","last_clean":"2024-04-26T12:17:43.095726+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:17:43.095726+0000","last_undegraded":"2024-04-26T12:17:43.095726+0000","last_fullsized":"2024-04-26T12:17:43.095726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108656+0000","last_change":"2024-04-26T12:17:44.108656+0000","last_active":"2024-04-26T12:17:44.108656+0000","last_peered":"2024-04-26T12:17:44.108656+0000","last_clean":"2024-04-26T12:17:44.108656+0000","last_became_active":"2024-04-26T12:17:44.107325+0000","last_became_peered":"2024-04-26T12:17:44.107325+0000","last_unstale":"2024-04-26T12:17:44.108656+0000","last_undegraded":"2024-04-26T12:17:44.108656+0000","last_fullsized":"2024-04-26T12:17:44.108656+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:04.558983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105975+0000","last_change":"2024-04-26T12:17:44.105975+0000","last_active":"2024-04-26T12:17:44.105975+0000","last_peered":"2024-04-26T12:17:44.105975+0000","last_clean":"2024-04-26T12:17:44.105975+0000","last_became_active":"2024-04-26T12:17:44.104611+0000","last_became_peered":"2024-04-26T12:17:44.104611+0000","last_unstale":"2024-04-26T12:17:44.105975+0000","last_undegraded":"2024-04-26T12:17:44.105975+0000","last_fullsized":"2024-04-26T12:17:44.105975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:45.206187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102157+0000","last_change":"2024-04-26T12:17:44.102157+0000","last_active":"2024-04-26T12:17:44.102157+0000","last_peered":"2024-04-26T12:17:44.102157+0000","last_clean":"2024-04-26T12:17:44.102157+0000","last_became_active":"2024-04-26T12:17:44.100968+0000","last_became_peered":"2024-04-26T12:17:44.100968+0000","last_unstale":"2024-04-26T12:17:44.102157+0000","last_undegraded":"2024-04-26T12:17:44.102157+0000","last_fullsized":"2024-04-26T12:17:44.102157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:09.700092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108547+0000","last_change":"2024-04-26T12:17:44.108547+0000","last_active":"2024-04-26T12:17:44.108547+0000","last_peered":"2024-04-26T12:17:44.108547+0000","last_clean":"2024-04-26T12:17:44.108547+0000","last_became_active":"2024-04-26T12:17:44.108258+0000","last_became_peered":"2024-04-26T12:17:44.108258+0000","last_unstale":"2024-04-26T12:17:44.108547+0000","last_undegraded":"2024-04-26T12:17:44.108547+0000","last_fullsized":"2024-04-26T12:17:44.108547+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:50.664236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108696+0000","last_change":"2024-04-26T12:17:44.108696+0000","last_active":"2024-04-26T12:17:44.108696+0000","last_peered":"2024-04-26T12:17:44.108696+0000","last_clean":"2024-04-26T12:17:44.108696+0000","last_became_active":"2024-04-26T12:17:44.108328+0000","last_became_peered":"2024-04-26T12:17:44.108328+0000","last_unstale":"2024-04-26T12:17:44.108696+0000","last_undegraded":"2024-04-26T12:17:44.108696+0000","last_fullsized":"2024-04-26T12:17:44.108696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:20.947866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104405+0000","last_change":"2024-04-26T12:17:44.104405+0000","last_active":"2024-04-26T12:17:44.104405+0000","last_peered":"2024-04-26T12:17:44.104405+0000","last_clean":"2024-04-26T12:17:44.104405+0000","last_became_active":"2024-04-26T12:17:44.103729+0000","last_became_peered":"2024-04-26T12:17:44.103729+0000","last_unstale":"2024-04-26T12:17:44.104405+0000","last_undegraded":"2024-04-26T12:17:44.104405+0000","last_fullsized":"2024-04-26T12:17:44.104405+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.551268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100942+0000","last_change":"2024-04-26T12:17:44.100942+0000","last_active":"2024-04-26T12:17:44.100942+0000","last_peered":"2024-04-26T12:17:44.100942+0000","last_clean":"2024-04-26T12:17:44.100942+0000","last_became_active":"2024-04-26T12:17:44.100427+0000","last_became_peered":"2024-04-26T12:17:44.100427+0000","last_unstale":"2024-04-26T12:17:44.100942+0000","last_undegraded":"2024-04-26T12:17:44.100942+0000","last_fullsized":"2024-04-26T12:17:44.100942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:23.119594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108737+0000","last_change":"2024-04-26T12:17:44.108737+0000","last_active":"2024-04-26T12:17:44.108737+0000","last_peered":"2024-04-26T12:17:44.108737+0000","last_clean":"2024-04-26T12:17:44.108737+0000","last_became_active":"2024-04-26T12:17:44.106410+0000","last_became_peered":"2024-04-26T12:17:44.106410+0000","last_unstale":"2024-04-26T12:17:44.108737+0000","last_undegraded":"2024-04-26T12:17:44.108737+0000","last_fullsized":"2024-04-26T12:17:44.108737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:37.724269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102058+0000","last_change":"2024-04-26T12:17:44.102058+0000","last_active":"2024-04-26T12:17:44.102058+0000","last_peered":"2024-04-26T12:17:44.102058+0000","last_clean":"2024-04-26T12:17:44.102058+0000","last_became_active":"2024-04-26T12:17:44.101674+0000","last_became_peered":"2024-04-26T12:17:44.101674+0000","last_unstale":"2024-04-26T12:17:44.102058+0000","last_undegraded":"2024-04-26T12:17:44.102058+0000","last_fullsized":"2024-04-26T12:17:44.102058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:39.893129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107762+0000","last_change":"2024-04-26T12:17:44.107762+0000","last_active":"2024-04-26T12:17:44.107762+0000","last_peered":"2024-04-26T12:17:44.107762+0000","last_clean":"2024-04-26T12:17:44.107762+0000","last_became_active":"2024-04-26T12:17:44.107330+0000","last_became_peered":"2024-04-26T12:17:44.107330+0000","last_unstale":"2024-04-26T12:17:44.107762+0000","last_undegraded":"2024-04-26T12:17:44.107762+0000","last_fullsized":"2024-04-26T12:17:44.107762+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:30.363451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.096400+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:17:43.096400+0000","last_peered":"2024-04-26T12:17:43.096400+0000","last_clean":"2024-04-26T12:17:43.096400+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:17:43.096400+0000","last_undegraded":"2024-04-26T12:17:43.096400+0000","last_fullsized":"2024-04-26T12:17:43.096400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.103485+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:17:43.103485+0000","last_peered":"2024-04-26T12:17:43.103485+0000","last_clean":"2024-04-26T12:17:43.103485+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:17:43.103485+0000","last_undegraded":"2024-04-26T12:17:43.103485+0000","last_fullsized":"2024-04-26T12:17:43.103485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107483+0000","last_change":"2024-04-26T12:17:44.107483+0000","last_active":"2024-04-26T12:17:44.107483+0000","last_peered":"2024-04-26T12:17:44.107483+0000","last_clean":"2024-04-26T12:17:44.107483+0000","last_became_active":"2024-04-26T12:17:44.105857+0000","last_became_peered":"2024-04-26T12:17:44.105857+0000","last_unstale":"2024-04-26T12:17:44.107483+0000","last_undegraded":"2024-04-26T12:17:44.107483+0000","last_fullsized":"2024-04-26T12:17:44.107483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:48.246780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101071+0000","last_change":"2024-04-26T12:17:44.101071+0000","last_active":"2024-04-26T12:17:44.101071+0000","last_peered":"2024-04-26T12:17:44.101071+0000","last_clean":"2024-04-26T12:17:44.101071+0000","last_became_active":"2024-04-26T12:17:44.100349+0000","last_became_peered":"2024-04-26T12:17:44.100349+0000","last_unstale":"2024-04-26T12:17:44.101071+0000","last_undegraded":"2024-04-26T12:17:44.101071+0000","last_fullsized":"2024-04-26T12:17:44.101071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:43.460557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107935+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:17:43.107935+0000","last_peered":"2024-04-26T12:17:43.107935+0000","last_clean":"2024-04-26T12:17:43.107935+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:17:43.107935+0000","last_undegraded":"2024-04-26T12:17:43.107935+0000","last_fullsized":"2024-04-26T12:17:43.107935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109629+0000","last_change":"2024-04-26T12:17:44.109629+0000","last_active":"2024-04-26T12:17:44.109629+0000","last_peered":"2024-04-26T12:17:44.109629+0000","last_clean":"2024-04-26T12:17:44.109629+0000","last_became_active":"2024-04-26T12:17:44.107996+0000","last_became_peered":"2024-04-26T12:17:44.107996+0000","last_unstale":"2024-04-26T12:17:44.109629+0000","last_undegraded":"2024-04-26T12:17:44.109629+0000","last_fullsized":"2024-04-26T12:17:44.109629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:55.766146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108035+0000","last_change":"2024-04-26T12:17:44.108035+0000","last_active":"2024-04-26T12:17:44.108035+0000","last_peered":"2024-04-26T12:17:44.108035+0000","last_clean":"2024-04-26T12:17:44.108035+0000","last_became_active":"2024-04-26T12:17:44.106828+0000","last_became_peered":"2024-04-26T12:17:44.106828+0000","last_unstale":"2024-04-26T12:17:44.108035+0000","last_undegraded":"2024-04-26T12:17:44.108035+0000","last_fullsized":"2024-04-26T12:17:44.108035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:46.266331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107036+0000","last_change":"2024-04-26T12:17:44.107036+0000","last_active":"2024-04-26T12:17:44.107036+0000","last_peered":"2024-04-26T12:17:44.107036+0000","last_clean":"2024-04-26T12:17:44.107036+0000","last_became_active":"2024-04-26T12:17:44.106107+0000","last_became_peered":"2024-04-26T12:17:44.106107+0000","last_unstale":"2024-04-26T12:17:44.107036+0000","last_undegraded":"2024-04-26T12:17:44.107036+0000","last_fullsized":"2024-04-26T12:17:44.107036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:48.670109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097487+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:17:43.097487+0000","last_peered":"2024-04-26T12:17:43.097487+0000","last_clean":"2024-04-26T12:17:43.097487+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:17:43.097487+0000","last_undegraded":"2024-04-26T12:17:43.097487+0000","last_fullsized":"2024-04-26T12:17:43.097487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107569+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:17:43.107569+0000","last_peered":"2024-04-26T12:17:43.107569+0000","last_clean":"2024-04-26T12:17:43.107569+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:17:43.107569+0000","last_undegraded":"2024-04-26T12:17:43.107569+0000","last_fullsized":"2024-04-26T12:17:43.107569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104533+0000","last_change":"2024-04-26T12:17:44.104533+0000","last_active":"2024-04-26T12:17:44.104533+0000","last_peered":"2024-04-26T12:17:44.104533+0000","last_clean":"2024-04-26T12:17:44.104533+0000","last_became_active":"2024-04-26T12:17:44.104125+0000","last_became_peered":"2024-04-26T12:17:44.104125+0000","last_unstale":"2024-04-26T12:17:44.104533+0000","last_undegraded":"2024-04-26T12:17:44.104533+0000","last_fullsized":"2024-04-26T12:17:44.104533+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:37.852785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.103983+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:17:43.103983+0000","last_peered":"2024-04-26T12:17:43.103983+0000","last_clean":"2024-04-26T12:17:43.103983+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:17:43.103983+0000","last_undegraded":"2024-04-26T12:17:43.103983+0000","last_fullsized":"2024-04-26T12:17:43.103983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101053+0000","last_change":"2024-04-26T12:17:44.101053+0000","last_active":"2024-04-26T12:17:44.101053+0000","last_peered":"2024-04-26T12:17:44.101053+0000","last_clean":"2024-04-26T12:17:44.101053+0000","last_became_active":"2024-04-26T12:17:44.099948+0000","last_became_peered":"2024-04-26T12:17:44.099948+0000","last_unstale":"2024-04-26T12:17:44.101053+0000","last_undegraded":"2024-04-26T12:17:44.101053+0000","last_fullsized":"2024-04-26T12:17:44.101053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:19.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102672+0000","last_change":"2024-04-26T12:17:44.102672+0000","last_active":"2024-04-26T12:17:44.102672+0000","last_peered":"2024-04-26T12:17:44.102672+0000","last_clean":"2024-04-26T12:17:44.102672+0000","last_became_active":"2024-04-26T12:17:44.101703+0000","last_became_peered":"2024-04-26T12:17:44.101703+0000","last_unstale":"2024-04-26T12:17:44.102672+0000","last_undegraded":"2024-04-26T12:17:44.102672+0000","last_fullsized":"2024-04-26T12:17:44.102672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:12.916220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106158+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:17:43.106158+0000","last_peered":"2024-04-26T12:17:43.106158+0000","last_clean":"2024-04-26T12:17:43.106158+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:17:43.106158+0000","last_undegraded":"2024-04-26T12:17:43.106158+0000","last_fullsized":"2024-04-26T12:17:43.106158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100820+0000","last_change":"2024-04-26T12:17:44.100820+0000","last_active":"2024-04-26T12:17:44.100820+0000","last_peered":"2024-04-26T12:17:44.100820+0000","last_clean":"2024-04-26T12:17:44.100820+0000","last_became_active":"2024-04-26T12:17:44.100153+0000","last_became_peered":"2024-04-26T12:17:44.100153+0000","last_unstale":"2024-04-26T12:17:44.100820+0000","last_undegraded":"2024-04-26T12:17:44.100820+0000","last_fullsized":"2024-04-26T12:17:44.100820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.540128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106878+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:17:43.106878+0000","last_peered":"2024-04-26T12:17:43.106878+0000","last_clean":"2024-04-26T12:17:43.106878+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:17:43.106878+0000","last_undegraded":"2024-04-26T12:17:43.106878+0000","last_fullsized":"2024-04-26T12:17:43.106878+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104433+0000","last_change":"2024-04-26T12:17:44.104433+0000","last_active":"2024-04-26T12:17:44.104433+0000","last_peered":"2024-04-26T12:17:44.104433+0000","last_clean":"2024-04-26T12:17:44.104433+0000","last_became_active":"2024-04-26T12:17:44.104097+0000","last_became_peered":"2024-04-26T12:17:44.104097+0000","last_unstale":"2024-04-26T12:17:44.104433+0000","last_undegraded":"2024-04-26T12:17:44.104433+0000","last_fullsized":"2024-04-26T12:17:44.104433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:37.296331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106775+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:17:43.106775+0000","last_peered":"2024-04-26T12:17:43.106775+0000","last_clean":"2024-04-26T12:17:43.106775+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:17:43.106775+0000","last_undegraded":"2024-04-26T12:17:43.106775+0000","last_fullsized":"2024-04-26T12:17:43.106775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.102195+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:17:43.102195+0000","last_peered":"2024-04-26T12:17:43.102195+0000","last_clean":"2024-04-26T12:17:43.102195+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:17:43.102195+0000","last_undegraded":"2024-04-26T12:17:43.102195+0000","last_fullsized":"2024-04-26T12:17:43.102195+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109700+0000","last_change":"2024-04-26T12:17:44.109700+0000","last_active":"2024-04-26T12:17:44.109700+0000","last_peered":"2024-04-26T12:17:44.109700+0000","last_clean":"2024-04-26T12:17:44.109700+0000","last_became_active":"2024-04-26T12:17:44.109338+0000","last_became_peered":"2024-04-26T12:17:44.109338+0000","last_unstale":"2024-04-26T12:17:44.109700+0000","last_undegraded":"2024-04-26T12:17:44.109700+0000","last_fullsized":"2024-04-26T12:17:44.109700+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:02.948179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":66,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106127+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:17:43.106127+0000","last_peered":"2024-04-26T12:17:43.106127+0000","last_clean":"2024-04-26T12:17:43.106127+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:17:43.106127+0000","last_undegraded":"2024-04-26T12:17:43.106127+0000","last_fullsized":"2024-04-26T12:17:43.106127+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106990+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:17:43.106990+0000","last_peered":"2024-04-26T12:17:43.106990+0000","last_clean":"2024-04-26T12:17:43.106990+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:17:43.106990+0000","last_undegraded":"2024-04-26T12:17:43.106990+0000","last_fullsized":"2024-04-26T12:17:43.106990+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106532+0000","last_change":"2024-04-26T12:17:44.106532+0000","last_active":"2024-04-26T12:17:44.106532+0000","last_peered":"2024-04-26T12:17:44.106532+0000","last_clean":"2024-04-26T12:17:44.106532+0000","last_became_active":"2024-04-26T12:17:44.106036+0000","last_became_peered":"2024-04-26T12:17:44.106036+0000","last_unstale":"2024-04-26T12:17:44.106532+0000","last_undegraded":"2024-04-26T12:17:44.106532+0000","last_fullsized":"2024-04-26T12:17:44.106532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:42.404493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102936+0000","last_change":"2024-04-26T12:17:44.102936+0000","last_active":"2024-04-26T12:17:44.102936+0000","last_peered":"2024-04-26T12:17:44.102936+0000","last_clean":"2024-04-26T12:17:44.102936+0000","last_became_active":"2024-04-26T12:17:44.102634+0000","last_became_peered":"2024-04-26T12:17:44.102634+0000","last_unstale":"2024-04-26T12:17:44.102936+0000","last_undegraded":"2024-04-26T12:17:44.102936+0000","last_fullsized":"2024-04-26T12:17:44.102936+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:39.641964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102223+0000","last_change":"2024-04-26T12:17:44.102223+0000","last_active":"2024-04-26T12:17:44.102223+0000","last_peered":"2024-04-26T12:17:44.102223+0000","last_clean":"2024-04-26T12:17:44.102223+0000","last_became_active":"2024-04-26T12:17:44.101566+0000","last_became_peered":"2024-04-26T12:17:44.101566+0000","last_unstale":"2024-04-26T12:17:44.102223+0000","last_undegraded":"2024-04-26T12:17:44.102223+0000","last_fullsized":"2024-04-26T12:17:44.102223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:59.569612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101906+0000","last_change":"2024-04-26T12:17:44.101906+0000","last_active":"2024-04-26T12:17:44.101906+0000","last_peered":"2024-04-26T12:17:44.101906+0000","last_clean":"2024-04-26T12:17:44.101906+0000","last_became_active":"2024-04-26T12:17:44.101636+0000","last_became_peered":"2024-04-26T12:17:44.101636+0000","last_unstale":"2024-04-26T12:17:44.101906+0000","last_undegraded":"2024-04-26T12:17:44.101906+0000","last_fullsized":"2024-04-26T12:17:44.101906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:44.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108018+0000","last_change":"2024-04-26T12:17:44.108018+0000","last_active":"2024-04-26T12:17:44.108018+0000","last_peered":"2024-04-26T12:17:44.108018+0000","last_clean":"2024-04-26T12:17:44.108018+0000","last_became_active":"2024-04-26T12:17:44.106774+0000","last_became_peered":"2024-04-26T12:17:44.106774+0000","last_unstale":"2024-04-26T12:17:44.108018+0000","last_undegraded":"2024-04-26T12:17:44.108018+0000","last_fullsized":"2024-04-26T12:17:44.108018+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:50.785680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":27,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102550+0000","last_change":"2024-04-26T12:17:44.102550+0000","last_active":"2024-04-26T12:17:44.102550+0000","last_peered":"2024-04-26T12:17:44.102550+0000","last_clean":"2024-04-26T12:17:44.102550+0000","last_became_active":"2024-04-26T12:17:44.102114+0000","last_became_peered":"2024-04-26T12:17:44.102114+0000","last_unstale":"2024-04-26T12:17:44.102550+0000","last_undegraded":"2024-04-26T12:17:44.102550+0000","last_fullsized":"2024-04-26T12:17:44.102550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:23.647496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107083+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:17:43.107083+0000","last_peered":"2024-04-26T12:17:43.107083+0000","last_clean":"2024-04-26T12:17:43.107083+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:17:43.107083+0000","last_undegraded":"2024-04-26T12:17:43.107083+0000","last_fullsized":"2024-04-26T12:17:43.107083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105911+0000","last_change":"2024-04-26T12:17:44.105911+0000","last_active":"2024-04-26T12:17:44.105911+0000","last_peered":"2024-04-26T12:17:44.105911+0000","last_clean":"2024-04-26T12:17:44.105911+0000","last_became_active":"2024-04-26T12:17:44.105642+0000","last_became_peered":"2024-04-26T12:17:44.105642+0000","last_unstale":"2024-04-26T12:17:44.105911+0000","last_undegraded":"2024-04-26T12:17:44.105911+0000","last_fullsized":"2024-04-26T12:17:44.105911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:56.685927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101208+0000","last_change":"2024-04-26T12:17:44.101208+0000","last_active":"2024-04-26T12:17:44.101208+0000","last_peered":"2024-04-26T12:17:44.101208+0000","last_clean":"2024-04-26T12:17:44.101208+0000","last_became_active":"2024-04-26T12:17:44.100576+0000","last_became_peered":"2024-04-26T12:17:44.100576+0000","last_unstale":"2024-04-26T12:17:44.101208+0000","last_undegraded":"2024-04-26T12:17:44.101208+0000","last_fullsized":"2024-04-26T12:17:44.101208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:40.393748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107883+0000","last_change":"2024-04-26T12:17:44.107883+0000","last_active":"2024-04-26T12:17:44.107883+0000","last_peered":"2024-04-26T12:17:44.107883+0000","last_clean":"2024-04-26T12:17:44.107883+0000","last_became_active":"2024-04-26T12:17:44.107368+0000","last_became_peered":"2024-04-26T12:17:44.107368+0000","last_unstale":"2024-04-26T12:17:44.107883+0000","last_undegraded":"2024-04-26T12:17:44.107883+0000","last_fullsized":"2024-04-26T12:17:44.107883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.453513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102987+0000","last_change":"2024-04-26T12:17:44.102987+0000","last_active":"2024-04-26T12:17:44.102987+0000","last_peered":"2024-04-26T12:17:44.102987+0000","last_clean":"2024-04-26T12:17:44.102987+0000","last_became_active":"2024-04-26T12:17:44.102714+0000","last_became_peered":"2024-04-26T12:17:44.102714+0000","last_unstale":"2024-04-26T12:17:44.102987+0000","last_undegraded":"2024-04-26T12:17:44.102987+0000","last_fullsized":"2024-04-26T12:17:44.102987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:33.785559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106991+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:17:43.106991+0000","last_peered":"2024-04-26T12:17:43.106991+0000","last_clean":"2024-04-26T12:17:43.106991+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:17:43.106991+0000","last_undegraded":"2024-04-26T12:17:43.106991+0000","last_fullsized":"2024-04-26T12:17:43.106991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104923+0000","last_change":"2024-04-26T12:17:44.104923+0000","last_active":"2024-04-26T12:17:44.104923+0000","last_peered":"2024-04-26T12:17:44.104923+0000","last_clean":"2024-04-26T12:17:44.104923+0000","last_became_active":"2024-04-26T12:17:44.104005+0000","last_became_peered":"2024-04-26T12:17:44.104005+0000","last_unstale":"2024-04-26T12:17:44.104923+0000","last_undegraded":"2024-04-26T12:17:44.104923+0000","last_fullsized":"2024-04-26T12:17:44.104923+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:45.472750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107149+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:17:43.107149+0000","last_peered":"2024-04-26T12:17:43.107149+0000","last_clean":"2024-04-26T12:17:43.107149+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:17:43.107149+0000","last_undegraded":"2024-04-26T12:17:43.107149+0000","last_fullsized":"2024-04-26T12:17:43.107149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106643+0000","last_change":"2024-04-26T12:17:44.106643+0000","last_active":"2024-04-26T12:17:44.106643+0000","last_peered":"2024-04-26T12:17:44.106643+0000","last_clean":"2024-04-26T12:17:44.106643+0000","last_became_active":"2024-04-26T12:17:44.105890+0000","last_became_peered":"2024-04-26T12:17:44.105890+0000","last_unstale":"2024-04-26T12:17:44.106643+0000","last_undegraded":"2024-04-26T12:17:44.106643+0000","last_fullsized":"2024-04-26T12:17:44.106643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:19.310096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107272+0000","last_change":"2024-04-26T12:17:44.107272+0000","last_active":"2024-04-26T12:17:44.107272+0000","last_peered":"2024-04-26T12:17:44.107272+0000","last_clean":"2024-04-26T12:17:44.107272+0000","last_became_active":"2024-04-26T12:17:44.106147+0000","last_became_peered":"2024-04-26T12:17:44.106147+0000","last_unstale":"2024-04-26T12:17:44.107272+0000","last_undegraded":"2024-04-26T12:17:44.107272+0000","last_fullsized":"2024-04-26T12:17:44.107272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:23.013459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105648+0000","last_change":"2024-04-26T12:17:44.105648+0000","last_active":"2024-04-26T12:17:44.105648+0000","last_peered":"2024-04-26T12:17:44.105648+0000","last_clean":"2024-04-26T12:17:44.105648+0000","last_became_active":"2024-04-26T12:17:44.105216+0000","last_became_peered":"2024-04-26T12:17:44.105216+0000","last_unstale":"2024-04-26T12:17:44.105648+0000","last_undegraded":"2024-04-26T12:17:44.105648+0000","last_fullsized":"2024-04-26T12:17:44.105648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:18.126904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.098581+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:17:43.098581+0000","last_peered":"2024-04-26T12:17:43.098581+0000","last_clean":"2024-04-26T12:17:43.098581+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:17:43.098581+0000","last_undegraded":"2024-04-26T12:17:43.098581+0000","last_fullsized":"2024-04-26T12:17:43.098581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097429+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:17:43.097429+0000","last_peered":"2024-04-26T12:17:43.097429+0000","last_clean":"2024-04-26T12:17:43.097429+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:17:43.097429+0000","last_undegraded":"2024-04-26T12:17:43.097429+0000","last_fullsized":"2024-04-26T12:17:43.097429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109792+0000","last_change":"2024-04-26T12:17:44.109792+0000","last_active":"2024-04-26T12:17:44.109792+0000","last_peered":"2024-04-26T12:17:44.109792+0000","last_clean":"2024-04-26T12:17:44.109792+0000","last_became_active":"2024-04-26T12:17:44.109360+0000","last_became_peered":"2024-04-26T12:17:44.109360+0000","last_unstale":"2024-04-26T12:17:44.109792+0000","last_undegraded":"2024-04-26T12:17:44.109792+0000","last_fullsized":"2024-04-26T12:17:44.109792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:13.622968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105878+0000","last_change":"2024-04-26T12:17:44.105878+0000","last_active":"2024-04-26T12:17:44.105878+0000","last_peered":"2024-04-26T12:17:44.105878+0000","last_clean":"2024-04-26T12:17:44.105878+0000","last_became_active":"2024-04-26T12:17:44.104220+0000","last_became_peered":"2024-04-26T12:17:44.104220+0000","last_unstale":"2024-04-26T12:17:44.105878+0000","last_undegraded":"2024-04-26T12:17:44.105878+0000","last_fullsized":"2024-04-26T12:17:44.105878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:37.800239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101637+0000","last_change":"2024-04-26T12:17:44.101637+0000","last_active":"2024-04-26T12:17:44.101637+0000","last_peered":"2024-04-26T12:17:44.101637+0000","last_clean":"2024-04-26T12:17:44.101637+0000","last_became_active":"2024-04-26T12:17:44.100911+0000","last_became_peered":"2024-04-26T12:17:44.100911+0000","last_unstale":"2024-04-26T12:17:44.101637+0000","last_undegraded":"2024-04-26T12:17:44.101637+0000","last_fullsized":"2024-04-26T12:17:44.101637+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:08.022971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.103731+0000","last_change":"2024-04-26T12:17:44.103731+0000","last_active":"2024-04-26T12:17:44.103731+0000","last_peered":"2024-04-26T12:17:44.103731+0000","last_clean":"2024-04-26T12:17:44.103731+0000","last_became_active":"2024-04-26T12:17:44.103151+0000","last_became_peered":"2024-04-26T12:17:44.103151+0000","last_unstale":"2024-04-26T12:17:44.103731+0000","last_undegraded":"2024-04-26T12:17:44.103731+0000","last_fullsized":"2024-04-26T12:17:44.103731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:31.552466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105804+0000","last_change":"2024-04-26T12:17:44.105804+0000","last_active":"2024-04-26T12:17:44.105804+0000","last_peered":"2024-04-26T12:17:44.105804+0000","last_clean":"2024-04-26T12:17:44.105804+0000","last_became_active":"2024-04-26T12:17:44.105280+0000","last_became_peered":"2024-04-26T12:17:44.105280+0000","last_unstale":"2024-04-26T12:17:44.105804+0000","last_undegraded":"2024-04-26T12:17:44.105804+0000","last_fullsized":"2024-04-26T12:17:44.105804+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:13.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.099163+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:17:43.099163+0000","last_peered":"2024-04-26T12:17:43.099163+0000","last_clean":"2024-04-26T12:17:43.099163+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:17:43.099163+0000","last_undegraded":"2024-04-26T12:17:43.099163+0000","last_fullsized":"2024-04-26T12:17:43.099163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106622+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:17:43.106622+0000","last_peered":"2024-04-26T12:17:43.106622+0000","last_clean":"2024-04-26T12:17:43.106622+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:17:43.106622+0000","last_undegraded":"2024-04-26T12:17:43.106622+0000","last_fullsized":"2024-04-26T12:17:43.106622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105189+0000","last_change":"2024-04-26T12:17:44.105189+0000","last_active":"2024-04-26T12:17:44.105189+0000","last_peered":"2024-04-26T12:17:44.105189+0000","last_clean":"2024-04-26T12:17:44.105189+0000","last_became_active":"2024-04-26T12:17:44.104460+0000","last_became_peered":"2024-04-26T12:17:44.104460+0000","last_unstale":"2024-04-26T12:17:44.105189+0000","last_undegraded":"2024-04-26T12:17:44.105189+0000","last_fullsized":"2024-04-26T12:17:44.105189+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:24.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106901+0000","last_change":"2024-04-26T12:17:44.106901+0000","last_active":"2024-04-26T12:17:44.106901+0000","last_peered":"2024-04-26T12:17:44.106901+0000","last_clean":"2024-04-26T12:17:44.106901+0000","last_became_active":"2024-04-26T12:17:44.106432+0000","last_became_peered":"2024-04-26T12:17:44.106432+0000","last_unstale":"2024-04-26T12:17:44.106901+0000","last_undegraded":"2024-04-26T12:17:44.106901+0000","last_fullsized":"2024-04-26T12:17:44.106901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:59.890908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321224,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050616,"statfs":{"total":96636764160,"available":96307830784,"internally_reserved":0,"allocated":1368064,"data_stored":879942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:17:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.35699999999999998,"15min":0.375},"min":{"1min":0.19,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.88400000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":1,"up_from":66,"seq":283467841538,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29516,"kb_used_data":1344,"kb_used_omap":6,"kb_used_meta":28153,"kb_avail":94342324,"statfs":{"total":96636764160,"available":96606539776,"internally_reserved":0,"allocated":1376256,"data_stored":880558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7076,"internal_metadata":28828764},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483060,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888780,"statfs":{"total":96636764160,"available":96142110720,"internally_reserved":0,"allocated":753664,"data_stored":286331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.161,"15min":0.161},"max":{"1min":0.64000000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.185,"15min":0.185},"max":{"1min":0.65000000000000002,"5min":0.879,"15min":0.879},"last":0.47299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:17:50.441 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:17:50.760 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:17:50.762 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:17:50.772 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-04-26T12:17:50.468711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":833800,"kb_used_data":3416,"kb_used_omap":10,"kb_used_meta":830325,"kb_avail":282281720,"statfs":{"total":289910292480,"available":289056481280,"internally_reserved":0,"allocated":3497984,"data_stored":2046831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10264,"internal_metadata":850253800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001513"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097942+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:17:43.097942+0000","last_peered":"2024-04-26T12:17:43.097942+0000","last_clean":"2024-04-26T12:17:43.097942+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:17:43.097942+0000","last_undegraded":"2024-04-26T12:17:43.097942+0000","last_fullsized":"2024-04-26T12:17:43.097942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097186+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:17:43.097186+0000","last_peered":"2024-04-26T12:17:43.097186+0000","last_clean":"2024-04-26T12:17:43.097186+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:17:43.097186+0000","last_undegraded":"2024-04-26T12:17:43.097186+0000","last_fullsized":"2024-04-26T12:17:43.097186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109808+0000","last_change":"2024-04-26T12:17:44.109808+0000","last_active":"2024-04-26T12:17:44.109808+0000","last_peered":"2024-04-26T12:17:44.109808+0000","last_clean":"2024-04-26T12:17:44.109808+0000","last_became_active":"2024-04-26T12:17:44.108039+0000","last_became_peered":"2024-04-26T12:17:44.108039+0000","last_unstale":"2024-04-26T12:17:44.109808+0000","last_undegraded":"2024-04-26T12:17:44.109808+0000","last_fullsized":"2024-04-26T12:17:44.109808+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:42.283308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100480+0000","last_change":"2024-04-26T12:17:44.100480+0000","last_active":"2024-04-26T12:17:44.100480+0000","last_peered":"2024-04-26T12:17:44.100480+0000","last_clean":"2024-04-26T12:17:44.100480+0000","last_became_active":"2024-04-26T12:17:44.100006+0000","last_became_peered":"2024-04-26T12:17:44.100006+0000","last_unstale":"2024-04-26T12:17:44.100480+0000","last_undegraded":"2024-04-26T12:17:44.100480+0000","last_fullsized":"2024-04-26T12:17:44.100480+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:48.064571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.096684+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:17:43.096684+0000","last_peered":"2024-04-26T12:17:43.096684+0000","last_clean":"2024-04-26T12:17:43.096684+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:17:43.096684+0000","last_undegraded":"2024-04-26T12:17:43.096684+0000","last_fullsized":"2024-04-26T12:17:43.096684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105887+0000","last_change":"2024-04-26T12:17:44.105887+0000","last_active":"2024-04-26T12:17:44.105887+0000","last_peered":"2024-04-26T12:17:44.105887+0000","last_clean":"2024-04-26T12:17:44.105887+0000","last_became_active":"2024-04-26T12:17:44.104771+0000","last_became_peered":"2024-04-26T12:17:44.104771+0000","last_unstale":"2024-04-26T12:17:44.105887+0000","last_undegraded":"2024-04-26T12:17:44.105887+0000","last_fullsized":"2024-04-26T12:17:44.105887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:45.218679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104383+0000","last_change":"2024-04-26T12:17:44.104383+0000","last_active":"2024-04-26T12:17:44.104383+0000","last_peered":"2024-04-26T12:17:44.104383+0000","last_clean":"2024-04-26T12:17:44.104383+0000","last_became_active":"2024-04-26T12:17:44.103584+0000","last_became_peered":"2024-04-26T12:17:44.103584+0000","last_unstale":"2024-04-26T12:17:44.104383+0000","last_undegraded":"2024-04-26T12:17:44.104383+0000","last_fullsized":"2024-04-26T12:17:44.104383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:42.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102070+0000","last_change":"2024-04-26T12:17:44.102070+0000","last_active":"2024-04-26T12:17:44.102070+0000","last_peered":"2024-04-26T12:17:44.102070+0000","last_clean":"2024-04-26T12:17:44.102070+0000","last_became_active":"2024-04-26T12:17:44.100825+0000","last_became_peered":"2024-04-26T12:17:44.100825+0000","last_unstale":"2024-04-26T12:17:44.102070+0000","last_undegraded":"2024-04-26T12:17:44.102070+0000","last_fullsized":"2024-04-26T12:17:44.102070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:49.320867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.102289+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:17:43.102289+0000","last_peered":"2024-04-26T12:17:43.102289+0000","last_clean":"2024-04-26T12:17:43.102289+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:17:43.102289+0000","last_undegraded":"2024-04-26T12:17:43.102289+0000","last_fullsized":"2024-04-26T12:17:43.102289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097325+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:17:43.097325+0000","last_peered":"2024-04-26T12:17:43.097325+0000","last_clean":"2024-04-26T12:17:43.097325+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:17:43.097325+0000","last_undegraded":"2024-04-26T12:17:43.097325+0000","last_fullsized":"2024-04-26T12:17:43.097325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106580+0000","last_change":"2024-04-26T12:17:44.106580+0000","last_active":"2024-04-26T12:17:44.106580+0000","last_peered":"2024-04-26T12:17:44.106580+0000","last_clean":"2024-04-26T12:17:44.106580+0000","last_became_active":"2024-04-26T12:17:44.104450+0000","last_became_peered":"2024-04-26T12:17:44.104450+0000","last_unstale":"2024-04-26T12:17:44.106580+0000","last_undegraded":"2024-04-26T12:17:44.106580+0000","last_fullsized":"2024-04-26T12:17:44.106580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:46.199335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105500+0000","last_change":"2024-04-26T12:17:44.105500+0000","last_active":"2024-04-26T12:17:44.105500+0000","last_peered":"2024-04-26T12:17:44.105500+0000","last_clean":"2024-04-26T12:17:44.105500+0000","last_became_active":"2024-04-26T12:17:44.104398+0000","last_became_peered":"2024-04-26T12:17:44.104398+0000","last_unstale":"2024-04-26T12:17:44.105500+0000","last_undegraded":"2024-04-26T12:17:44.105500+0000","last_fullsized":"2024-04-26T12:17:44.105500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.095959+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:17:43.095959+0000","last_peered":"2024-04-26T12:17:43.095959+0000","last_clean":"2024-04-26T12:17:43.095959+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:17:43.095959+0000","last_undegraded":"2024-04-26T12:17:43.095959+0000","last_fullsized":"2024-04-26T12:17:43.095959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108572+0000","last_change":"2024-04-26T12:17:44.108572+0000","last_active":"2024-04-26T12:17:44.108572+0000","last_peered":"2024-04-26T12:17:44.108572+0000","last_clean":"2024-04-26T12:17:44.108572+0000","last_became_active":"2024-04-26T12:17:44.106664+0000","last_became_peered":"2024-04-26T12:17:44.106664+0000","last_unstale":"2024-04-26T12:17:44.108572+0000","last_undegraded":"2024-04-26T12:17:44.108572+0000","last_fullsized":"2024-04-26T12:17:44.108572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:10.139675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107371+0000","last_change":"2024-04-26T12:17:44.107371+0000","last_active":"2024-04-26T12:17:44.107371+0000","last_peered":"2024-04-26T12:17:44.107371+0000","last_clean":"2024-04-26T12:17:44.107371+0000","last_became_active":"2024-04-26T12:17:44.105812+0000","last_became_peered":"2024-04-26T12:17:44.105812+0000","last_unstale":"2024-04-26T12:17:44.107371+0000","last_undegraded":"2024-04-26T12:17:44.107371+0000","last_fullsized":"2024-04-26T12:17:44.107371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:42.134380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105349+0000","last_change":"2024-04-26T12:17:44.105349+0000","last_active":"2024-04-26T12:17:44.105349+0000","last_peered":"2024-04-26T12:17:44.105349+0000","last_clean":"2024-04-26T12:17:44.105349+0000","last_became_active":"2024-04-26T12:17:44.104601+0000","last_became_peered":"2024-04-26T12:17:44.104601+0000","last_unstale":"2024-04-26T12:17:44.105349+0000","last_undegraded":"2024-04-26T12:17:44.105349+0000","last_fullsized":"2024-04-26T12:17:44.105349+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:08.232303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.105932+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:17:43.105932+0000","last_peered":"2024-04-26T12:17:43.105932+0000","last_clean":"2024-04-26T12:17:43.105932+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:17:43.105932+0000","last_undegraded":"2024-04-26T12:17:43.105932+0000","last_fullsized":"2024-04-26T12:17:43.105932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097693+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:17:43.097693+0000","last_peered":"2024-04-26T12:17:43.097693+0000","last_clean":"2024-04-26T12:17:43.097693+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:17:43.097693+0000","last_undegraded":"2024-04-26T12:17:43.097693+0000","last_fullsized":"2024-04-26T12:17:43.097693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.102370+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:17:43.102370+0000","last_peered":"2024-04-26T12:17:43.102370+0000","last_clean":"2024-04-26T12:17:43.102370+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:17:43.102370+0000","last_undegraded":"2024-04-26T12:17:43.102370+0000","last_fullsized":"2024-04-26T12:17:43.102370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104892+0000","last_change":"2024-04-26T12:17:44.104892+0000","last_active":"2024-04-26T12:17:44.104892+0000","last_peered":"2024-04-26T12:17:44.104892+0000","last_clean":"2024-04-26T12:17:44.104892+0000","last_became_active":"2024-04-26T12:17:44.103880+0000","last_became_peered":"2024-04-26T12:17:44.103880+0000","last_unstale":"2024-04-26T12:17:44.104892+0000","last_undegraded":"2024-04-26T12:17:44.104892+0000","last_fullsized":"2024-04-26T12:17:44.104892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:30.680921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106482+0000","last_change":"2024-04-26T12:17:44.106482+0000","last_active":"2024-04-26T12:17:44.106482+0000","last_peered":"2024-04-26T12:17:44.106482+0000","last_clean":"2024-04-26T12:17:44.106482+0000","last_became_active":"2024-04-26T12:17:44.105141+0000","last_became_peered":"2024-04-26T12:17:44.105141+0000","last_unstale":"2024-04-26T12:17:44.106482+0000","last_undegraded":"2024-04-26T12:17:44.106482+0000","last_fullsized":"2024-04-26T12:17:44.106482+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:19.098834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105075+0000","last_change":"2024-04-26T12:17:44.105075+0000","last_active":"2024-04-26T12:17:44.105075+0000","last_peered":"2024-04-26T12:17:44.105075+0000","last_clean":"2024-04-26T12:17:44.105075+0000","last_became_active":"2024-04-26T12:17:44.104629+0000","last_became_peered":"2024-04-26T12:17:44.104629+0000","last_unstale":"2024-04-26T12:17:44.105075+0000","last_undegraded":"2024-04-26T12:17:44.105075+0000","last_fullsized":"2024-04-26T12:17:44.105075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:29.767394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107876+0000","last_change":"2024-04-26T12:17:44.107876+0000","last_active":"2024-04-26T12:17:44.107876+0000","last_peered":"2024-04-26T12:17:44.107876+0000","last_clean":"2024-04-26T12:17:44.107876+0000","last_became_active":"2024-04-26T12:17:44.106778+0000","last_became_peered":"2024-04-26T12:17:44.106778+0000","last_unstale":"2024-04-26T12:17:44.107876+0000","last_undegraded":"2024-04-26T12:17:44.107876+0000","last_fullsized":"2024-04-26T12:17:44.107876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:08.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.095615+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:17:43.095615+0000","last_peered":"2024-04-26T12:17:43.095615+0000","last_clean":"2024-04-26T12:17:43.095615+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:17:43.095615+0000","last_undegraded":"2024-04-26T12:17:43.095615+0000","last_fullsized":"2024-04-26T12:17:43.095615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105270+0000","last_change":"2024-04-26T12:17:44.105270+0000","last_active":"2024-04-26T12:17:44.105270+0000","last_peered":"2024-04-26T12:17:44.105270+0000","last_clean":"2024-04-26T12:17:44.105270+0000","last_became_active":"2024-04-26T12:17:44.104452+0000","last_became_peered":"2024-04-26T12:17:44.104452+0000","last_unstale":"2024-04-26T12:17:44.105270+0000","last_undegraded":"2024-04-26T12:17:44.105270+0000","last_fullsized":"2024-04-26T12:17:44.105270+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:22.685511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106877+0000","last_change":"2024-04-26T12:17:44.106877+0000","last_active":"2024-04-26T12:17:44.106877+0000","last_peered":"2024-04-26T12:17:44.106877+0000","last_clean":"2024-04-26T12:17:44.106877+0000","last_became_active":"2024-04-26T12:17:44.106322+0000","last_became_peered":"2024-04-26T12:17:44.106322+0000","last_unstale":"2024-04-26T12:17:44.106877+0000","last_undegraded":"2024-04-26T12:17:44.106877+0000","last_fullsized":"2024-04-26T12:17:44.106877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:10.112402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109143+0000","last_change":"2024-04-26T12:17:44.109143+0000","last_active":"2024-04-26T12:17:44.109143+0000","last_peered":"2024-04-26T12:17:44.109143+0000","last_clean":"2024-04-26T12:17:44.109143+0000","last_became_active":"2024-04-26T12:17:44.107515+0000","last_became_peered":"2024-04-26T12:17:44.107515+0000","last_unstale":"2024-04-26T12:17:44.109143+0000","last_undegraded":"2024-04-26T12:17:44.109143+0000","last_fullsized":"2024-04-26T12:17:44.109143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:27.955070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105498+0000","last_change":"2024-04-26T12:17:44.105498+0000","last_active":"2024-04-26T12:17:44.105498+0000","last_peered":"2024-04-26T12:17:44.105498+0000","last_clean":"2024-04-26T12:17:44.105498+0000","last_became_active":"2024-04-26T12:17:44.104599+0000","last_became_peered":"2024-04-26T12:17:44.104599+0000","last_unstale":"2024-04-26T12:17:44.105498+0000","last_undegraded":"2024-04-26T12:17:44.105498+0000","last_fullsized":"2024-04-26T12:17:44.105498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:02.689137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.104392+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:17:43.104392+0000","last_peered":"2024-04-26T12:17:43.104392+0000","last_clean":"2024-04-26T12:17:43.104392+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:17:43.104392+0000","last_undegraded":"2024-04-26T12:17:43.104392+0000","last_fullsized":"2024-04-26T12:17:43.104392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105524+0000","last_change":"2024-04-26T12:17:44.105524+0000","last_active":"2024-04-26T12:17:44.105524+0000","last_peered":"2024-04-26T12:17:44.105524+0000","last_clean":"2024-04-26T12:17:44.105524+0000","last_became_active":"2024-04-26T12:17:44.104812+0000","last_became_peered":"2024-04-26T12:17:44.104812+0000","last_unstale":"2024-04-26T12:17:44.105524+0000","last_undegraded":"2024-04-26T12:17:44.105524+0000","last_fullsized":"2024-04-26T12:17:44.105524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:51.792918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107407+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:17:43.107407+0000","last_peered":"2024-04-26T12:17:43.107407+0000","last_clean":"2024-04-26T12:17:43.107407+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:17:43.107407+0000","last_undegraded":"2024-04-26T12:17:43.107407+0000","last_fullsized":"2024-04-26T12:17:43.107407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100660+0000","last_change":"2024-04-26T12:17:44.100660+0000","last_active":"2024-04-26T12:17:44.100660+0000","last_peered":"2024-04-26T12:17:44.100660+0000","last_clean":"2024-04-26T12:17:44.100660+0000","last_became_active":"2024-04-26T12:17:44.099937+0000","last_became_peered":"2024-04-26T12:17:44.099937+0000","last_unstale":"2024-04-26T12:17:44.100660+0000","last_undegraded":"2024-04-26T12:17:44.100660+0000","last_fullsized":"2024-04-26T12:17:44.100660+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:45.974578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097532+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:17:43.097532+0000","last_peered":"2024-04-26T12:17:43.097532+0000","last_clean":"2024-04-26T12:17:43.097532+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:17:43.097532+0000","last_undegraded":"2024-04-26T12:17:43.097532+0000","last_fullsized":"2024-04-26T12:17:43.097532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104913+0000","last_change":"2024-04-26T12:17:44.104913+0000","last_active":"2024-04-26T12:17:44.104913+0000","last_peered":"2024-04-26T12:17:44.104913+0000","last_clean":"2024-04-26T12:17:44.104913+0000","last_became_active":"2024-04-26T12:17:44.103912+0000","last_became_peered":"2024-04-26T12:17:44.103912+0000","last_unstale":"2024-04-26T12:17:44.104913+0000","last_undegraded":"2024-04-26T12:17:44.104913+0000","last_fullsized":"2024-04-26T12:17:44.104913+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:25.791295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.100890+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:17:43.100890+0000","last_peered":"2024-04-26T12:17:43.100890+0000","last_clean":"2024-04-26T12:17:43.100890+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:17:43.100890+0000","last_undegraded":"2024-04-26T12:17:43.100890+0000","last_fullsized":"2024-04-26T12:17:43.100890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106383+0000","last_change":"2024-04-26T12:17:44.106383+0000","last_active":"2024-04-26T12:17:44.106383+0000","last_peered":"2024-04-26T12:17:44.106383+0000","last_clean":"2024-04-26T12:17:44.106383+0000","last_became_active":"2024-04-26T12:17:44.105933+0000","last_became_peered":"2024-04-26T12:17:44.105933+0000","last_unstale":"2024-04-26T12:17:44.106383+0000","last_undegraded":"2024-04-26T12:17:44.106383+0000","last_fullsized":"2024-04-26T12:17:44.106383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:44.468143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107030+0000","last_change":"2024-04-26T12:17:44.107030+0000","last_active":"2024-04-26T12:17:44.107030+0000","last_peered":"2024-04-26T12:17:44.107030+0000","last_clean":"2024-04-26T12:17:44.107030+0000","last_became_active":"2024-04-26T12:17:44.106665+0000","last_became_peered":"2024-04-26T12:17:44.106665+0000","last_unstale":"2024-04-26T12:17:44.107030+0000","last_undegraded":"2024-04-26T12:17:44.107030+0000","last_fullsized":"2024-04-26T12:17:44.107030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:21.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102219+0000","last_change":"2024-04-26T12:17:44.102219+0000","last_active":"2024-04-26T12:17:44.102219+0000","last_peered":"2024-04-26T12:17:44.102219+0000","last_clean":"2024-04-26T12:17:44.102219+0000","last_became_active":"2024-04-26T12:17:44.101964+0000","last_became_peered":"2024-04-26T12:17:44.101964+0000","last_unstale":"2024-04-26T12:17:44.102219+0000","last_undegraded":"2024-04-26T12:17:44.102219+0000","last_fullsized":"2024-04-26T12:17:44.102219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.014776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106530+0000","last_change":"2024-04-26T12:17:44.106530+0000","last_active":"2024-04-26T12:17:44.106530+0000","last_peered":"2024-04-26T12:17:44.106530+0000","last_clean":"2024-04-26T12:17:44.106530+0000","last_became_active":"2024-04-26T12:17:44.106158+0000","last_became_peered":"2024-04-26T12:17:44.106158+0000","last_unstale":"2024-04-26T12:17:44.106530+0000","last_undegraded":"2024-04-26T12:17:44.106530+0000","last_fullsized":"2024-04-26T12:17:44.106530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:04.919616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":26,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107770+0000","last_change":"2024-04-26T12:17:44.107770+0000","last_active":"2024-04-26T12:17:44.107770+0000","last_peered":"2024-04-26T12:17:44.107770+0000","last_clean":"2024-04-26T12:17:44.107770+0000","last_became_active":"2024-04-26T12:17:44.106627+0000","last_became_peered":"2024-04-26T12:17:44.106627+0000","last_unstale":"2024-04-26T12:17:44.107770+0000","last_undegraded":"2024-04-26T12:17:44.107770+0000","last_fullsized":"2024-04-26T12:17:44.107770+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:23.758364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109545+0000","last_change":"2024-04-26T12:17:44.109545+0000","last_active":"2024-04-26T12:17:44.109545+0000","last_peered":"2024-04-26T12:17:44.109545+0000","last_clean":"2024-04-26T12:17:44.109545+0000","last_became_active":"2024-04-26T12:17:44.108869+0000","last_became_peered":"2024-04-26T12:17:44.108869+0000","last_unstale":"2024-04-26T12:17:44.109545+0000","last_undegraded":"2024-04-26T12:17:44.109545+0000","last_fullsized":"2024-04-26T12:17:44.109545+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:32.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102225+0000","last_change":"2024-04-26T12:17:44.102225+0000","last_active":"2024-04-26T12:17:44.102225+0000","last_peered":"2024-04-26T12:17:44.102225+0000","last_clean":"2024-04-26T12:17:44.102225+0000","last_became_active":"2024-04-26T12:17:44.101899+0000","last_became_peered":"2024-04-26T12:17:44.101899+0000","last_unstale":"2024-04-26T12:17:44.102225+0000","last_undegraded":"2024-04-26T12:17:44.102225+0000","last_fullsized":"2024-04-26T12:17:44.102225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:06.908520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104669+0000","last_change":"2024-04-26T12:17:44.104669+0000","last_active":"2024-04-26T12:17:44.104669+0000","last_peered":"2024-04-26T12:17:44.104669+0000","last_clean":"2024-04-26T12:17:44.104669+0000","last_became_active":"2024-04-26T12:17:44.103914+0000","last_became_peered":"2024-04-26T12:17:44.103914+0000","last_unstale":"2024-04-26T12:17:44.104669+0000","last_undegraded":"2024-04-26T12:17:44.104669+0000","last_fullsized":"2024-04-26T12:17:44.104669+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:40.889006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.095726+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:17:43.095726+0000","last_peered":"2024-04-26T12:17:43.095726+0000","last_clean":"2024-04-26T12:17:43.095726+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:17:43.095726+0000","last_undegraded":"2024-04-26T12:17:43.095726+0000","last_fullsized":"2024-04-26T12:17:43.095726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108656+0000","last_change":"2024-04-26T12:17:44.108656+0000","last_active":"2024-04-26T12:17:44.108656+0000","last_peered":"2024-04-26T12:17:44.108656+0000","last_clean":"2024-04-26T12:17:44.108656+0000","last_became_active":"2024-04-26T12:17:44.107325+0000","last_became_peered":"2024-04-26T12:17:44.107325+0000","last_unstale":"2024-04-26T12:17:44.108656+0000","last_undegraded":"2024-04-26T12:17:44.108656+0000","last_fullsized":"2024-04-26T12:17:44.108656+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:04.558983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105975+0000","last_change":"2024-04-26T12:17:44.105975+0000","last_active":"2024-04-26T12:17:44.105975+0000","last_peered":"2024-04-26T12:17:44.105975+0000","last_clean":"2024-04-26T12:17:44.105975+0000","last_became_active":"2024-04-26T12:17:44.104611+0000","last_became_peered":"2024-04-26T12:17:44.104611+0000","last_unstale":"2024-04-26T12:17:44.105975+0000","last_undegraded":"2024-04-26T12:17:44.105975+0000","last_fullsized":"2024-04-26T12:17:44.105975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:45.206187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102157+0000","last_change":"2024-04-26T12:17:44.102157+0000","last_active":"2024-04-26T12:17:44.102157+0000","last_peered":"2024-04-26T12:17:44.102157+0000","last_clean":"2024-04-26T12:17:44.102157+0000","last_became_active":"2024-04-26T12:17:44.100968+0000","last_became_peered":"2024-04-26T12:17:44.100968+0000","last_unstale":"2024-04-26T12:17:44.102157+0000","last_undegraded":"2024-04-26T12:17:44.102157+0000","last_fullsized":"2024-04-26T12:17:44.102157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:09.700092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108547+0000","last_change":"2024-04-26T12:17:44.108547+0000","last_active":"2024-04-26T12:17:44.108547+0000","last_peered":"2024-04-26T12:17:44.108547+0000","last_clean":"2024-04-26T12:17:44.108547+0000","last_became_active":"2024-04-26T12:17:44.108258+0000","last_became_peered":"2024-04-26T12:17:44.108258+0000","last_unstale":"2024-04-26T12:17:44.108547+0000","last_undegraded":"2024-04-26T12:17:44.108547+0000","last_fullsized":"2024-04-26T12:17:44.108547+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:50.664236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108696+0000","last_change":"2024-04-26T12:17:44.108696+0000","last_active":"2024-04-26T12:17:44.108696+0000","last_peered":"2024-04-26T12:17:44.108696+0000","last_clean":"2024-04-26T12:17:44.108696+0000","last_became_active":"2024-04-26T12:17:44.108328+0000","last_became_peered":"2024-04-26T12:17:44.108328+0000","last_unstale":"2024-04-26T12:17:44.108696+0000","last_undegraded":"2024-04-26T12:17:44.108696+0000","last_fullsized":"2024-04-26T12:17:44.108696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:20.947866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104405+0000","last_change":"2024-04-26T12:17:44.104405+0000","last_active":"2024-04-26T12:17:44.104405+0000","last_peered":"2024-04-26T12:17:44.104405+0000","last_clean":"2024-04-26T12:17:44.104405+0000","last_became_active":"2024-04-26T12:17:44.103729+0000","last_became_peered":"2024-04-26T12:17:44.103729+0000","last_unstale":"2024-04-26T12:17:44.104405+0000","last_undegraded":"2024-04-26T12:17:44.104405+0000","last_fullsized":"2024-04-26T12:17:44.104405+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.551268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100942+0000","last_change":"2024-04-26T12:17:44.100942+0000","last_active":"2024-04-26T12:17:44.100942+0000","last_peered":"2024-04-26T12:17:44.100942+0000","last_clean":"2024-04-26T12:17:44.100942+0000","last_became_active":"2024-04-26T12:17:44.100427+0000","last_became_peered":"2024-04-26T12:17:44.100427+0000","last_unstale":"2024-04-26T12:17:44.100942+0000","last_undegraded":"2024-04-26T12:17:44.100942+0000","last_fullsized":"2024-04-26T12:17:44.100942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:23.119594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108737+0000","last_change":"2024-04-26T12:17:44.108737+0000","last_active":"2024-04-26T12:17:44.108737+0000","last_peered":"2024-04-26T12:17:44.108737+0000","last_clean":"2024-04-26T12:17:44.108737+0000","last_became_active":"2024-04-26T12:17:44.106410+0000","last_became_peered":"2024-04-26T12:17:44.106410+0000","last_unstale":"2024-04-26T12:17:44.108737+0000","last_undegraded":"2024-04-26T12:17:44.108737+0000","last_fullsized":"2024-04-26T12:17:44.108737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:37.724269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102058+0000","last_change":"2024-04-26T12:17:44.102058+0000","last_active":"2024-04-26T12:17:44.102058+0000","last_peered":"2024-04-26T12:17:44.102058+0000","last_clean":"2024-04-26T12:17:44.102058+0000","last_became_active":"2024-04-26T12:17:44.101674+0000","last_became_peered":"2024-04-26T12:17:44.101674+0000","last_unstale":"2024-04-26T12:17:44.102058+0000","last_undegraded":"2024-04-26T12:17:44.102058+0000","last_fullsized":"2024-04-26T12:17:44.102058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:39.893129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107762+0000","last_change":"2024-04-26T12:17:44.107762+0000","last_active":"2024-04-26T12:17:44.107762+0000","last_peered":"2024-04-26T12:17:44.107762+0000","last_clean":"2024-04-26T12:17:44.107762+0000","last_became_active":"2024-04-26T12:17:44.107330+0000","last_became_peered":"2024-04-26T12:17:44.107330+0000","last_unstale":"2024-04-26T12:17:44.107762+0000","last_undegraded":"2024-04-26T12:17:44.107762+0000","last_fullsized":"2024-04-26T12:17:44.107762+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:30.363451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.096400+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:17:43.096400+0000","last_peered":"2024-04-26T12:17:43.096400+0000","last_clean":"2024-04-26T12:17:43.096400+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:17:43.096400+0000","last_undegraded":"2024-04-26T12:17:43.096400+0000","last_fullsized":"2024-04-26T12:17:43.096400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.103485+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:17:43.103485+0000","last_peered":"2024-04-26T12:17:43.103485+0000","last_clean":"2024-04-26T12:17:43.103485+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:17:43.103485+0000","last_undegraded":"2024-04-26T12:17:43.103485+0000","last_fullsized":"2024-04-26T12:17:43.103485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107483+0000","last_change":"2024-04-26T12:17:44.107483+0000","last_active":"2024-04-26T12:17:44.107483+0000","last_peered":"2024-04-26T12:17:44.107483+0000","last_clean":"2024-04-26T12:17:44.107483+0000","last_became_active":"2024-04-26T12:17:44.105857+0000","last_became_peered":"2024-04-26T12:17:44.105857+0000","last_unstale":"2024-04-26T12:17:44.107483+0000","last_undegraded":"2024-04-26T12:17:44.107483+0000","last_fullsized":"2024-04-26T12:17:44.107483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:48.246780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101071+0000","last_change":"2024-04-26T12:17:44.101071+0000","last_active":"2024-04-26T12:17:44.101071+0000","last_peered":"2024-04-26T12:17:44.101071+0000","last_clean":"2024-04-26T12:17:44.101071+0000","last_became_active":"2024-04-26T12:17:44.100349+0000","last_became_peered":"2024-04-26T12:17:44.100349+0000","last_unstale":"2024-04-26T12:17:44.101071+0000","last_undegraded":"2024-04-26T12:17:44.101071+0000","last_fullsized":"2024-04-26T12:17:44.101071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:43.460557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107935+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:17:43.107935+0000","last_peered":"2024-04-26T12:17:43.107935+0000","last_clean":"2024-04-26T12:17:43.107935+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:17:43.107935+0000","last_undegraded":"2024-04-26T12:17:43.107935+0000","last_fullsized":"2024-04-26T12:17:43.107935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109629+0000","last_change":"2024-04-26T12:17:44.109629+0000","last_active":"2024-04-26T12:17:44.109629+0000","last_peered":"2024-04-26T12:17:44.109629+0000","last_clean":"2024-04-26T12:17:44.109629+0000","last_became_active":"2024-04-26T12:17:44.107996+0000","last_became_peered":"2024-04-26T12:17:44.107996+0000","last_unstale":"2024-04-26T12:17:44.109629+0000","last_undegraded":"2024-04-26T12:17:44.109629+0000","last_fullsized":"2024-04-26T12:17:44.109629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:55.766146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108035+0000","last_change":"2024-04-26T12:17:44.108035+0000","last_active":"2024-04-26T12:17:44.108035+0000","last_peered":"2024-04-26T12:17:44.108035+0000","last_clean":"2024-04-26T12:17:44.108035+0000","last_became_active":"2024-04-26T12:17:44.106828+0000","last_became_peered":"2024-04-26T12:17:44.106828+0000","last_unstale":"2024-04-26T12:17:44.108035+0000","last_undegraded":"2024-04-26T12:17:44.108035+0000","last_fullsized":"2024-04-26T12:17:44.108035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:46.266331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107036+0000","last_change":"2024-04-26T12:17:44.107036+0000","last_active":"2024-04-26T12:17:44.107036+0000","last_peered":"2024-04-26T12:17:44.107036+0000","last_clean":"2024-04-26T12:17:44.107036+0000","last_became_active":"2024-04-26T12:17:44.106107+0000","last_became_peered":"2024-04-26T12:17:44.106107+0000","last_unstale":"2024-04-26T12:17:44.107036+0000","last_undegraded":"2024-04-26T12:17:44.107036+0000","last_fullsized":"2024-04-26T12:17:44.107036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:48.670109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097487+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:17:43.097487+0000","last_peered":"2024-04-26T12:17:43.097487+0000","last_clean":"2024-04-26T12:17:43.097487+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:17:43.097487+0000","last_undegraded":"2024-04-26T12:17:43.097487+0000","last_fullsized":"2024-04-26T12:17:43.097487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107569+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:17:43.107569+0000","last_peered":"2024-04-26T12:17:43.107569+0000","last_clean":"2024-04-26T12:17:43.107569+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:17:43.107569+0000","last_undegraded":"2024-04-26T12:17:43.107569+0000","last_fullsized":"2024-04-26T12:17:43.107569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104533+0000","last_change":"2024-04-26T12:17:44.104533+0000","last_active":"2024-04-26T12:17:44.104533+0000","last_peered":"2024-04-26T12:17:44.104533+0000","last_clean":"2024-04-26T12:17:44.104533+0000","last_became_active":"2024-04-26T12:17:44.104125+0000","last_became_peered":"2024-04-26T12:17:44.104125+0000","last_unstale":"2024-04-26T12:17:44.104533+0000","last_undegraded":"2024-04-26T12:17:44.104533+0000","last_fullsized":"2024-04-26T12:17:44.104533+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:37.852785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.103983+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:17:43.103983+0000","last_peered":"2024-04-26T12:17:43.103983+0000","last_clean":"2024-04-26T12:17:43.103983+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:17:43.103983+0000","last_undegraded":"2024-04-26T12:17:43.103983+0000","last_fullsized":"2024-04-26T12:17:43.103983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101053+0000","last_change":"2024-04-26T12:17:44.101053+0000","last_active":"2024-04-26T12:17:44.101053+0000","last_peered":"2024-04-26T12:17:44.101053+0000","last_clean":"2024-04-26T12:17:44.101053+0000","last_became_active":"2024-04-26T12:17:44.099948+0000","last_became_peered":"2024-04-26T12:17:44.099948+0000","last_unstale":"2024-04-26T12:17:44.101053+0000","last_undegraded":"2024-04-26T12:17:44.101053+0000","last_fullsized":"2024-04-26T12:17:44.101053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:19.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102672+0000","last_change":"2024-04-26T12:17:44.102672+0000","last_active":"2024-04-26T12:17:44.102672+0000","last_peered":"2024-04-26T12:17:44.102672+0000","last_clean":"2024-04-26T12:17:44.102672+0000","last_became_active":"2024-04-26T12:17:44.101703+0000","last_became_peered":"2024-04-26T12:17:44.101703+0000","last_unstale":"2024-04-26T12:17:44.102672+0000","last_undegraded":"2024-04-26T12:17:44.102672+0000","last_fullsized":"2024-04-26T12:17:44.102672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:12.916220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106158+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:17:43.106158+0000","last_peered":"2024-04-26T12:17:43.106158+0000","last_clean":"2024-04-26T12:17:43.106158+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:17:43.106158+0000","last_undegraded":"2024-04-26T12:17:43.106158+0000","last_fullsized":"2024-04-26T12:17:43.106158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.100820+0000","last_change":"2024-04-26T12:17:44.100820+0000","last_active":"2024-04-26T12:17:44.100820+0000","last_peered":"2024-04-26T12:17:44.100820+0000","last_clean":"2024-04-26T12:17:44.100820+0000","last_became_active":"2024-04-26T12:17:44.100153+0000","last_became_peered":"2024-04-26T12:17:44.100153+0000","last_unstale":"2024-04-26T12:17:44.100820+0000","last_undegraded":"2024-04-26T12:17:44.100820+0000","last_fullsized":"2024-04-26T12:17:44.100820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.540128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106878+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:17:43.106878+0000","last_peered":"2024-04-26T12:17:43.106878+0000","last_clean":"2024-04-26T12:17:43.106878+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:17:43.106878+0000","last_undegraded":"2024-04-26T12:17:43.106878+0000","last_fullsized":"2024-04-26T12:17:43.106878+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104433+0000","last_change":"2024-04-26T12:17:44.104433+0000","last_active":"2024-04-26T12:17:44.104433+0000","last_peered":"2024-04-26T12:17:44.104433+0000","last_clean":"2024-04-26T12:17:44.104433+0000","last_became_active":"2024-04-26T12:17:44.104097+0000","last_became_peered":"2024-04-26T12:17:44.104097+0000","last_unstale":"2024-04-26T12:17:44.104433+0000","last_undegraded":"2024-04-26T12:17:44.104433+0000","last_fullsized":"2024-04-26T12:17:44.104433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:37.296331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106775+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:17:43.106775+0000","last_peered":"2024-04-26T12:17:43.106775+0000","last_clean":"2024-04-26T12:17:43.106775+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:17:43.106775+0000","last_undegraded":"2024-04-26T12:17:43.106775+0000","last_fullsized":"2024-04-26T12:17:43.106775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.102195+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:17:43.102195+0000","last_peered":"2024-04-26T12:17:43.102195+0000","last_clean":"2024-04-26T12:17:43.102195+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:17:43.102195+0000","last_undegraded":"2024-04-26T12:17:43.102195+0000","last_fullsized":"2024-04-26T12:17:43.102195+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109700+0000","last_change":"2024-04-26T12:17:44.109700+0000","last_active":"2024-04-26T12:17:44.109700+0000","last_peered":"2024-04-26T12:17:44.109700+0000","last_clean":"2024-04-26T12:17:44.109700+0000","last_became_active":"2024-04-26T12:17:44.109338+0000","last_became_peered":"2024-04-26T12:17:44.109338+0000","last_unstale":"2024-04-26T12:17:44.109700+0000","last_undegraded":"2024-04-26T12:17:44.109700+0000","last_fullsized":"2024-04-26T12:17:44.109700+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:02.948179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":66,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106127+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:17:43.106127+0000","last_peered":"2024-04-26T12:17:43.106127+0000","last_clean":"2024-04-26T12:17:43.106127+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:17:43.106127+0000","last_undegraded":"2024-04-26T12:17:43.106127+0000","last_fullsized":"2024-04-26T12:17:43.106127+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106990+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:17:43.106990+0000","last_peered":"2024-04-26T12:17:43.106990+0000","last_clean":"2024-04-26T12:17:43.106990+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:17:43.106990+0000","last_undegraded":"2024-04-26T12:17:43.106990+0000","last_fullsized":"2024-04-26T12:17:43.106990+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106532+0000","last_change":"2024-04-26T12:17:44.106532+0000","last_active":"2024-04-26T12:17:44.106532+0000","last_peered":"2024-04-26T12:17:44.106532+0000","last_clean":"2024-04-26T12:17:44.106532+0000","last_became_active":"2024-04-26T12:17:44.106036+0000","last_became_peered":"2024-04-26T12:17:44.106036+0000","last_unstale":"2024-04-26T12:17:44.106532+0000","last_undegraded":"2024-04-26T12:17:44.106532+0000","last_fullsized":"2024-04-26T12:17:44.106532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:42.404493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102936+0000","last_change":"2024-04-26T12:17:44.102936+0000","last_active":"2024-04-26T12:17:44.102936+0000","last_peered":"2024-04-26T12:17:44.102936+0000","last_clean":"2024-04-26T12:17:44.102936+0000","last_became_active":"2024-04-26T12:17:44.102634+0000","last_became_peered":"2024-04-26T12:17:44.102634+0000","last_unstale":"2024-04-26T12:17:44.102936+0000","last_undegraded":"2024-04-26T12:17:44.102936+0000","last_fullsized":"2024-04-26T12:17:44.102936+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:39.641964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102223+0000","last_change":"2024-04-26T12:17:44.102223+0000","last_active":"2024-04-26T12:17:44.102223+0000","last_peered":"2024-04-26T12:17:44.102223+0000","last_clean":"2024-04-26T12:17:44.102223+0000","last_became_active":"2024-04-26T12:17:44.101566+0000","last_became_peered":"2024-04-26T12:17:44.101566+0000","last_unstale":"2024-04-26T12:17:44.102223+0000","last_undegraded":"2024-04-26T12:17:44.102223+0000","last_fullsized":"2024-04-26T12:17:44.102223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:59.569612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101906+0000","last_change":"2024-04-26T12:17:44.101906+0000","last_active":"2024-04-26T12:17:44.101906+0000","last_peered":"2024-04-26T12:17:44.101906+0000","last_clean":"2024-04-26T12:17:44.101906+0000","last_became_active":"2024-04-26T12:17:44.101636+0000","last_became_peered":"2024-04-26T12:17:44.101636+0000","last_unstale":"2024-04-26T12:17:44.101906+0000","last_undegraded":"2024-04-26T12:17:44.101906+0000","last_fullsized":"2024-04-26T12:17:44.101906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:44.196751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.108018+0000","last_change":"2024-04-26T12:17:44.108018+0000","last_active":"2024-04-26T12:17:44.108018+0000","last_peered":"2024-04-26T12:17:44.108018+0000","last_clean":"2024-04-26T12:17:44.108018+0000","last_became_active":"2024-04-26T12:17:44.106774+0000","last_became_peered":"2024-04-26T12:17:44.106774+0000","last_unstale":"2024-04-26T12:17:44.108018+0000","last_undegraded":"2024-04-26T12:17:44.108018+0000","last_fullsized":"2024-04-26T12:17:44.108018+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:50.785680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":27,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102550+0000","last_change":"2024-04-26T12:17:44.102550+0000","last_active":"2024-04-26T12:17:44.102550+0000","last_peered":"2024-04-26T12:17:44.102550+0000","last_clean":"2024-04-26T12:17:44.102550+0000","last_became_active":"2024-04-26T12:17:44.102114+0000","last_became_peered":"2024-04-26T12:17:44.102114+0000","last_unstale":"2024-04-26T12:17:44.102550+0000","last_undegraded":"2024-04-26T12:17:44.102550+0000","last_fullsized":"2024-04-26T12:17:44.102550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:23.647496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107083+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:17:43.107083+0000","last_peered":"2024-04-26T12:17:43.107083+0000","last_clean":"2024-04-26T12:17:43.107083+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:17:43.107083+0000","last_undegraded":"2024-04-26T12:17:43.107083+0000","last_fullsized":"2024-04-26T12:17:43.107083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105911+0000","last_change":"2024-04-26T12:17:44.105911+0000","last_active":"2024-04-26T12:17:44.105911+0000","last_peered":"2024-04-26T12:17:44.105911+0000","last_clean":"2024-04-26T12:17:44.105911+0000","last_became_active":"2024-04-26T12:17:44.105642+0000","last_became_peered":"2024-04-26T12:17:44.105642+0000","last_unstale":"2024-04-26T12:17:44.105911+0000","last_undegraded":"2024-04-26T12:17:44.105911+0000","last_fullsized":"2024-04-26T12:17:44.105911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:56.685927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101208+0000","last_change":"2024-04-26T12:17:44.101208+0000","last_active":"2024-04-26T12:17:44.101208+0000","last_peered":"2024-04-26T12:17:44.101208+0000","last_clean":"2024-04-26T12:17:44.101208+0000","last_became_active":"2024-04-26T12:17:44.100576+0000","last_became_peered":"2024-04-26T12:17:44.100576+0000","last_unstale":"2024-04-26T12:17:44.101208+0000","last_undegraded":"2024-04-26T12:17:44.101208+0000","last_fullsized":"2024-04-26T12:17:44.101208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:40.393748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107883+0000","last_change":"2024-04-26T12:17:44.107883+0000","last_active":"2024-04-26T12:17:44.107883+0000","last_peered":"2024-04-26T12:17:44.107883+0000","last_clean":"2024-04-26T12:17:44.107883+0000","last_became_active":"2024-04-26T12:17:44.107368+0000","last_became_peered":"2024-04-26T12:17:44.107368+0000","last_unstale":"2024-04-26T12:17:44.107883+0000","last_undegraded":"2024-04-26T12:17:44.107883+0000","last_fullsized":"2024-04-26T12:17:44.107883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.453513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.102987+0000","last_change":"2024-04-26T12:17:44.102987+0000","last_active":"2024-04-26T12:17:44.102987+0000","last_peered":"2024-04-26T12:17:44.102987+0000","last_clean":"2024-04-26T12:17:44.102987+0000","last_became_active":"2024-04-26T12:17:44.102714+0000","last_became_peered":"2024-04-26T12:17:44.102714+0000","last_unstale":"2024-04-26T12:17:44.102987+0000","last_undegraded":"2024-04-26T12:17:44.102987+0000","last_fullsized":"2024-04-26T12:17:44.102987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:33.785559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106991+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:17:43.106991+0000","last_peered":"2024-04-26T12:17:43.106991+0000","last_clean":"2024-04-26T12:17:43.106991+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:17:43.106991+0000","last_undegraded":"2024-04-26T12:17:43.106991+0000","last_fullsized":"2024-04-26T12:17:43.106991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.104923+0000","last_change":"2024-04-26T12:17:44.104923+0000","last_active":"2024-04-26T12:17:44.104923+0000","last_peered":"2024-04-26T12:17:44.104923+0000","last_clean":"2024-04-26T12:17:44.104923+0000","last_became_active":"2024-04-26T12:17:44.104005+0000","last_became_peered":"2024-04-26T12:17:44.104005+0000","last_unstale":"2024-04-26T12:17:44.104923+0000","last_undegraded":"2024-04-26T12:17:44.104923+0000","last_fullsized":"2024-04-26T12:17:44.104923+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:45.472750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.107149+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:17:43.107149+0000","last_peered":"2024-04-26T12:17:43.107149+0000","last_clean":"2024-04-26T12:17:43.107149+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:17:43.107149+0000","last_undegraded":"2024-04-26T12:17:43.107149+0000","last_fullsized":"2024-04-26T12:17:43.107149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106643+0000","last_change":"2024-04-26T12:17:44.106643+0000","last_active":"2024-04-26T12:17:44.106643+0000","last_peered":"2024-04-26T12:17:44.106643+0000","last_clean":"2024-04-26T12:17:44.106643+0000","last_became_active":"2024-04-26T12:17:44.105890+0000","last_became_peered":"2024-04-26T12:17:44.105890+0000","last_unstale":"2024-04-26T12:17:44.106643+0000","last_undegraded":"2024-04-26T12:17:44.106643+0000","last_fullsized":"2024-04-26T12:17:44.106643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:19.310096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.107272+0000","last_change":"2024-04-26T12:17:44.107272+0000","last_active":"2024-04-26T12:17:44.107272+0000","last_peered":"2024-04-26T12:17:44.107272+0000","last_clean":"2024-04-26T12:17:44.107272+0000","last_became_active":"2024-04-26T12:17:44.106147+0000","last_became_peered":"2024-04-26T12:17:44.106147+0000","last_unstale":"2024-04-26T12:17:44.107272+0000","last_undegraded":"2024-04-26T12:17:44.107272+0000","last_fullsized":"2024-04-26T12:17:44.107272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:23.013459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105648+0000","last_change":"2024-04-26T12:17:44.105648+0000","last_active":"2024-04-26T12:17:44.105648+0000","last_peered":"2024-04-26T12:17:44.105648+0000","last_clean":"2024-04-26T12:17:44.105648+0000","last_became_active":"2024-04-26T12:17:44.105216+0000","last_became_peered":"2024-04-26T12:17:44.105216+0000","last_unstale":"2024-04-26T12:17:44.105648+0000","last_undegraded":"2024-04-26T12:17:44.105648+0000","last_fullsized":"2024-04-26T12:17:44.105648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:18.126904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.098581+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:17:43.098581+0000","last_peered":"2024-04-26T12:17:43.098581+0000","last_clean":"2024-04-26T12:17:43.098581+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:17:43.098581+0000","last_undegraded":"2024-04-26T12:17:43.098581+0000","last_fullsized":"2024-04-26T12:17:43.098581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.097429+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:17:43.097429+0000","last_peered":"2024-04-26T12:17:43.097429+0000","last_clean":"2024-04-26T12:17:43.097429+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:17:43.097429+0000","last_undegraded":"2024-04-26T12:17:43.097429+0000","last_fullsized":"2024-04-26T12:17:43.097429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.109792+0000","last_change":"2024-04-26T12:17:44.109792+0000","last_active":"2024-04-26T12:17:44.109792+0000","last_peered":"2024-04-26T12:17:44.109792+0000","last_clean":"2024-04-26T12:17:44.109792+0000","last_became_active":"2024-04-26T12:17:44.109360+0000","last_became_peered":"2024-04-26T12:17:44.109360+0000","last_unstale":"2024-04-26T12:17:44.109792+0000","last_undegraded":"2024-04-26T12:17:44.109792+0000","last_fullsized":"2024-04-26T12:17:44.109792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:13.622968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105878+0000","last_change":"2024-04-26T12:17:44.105878+0000","last_active":"2024-04-26T12:17:44.105878+0000","last_peered":"2024-04-26T12:17:44.105878+0000","last_clean":"2024-04-26T12:17:44.105878+0000","last_became_active":"2024-04-26T12:17:44.104220+0000","last_became_peered":"2024-04-26T12:17:44.104220+0000","last_unstale":"2024-04-26T12:17:44.105878+0000","last_undegraded":"2024-04-26T12:17:44.105878+0000","last_fullsized":"2024-04-26T12:17:44.105878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:37.800239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.101637+0000","last_change":"2024-04-26T12:17:44.101637+0000","last_active":"2024-04-26T12:17:44.101637+0000","last_peered":"2024-04-26T12:17:44.101637+0000","last_clean":"2024-04-26T12:17:44.101637+0000","last_became_active":"2024-04-26T12:17:44.100911+0000","last_became_peered":"2024-04-26T12:17:44.100911+0000","last_unstale":"2024-04-26T12:17:44.101637+0000","last_undegraded":"2024-04-26T12:17:44.101637+0000","last_fullsized":"2024-04-26T12:17:44.101637+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:08.022971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.103731+0000","last_change":"2024-04-26T12:17:44.103731+0000","last_active":"2024-04-26T12:17:44.103731+0000","last_peered":"2024-04-26T12:17:44.103731+0000","last_clean":"2024-04-26T12:17:44.103731+0000","last_became_active":"2024-04-26T12:17:44.103151+0000","last_became_peered":"2024-04-26T12:17:44.103151+0000","last_unstale":"2024-04-26T12:17:44.103731+0000","last_undegraded":"2024-04-26T12:17:44.103731+0000","last_fullsized":"2024-04-26T12:17:44.103731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:31.552466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105804+0000","last_change":"2024-04-26T12:17:44.105804+0000","last_active":"2024-04-26T12:17:44.105804+0000","last_peered":"2024-04-26T12:17:44.105804+0000","last_clean":"2024-04-26T12:17:44.105804+0000","last_became_active":"2024-04-26T12:17:44.105280+0000","last_became_peered":"2024-04-26T12:17:44.105280+0000","last_unstale":"2024-04-26T12:17:44.105804+0000","last_undegraded":"2024-04-26T12:17:44.105804+0000","last_fullsized":"2024-04-26T12:17:44.105804+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:13.941345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.099163+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:17:43.099163+0000","last_peered":"2024-04-26T12:17:43.099163+0000","last_clean":"2024-04-26T12:17:43.099163+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:17:43.099163+0000","last_undegraded":"2024-04-26T12:17:43.099163+0000","last_fullsized":"2024-04-26T12:17:43.099163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T12:17:43.106622+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:17:43.106622+0000","last_peered":"2024-04-26T12:17:43.106622+0000","last_clean":"2024-04-26T12:17:43.106622+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:17:43.106622+0000","last_undegraded":"2024-04-26T12:17:43.106622+0000","last_fullsized":"2024-04-26T12:17:43.106622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.105189+0000","last_change":"2024-04-26T12:17:44.105189+0000","last_active":"2024-04-26T12:17:44.105189+0000","last_peered":"2024-04-26T12:17:44.105189+0000","last_clean":"2024-04-26T12:17:44.105189+0000","last_became_active":"2024-04-26T12:17:44.104460+0000","last_became_peered":"2024-04-26T12:17:44.104460+0000","last_unstale":"2024-04-26T12:17:44.105189+0000","last_undegraded":"2024-04-26T12:17:44.105189+0000","last_fullsized":"2024-04-26T12:17:44.105189+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:24.535787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T12:17:44.106901+0000","last_change":"2024-04-26T12:17:44.106901+0000","last_active":"2024-04-26T12:17:44.106901+0000","last_peered":"2024-04-26T12:17:44.106901+0000","last_clean":"2024-04-26T12:17:44.106901+0000","last_became_active":"2024-04-26T12:17:44.106432+0000","last_became_peered":"2024-04-26T12:17:44.106432+0000","last_unstale":"2024-04-26T12:17:44.106901+0000","last_undegraded":"2024-04-26T12:17:44.106901+0000","last_fullsized":"2024-04-26T12:17:44.106901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:59.890908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321224,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050616,"statfs":{"total":96636764160,"available":96307830784,"internally_reserved":0,"allocated":1368064,"data_stored":879942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:17:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.35699999999999998,"15min":0.375},"min":{"1min":0.19,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.41599999999999998},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.88400000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":1,"up_from":66,"seq":283467841538,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29516,"kb_used_data":1344,"kb_used_omap":6,"kb_used_meta":28153,"kb_avail":94342324,"statfs":{"total":96636764160,"available":96606539776,"internally_reserved":0,"allocated":1376256,"data_stored":880558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7076,"internal_metadata":28828764},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483060,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888780,"statfs":{"total":96636764160,"available":96142110720,"internally_reserved":0,"allocated":753664,"data_stored":286331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.161,"15min":0.161},"max":{"1min":0.64000000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.185,"15min":0.185},"max":{"1min":0.65000000000000002,"5min":0.879,"15min":0.879},"last":0.47299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:17:50.776 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:17:50.776 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:17:50.776 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 2, 1] 2024-04-26T12:17:50.776 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:17:50.776 INFO:teuthology.orchestra.console.smithi113:Power off 2024-04-26T12:17:50.777 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T12:17:50.801 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-04-26T12:17:50.802 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:17:50.827 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-26T12:17:54.828 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:17:54.939 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-26T12:17:58.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T12:17:58.940 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:17:59.051 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-26T12:18:03.053 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:18:03.163 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-26T12:18:03.264 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-04-26T12:18:04.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-26T12:18:08.366 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-26T12:18:08.366 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-26T12:18:08.366 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:18:08.367 INFO:teuthology.orchestra.console.smithi113:Power on 2024-04-26T12:18:08.367 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T12:18:08.390 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2024-04-26T12:18:08.391 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:18:08.416 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-26T12:18:10.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-26T12:18:12.418 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:18:12.529 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-26T12:18:16.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~17s 2024-04-26T12:18:16.530 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:18:16.745 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-26T12:18:16.846 INFO:teuthology.orchestra.console.smithi113:Power on completed 2024-04-26T12:18:16.948 DEBUG:teuthology.orchestra.console.smithi113:Waiting for login prompt 2024-04-26T12:18:16.948 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi113 2024-04-26T12:18:22.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-04-26T12:18:27.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-26T12:18:33.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-26T12:18:39.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-26T12:18:45.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~46s 2024-04-26T12:18:51.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~52s 2024-04-26T12:18:56.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~58s 2024-04-26T12:19:02.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2024-04-26T12:19:08.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-26T12:19:14.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-26T12:19:20.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~81s 2024-04-26T12:19:25.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~87s 2024-04-26T12:19:31.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~93s 2024-04-26T12:19:37.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~99s 2024-04-26T12:19:43.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-26T12:19:49.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2024-04-26T12:19:55.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~116s 2024-04-26T12:20:00.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~122s 2024-04-26T12:20:06.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~128s 2024-04-26T12:20:12.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-04-26T12:20:16.644 DEBUG:teuthology.orchestra.console.smithi113:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                      test failure, check cable PXE-M0F: Exiting Intel Boot Agent. PXE-E61: Media test failure, check cable Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.113 : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d7:c1)... Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   Configuring (net0 0c:c4:7a:8f:d7:c1).... Configuring (net0 0c:c4:7a:8f:d7:c1)..... PXE-E61: Media test failure, check cable  [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9               The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            Use the * and * keys to change the selection.  The selected entry will be started automatically in 4s.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.     The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eaffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f62000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.684 MHz processor [ 0.000408] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000411] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000413] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000748] last_pfn = 0x78eb0 max_arch_pfn = 0x400000000 [ 0.006544] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006553] Using GB pages for direct mapping [ 0.006664] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006667] ACPI: Early table checksum verification disabled [ 0.006670] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006673] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.006677] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006681] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006684] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.006686] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006689] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006691] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006693] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006696] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006698] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006700] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006703] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006705] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006707] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006710] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006712] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006715] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006717] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006719] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006722] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006724] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006726] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.006727] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.006728] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.006728] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.006729] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.006729] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.006730] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.006731] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.006731] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.006732] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.006732] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.006733] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.006734] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.006734] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.006735] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.006735] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.006736] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.006737] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.006737] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.006738] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.006783] No NUMA configuration found [ 0.006784] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006793] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006987] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007022] Zone ranges: [ 0.007022] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007024] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007025] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007026] Device empty [ 0.007027] Movable zone start for each node [ 0.007029] Early memory node ranges [ 0.007029] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007031] node 0: [mem 0x0000000000100000-0x0000000078eaffff] [ 0.007031] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007035] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007039] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007076] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011878] On node 0, zone Normal: 29008 pages in unavailable ranges [ 0.011989] ACPI: PM-Timer IO Port: 0x408 [ 0.011996] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011997] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011998] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012010] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012015] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012016] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012018] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012021] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012022] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012026] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012027] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012037] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012038] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012039] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012040] PM: hibernation: Registered nosave memory: [mem 0x78eb0000-0x78f61fff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x78f62000-0x798affff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012045] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012046] Booting paravirtualized kernel on bare hardware [ 0.012048] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016371] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016590] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016614] Fallback order for Node 0: 0 [ 0.016617] Built 1 zonelists, mobility grouping on. Total pages: 8228725 [ 0.016618] Policy zone: Normal [ 0.016619] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016673] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016689] random: crng init done [ 0.018867] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020005] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020250] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020258] software IO TLB: area num 8. [ 0.047639] Memory: 1750092K/33437928K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989184K reserved, 0K cma-reserved) [ 0.047740] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047748] Kernel/User page tables isolation: enabled [ 0.047772] ftrace: allocating 46993 entries in 184 pages [ 0.065985] ftrace: allocated 184 pages with 4 groups [ 0.066493] Dynamic Preempt: voluntary [ 0.066522] rcu: Preemptible hierarchical RCU implementation. [ 0.066523] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066524] Trampoline variant of Tasks RCU enabled. [ 0.066524] Rude variant of Tasks RCU enabled. [ 0.066524] Tracing variant of Tasks RCU enabled. [ 0.066525] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066525] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069744] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069905] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070010] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075248] Console: colour VGA+ 80x25 [ 1.096689] printk: console [ttyS1] enabled [ 1.100880] ACPI: Core revision 20230331 [ 1.104975] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.114103] APIC: Switch to symmetric I/O mode setup [ 1.119073] DMAR: Host address width 46 [ 1.122916] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128233] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136229] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142496] DMAR: ATSR flags: 0x0 [ 1.145816] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.152084] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158435] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.164789] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170189] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170190] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185212] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190516] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196741] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.207111] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272269c7d7, max_idle_ns: 440795300785 ns [ 1.217622] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.36 BogoMIPS (lpj=3499684) [ 1.218640] CPU0: Thermal monitoring enabled (TM1) [ 1.219674] process: using mwait in idle threads [ 1.220622] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221621] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222622] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223622] Spectre V2 : Mitigation: Retpolines [ 1.224621] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225621] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226621] Speculative Store Bypass: Vulnerable [ 1.227627] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228621] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229621] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230624] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231621] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232621] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233621] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234621] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.247022] Freeing SMP alternatives memory: 36K [ 1.247622] pid_max: default: 32768 minimum: 301 [ 1.248639] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249626] Yama: becoming mindful. [ 1.250625] SELinux: Initializing. [ 1.251637] LSM support for eBPF active [ 1.252678] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253659] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357436] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358714] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359621] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360632] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361631] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362630] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363622] ... version: 3 [ 1.364621] ... bit width: 48 [ 1.365621] ... generic registers: 4 [ 1.366621] ... value mask: 0000ffffffffffff [ 1.367621] ... max period: 00007fffffffffff [ 1.368621] ... fixed-purpose events: 3 [ 1.369621] ... event mask: 000000070000000f [ 1.370704] signal: max sigframe size: 1776 [ 1.371632] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372646] rcu: Hierarchical SRCU implementation. [ 1.372646] rcu: Max phase no-delay instances is 400. [ 1.372654] printk: console [ttyS1] printing thread started [ 1.377209] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377275] smp: Bringing up secondary CPUs ... [ 1.377342] smpboot: x86: Booting SMP configuration: [ 1.377343] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.383888] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.383888] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.383888] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.383888] smp: Brought up 1 node, 8 CPUs [ 1.383888] smpboot: Max logical packages: 1 [ 1.383888] smpboot: Total of 8 processors activated (55994.94 BogoMIPS) [ 1.427642] node 0 deferred pages initialised in 36ms [ 1.429644] devtmpfs: initialized [ 1.429667] x86/mm: Memory block size: 128MB [ 1.430640] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.430718] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.430722] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.430756] pinctrl core: initialized pinctrl subsystem [ 1.440170] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.440257] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.440268] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.440275] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.440283] audit: initializing netlink subsys (disabled) [ 1.440633] audit: type=2000 audit(1714133993.243:1): state=initialized audit_enabled=0 res=1 [ 1.440691] thermal_sys: Registered thermal governor 'fair_share' [ 1.440692] thermal_sys: Registered thermal governor 'step_wise' [ 1.440692] thermal_sys: Registered thermal governor 'user_space' [ 1.448623] cpuidle: using governor menu [ 1.458641] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.458642] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.458687] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.458690] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.458698] PCI: Using configuration type 1 for base access [ 1.476649] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.476653] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.476653] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.476653] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.476653] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.483925] cryptd: max_cpu_qlen set to 1000 [ 1.500152] ACPI: Added _OSI(Module Device) [ 1.500153] ACPI: Added _OSI(Processor Device) [ 1.500153] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.500154] ACPI: Added _OSI(Processor Aggregator Device) [ 1.500155] ACPI: Added _OSI(Linux-Dell-Video) [ 1.500155] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.500156] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.523823] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.525991] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.527715] ACPI: Dynamic OEM Table Load: [ 1.545912] ACPI: _OSC evaluated successfully for all CPUs [ 1.546280] ACPI: Interpreter enabled [ 1.546291] ACPI: PM: (supports S0 S4 S5) [ 1.546292] ACPI: Using IOAPIC for interrupt routing [ 1.548464] HEST: Enabling Firmware First mode for corrected errors. [ 1.586784] HEST: Table parsing has been initialized. [ 1.586900] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.586902] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.586903] PCI: Using E820 reservations for host bridge windows [ 1.587344] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.608462] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.608466] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.609580] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.610109] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.610110] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.610136] PCI host bridge to bus 0000:ff [ 1.610138] pci_bus 0000:ff: root bus resource [bus ff] [ 1.610148] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.610190] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.610220] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.610249] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.610278] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.610307] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.610335] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.610363] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.610392] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.610419] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.610447] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.610475] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.610502] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.610530] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.610558] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.610587] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.610614] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.610644] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.610671] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.610691] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.610726] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610784] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610836] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610877] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610918] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610957] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610996] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.611026] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.611057] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611098] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611138] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611177] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611216] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.611246] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.611277] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.611309] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.611341] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611381] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611423] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611466] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611508] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.611542] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.611571] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.611602] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.611636] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.611666] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.611697] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.611726] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.611759] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.611787] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.611817] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.611847] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.611868] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.611899] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.611928] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.614130] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.614133] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.614265] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.614502] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.614503] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.614914] PCI host bridge to bus 0000:00 [ 1.614916] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.614917] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.614918] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.614919] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.614920] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.614921] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.614922] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.614941] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.615041] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.615053] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.615088] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.615176] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.615188] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.615191] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.615223] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.615309] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.615320] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.615322] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.615324] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.615328] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.615357] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.615437] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615445] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.615518] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615526] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.615597] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615605] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.615679] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615686] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.615758] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615765] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.615839] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615846] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.615919] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615927] pci 00-0xfb417fff 64bi7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616006] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.616076] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616138] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616219] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616274] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.616279] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.616358] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.616593] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.616613] pci 0000:00:11.4: BAR 0 1.616623] pci 00-0xf103] [ [io 0xf0f0-0xf0f7] [ 1.616645] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.616656] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.616667] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.616726] pci 0000:00:11.4: PME# supported from D3hot [ 1.616805] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.616829] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.616916] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.617002] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.617026] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.617112] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.617178] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.617202] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.617289] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.617370] pci 0000:00:1a.0: [8086:8ventional PCI endpoint [ 1.617392] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0 [ 1.617505] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.617582] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.617622] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.617714] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.617813] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.617850] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.617855] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.617858] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.617000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.618041] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.618080] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.618086] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.618089] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.618177] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.618277] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.618298] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.618412] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.618492] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.618697] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.618715] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.618726] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.618737] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.618747] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.618757] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.618769] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.618821] pci 0000:00:1f.2: PME# supported from D3hot [ 1.618881] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.618904] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.618933] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.619093] acpiphp: Slot [1] registered [ 1.619104] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.619210] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.619219] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.619235] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.619239] pci 0000:02:00.0: enabling Extended Tags [ 1.619339] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.619446] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.619457] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.619461] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.619471] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.619476] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.619511] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.619528] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619529] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.619537] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619538] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.619691] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.619701] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.619705] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.619715] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.619720] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.619755] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.619769] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619770] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.619778] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619779] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.619916] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.619960] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.620052] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.620124] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.620137] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.620142] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.620196] pci 0000:05:00.0: enabling Extended Tags [ 1.620316] pci 0000:05:00.0: supports D1 D2 [ 1.620317] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.620450] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.620537] pci_bus 0000:06: extended config space not accessible [ 1.620570] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.620607] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.620626] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.620645] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.620744] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.620814] pci 0000:06:00.0: supports D1 D2 [ 1.620815] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.620966] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.621108] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.621141] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.621178] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.621196] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.621421] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.621483] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.621484] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.621516] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.621517] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.621849] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.621882] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.621918] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.621937] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.622153] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.622211] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.622211] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.622244] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.622245] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.622539] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.622550] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.623226] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.623256] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.623286] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.623315] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.623345] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.623346] ACPI: PCI: Interrupt link LNKE disabled [ 1.623375] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.623375] ACPI: PCI: Interrupt link LNKF disabled [ 1.623406] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.623406] ACPI: PCI: Interrupt link LNKG disabled [ 1.623436] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.623436] ACPI: PCI: Interrupt link LNKH disabled [ 1.623634] iommu: Default domain type: Translated [ 1.623634] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.623704] SCSI subsystem initialized [ 1.623719] ACPI: bus type USB registered [ 1.623730] usbcore: registered new interface driver usbfs [ 1.623735] usbcore: registered new interface driver hub [ 1.623739] usbcore: registered new device driver usb [ 1.623758] pps_core: LinuxPPS API ver. 1 registered [ 1.623759] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.623760] PTP clock support registered [ 1.623774] EDAC MC: Ver: 3.0.0 [ 1.624781] NetLabel: Initializing [ 1.624782] NetLabel: domain hash size = 128 [ 1.624782] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.624796] NetLabel: unlabeled traffic allowed by default [ 1.624797] PCI: Using ACPI for IRQ routing [ 1.634790] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.634790] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.634790] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.634790] vgaarb: loaded [ 1.634790] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.634790] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.639208] clocksource: Switched to clocksource tsc-early [ 1.647399] VFS: Disk quotas dquot_6.6.0 [ 1.647407] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.647454] pnp: PnP ACPI init [ 1.647774] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.647777] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.647779] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.647780] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.647781] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.647781] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.647782] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.647784] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.647785] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.647786] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.647786] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.647787] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.647788] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.647929] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.647930] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.647931] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.647931] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.647932] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.648599] pnp: PnP ACPI: found 5 devices [ 1.654059] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.654100] NET: Registered PF_INET protocol family [ 1.654267] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.656535] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.656564] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.656574] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.656795] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.656904] TCP: Hash tables configured (established 262144 bind 65536) [ 1.657018] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.657102] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.657157] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.657238] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.657242] NET: Registered PF_XDP protocol family [ 1.657263] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.657273] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.657276] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.657281] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.657283] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.657289] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657291] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657292] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657293] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657294] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657295] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657296] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657297] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657298] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657299] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657300] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657301] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657302] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657303] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657304] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657305] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657306] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.657307] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.657309] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.657311] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.657314] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.657329] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.657331] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.657339] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.657355] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.657357] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.657362] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.657372] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.657378] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.657384] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.657390] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.657396] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.657398] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.657404] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.657407] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.657413] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.657414] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.657415] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.657415] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.657416] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.657417] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.657418] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.657419] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.657420] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.657421] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.657422] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.657423] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.657424] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.657424] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.657425] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.657426] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.657427] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.657427] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.657591] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.674681] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16516 usecs [ 1.691670] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 16575 usecs [ 1.691684] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.691718] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.691719] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.691725] Trying to unpack rootfs image as initramfs... [ 1.691733] ACPI: bus type thunderbolt registered [ 1.767029] Initialise system trusted keyrings [ 1.767037] Key type blacklist registered [ 1.767074] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.768396] zbud: loaded [ 1.842146] integrity: Platform Keyring initialized [ 1.842151] integrity: Machine keyring initialized [ 1.849915] NET: Registered PF_ALG protocol family [ 1.849917] xor: automatically using best checksumming function avx [ 1.849919] Key type asymmetric registered [ 1.849920] Asymmetric key parser 'x509' registered [ 1.849920] Running certificate verification selftests [ 1.851330] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.851803] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.851822] io scheduler mq-deadline registered [ 1.851822] io scheduler kyber registered [ 1.851849] io scheduler bfq registered [ 1.867037] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.867336] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.867496] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.867643] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.867772] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.867927] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.868074] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.868229] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.868302] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.892039] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.892058] ACPI: button: Power Button [PWRB] [ 1.892078] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.892131] ACPI: button: Power Button [PWRF] [ 1.900522] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.900524] pstore: Registered erst as persistent store backend [ 1.900613] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.900703] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.908350] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.916957] Non-volatile memory driver v1.3 [ 1.924980] rdac: device handler registered [ 1.925008] hp_sw: device handler registered [ 1.925009] emc: device handler registered [ 1.925028] alua: device handler registered [ 1.925318] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.925369] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.925383] ehci-pci 0000:00:1d.0: debug port 2 [ 1.929310] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.934655] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.934689] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.934691] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.934692] usb usb1: Product: EHCI Host Controller [ 1.934693] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.934693] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.934777] hub 1-0:1.0: USB hub found [ 1.934781] hub 1-0:1.0: 2 ports detected [ 1.934887] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.934921] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.936007] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.936195] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.936220] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.936253] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 1.936255] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 1.936256] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.936272] ehci-pci 0000:00:1a.0: debug port 2 [ 1.936302] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.936304] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.936306] usb usb2: Product: xHCI Host Controller [ 1.936307] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.936307] usb usb2: SerialNumber: 0000:00:14.0 [ 1.936412] hub 2-0:1.0: USB hub found [ 1.936444] hub 2-0:1.0: 15 ports detected [ 1.939789] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.939792] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.939793] usb usb4: Product: xHCI Host Controller [ 1.939794] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.939795] usb usb4: SerialNumber: 0000:00:14.0 [ 1.939873] hub 4-0:1.0: USB hub found [ 1.939891] hub 4-0:1.0: 6 ports detected [ 1.940199] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.941243] usbcore: registered new interface driver usbserial_generic [ 1.941247] usbserial: USB Serial support registered for generic [ 1.941272] i8042: PNP: No PS/2 controller found. [ 1.941320] mousedev: PS/2 mouse device common for all mice [ 1.941372] rtc_cmos 00:00: RTC can wake from S4 [ 1.941654] rtc_cmos 00:00: registered as rtc0 [ 1.941701] rtc_cmos 00:00: setting system clock to 2024-04-26T12:19:55 UTC (1714133995) [ 1.941723] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.946656] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.946682] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.946683] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.946684] usb usb3: Product: EHCI Host Controller [ 1.946685] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.946686] usb usb3: SerialNumber: 0000:00:1a.0 [ 1.946760] hub 3-0:1.0: USB hub found [ 1.946763] hub 3-0:1.0: 2 ports detected [ 1.950858] intel_pstate: Intel P-state driver initializing [ 2.017307] Freeing initrd memory: 33136K [ 2.042422] hid: raw HID events driver (C) Jiri Kosina [ 2.042461] usbcore: registered new interface driver usbhid [ 2.042462] usbhid: USB HID core driver [ 2.042509] drop_monitor: Initializing network drop monitor service [ 2.050952] Initializing XFRM netlink socket [ 2.051031] NET: Registered PF_INET6 protocol family [ 2.055533] Segment Routing with IPv6 [ 2.055548] NET: Registered PF_PACKET protocol family [ 2.055568] mpls_gso: MPLS GSO support [ 2.093398] microcode: Current revision: 0x0b000010 [ 2.112004] resctrl: L3 allocation detected [ 2.112006] resctrl: L3 monitoring detected [ 2.112017] IPI shorthand broadcast: enabled [ 2.112021] AVX2 version of gcm_enc/dec engaged. [ 2.146413] AES CTR mode by8 optimization enabled [ 2.146451] sched_clock: Marking stable (1017933430, 1127687847)->(2550194282, -404573005) [ 2.163017] registered taskstats version 1 [ 2.179442] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.179619] Loading compiled-in X.509 certificates [ 2.180147] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.180413] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.180696] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.180838] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.180847] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.181012] zswap: loaded using pool lzo/zbud [ 2.187733] page_owner is disabled [ 2.187902] pstore: Using crash dump compression: deflate [ 2.187911] Key type big_key registered [ 2.193646] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.196000] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.290928] Key type encrypted registered [ 2.290934] ima: No TPM chip found, activating TPM-bypass! [ 2.290936] Loading compiled-in module X.509 certificates [ 2.291219] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.291221] ima: Allocated hash algorithm: sha256 [ 2.291229] ima: No architecture policies found [ 2.291236] evm: Initialising EVM extended attributes: [ 2.291237] evm: security.selinux [ 2.291237] evm: security.SMACK64 (disabled) [ 2.291238] evm: security.SMACK64EXEC (disabled) [ 2.291238] evm: security.SMACK64TRANSMUTE (disabled) [ 2.291238] evm: security.SMACK64MMAP (disabled) [ 2.291239] evm: security.apparmor (disabled) [ 2.291239] evm: security.ima [ 2.291239] evm: security.capability [ 2.291240] evm: HMAC attrs: 0x1 [ 2.320821] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.320823] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.321278] hub 2-12:1.0: USB hub found [ 2.321354] hub 2-12:1.0: 4 ports detected [ 2.357645] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.357648] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.357705] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.357707] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.363782] hub 3-1:1.0: USB hub found [ 2.363828] hub 1-1:1.0: USB hub found [ 2.371060] hub 3-1:1.0: 6 ports detected [ 2.371065] hub 1-1:1.0: 8 ports detected [ 2.616649] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.700658] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.700662] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.701381] clocksource: Switched to clocksource tsc [ 2.721030] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.721032] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.726119] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.777760] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.780442] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.780512] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.277759] Freeing unused decrypted memory: 2028K [ 5.278226] Freeing unused kernel image (initmem) memory: 3928K [ 5.289686] Write protecting the kernel read-only data: 28672k [ 5.289885] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.328181] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.328182] x86/mm: Checking user space page tables [ 5.364880] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.364890] Run /init as init process [ 5.378513] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.378612] systemd[1]: Detected architecture x86-64. Welcome to [0[ 5.378613] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.429842] systemd[1]: Hostname set to . [ OK [[ 5.485793] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.485904] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.507719] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.521692] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.533775] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.544689] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.556883] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.571778] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.585791] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.597759] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.611744] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.625761] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.644534] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.659855] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.671784] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.672350] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.694215] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.706300] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.719536] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.117777] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ [ 6.151038] igb: Intel(R) Gigabit Ethernet Network Driver OK ] Starte[ 6.151040] igb: Copyright (c) 2007-2014 Intel Corporation. d Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target [0;1;39[ 6.173201] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver mPath Units.[ 6.173204] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ OK ] Reached target Basic System. [ 6.204287] nvme nvme0: pci function 0000:02:00.0 [ 6.204403] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.204406] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.204555] ACPI: bus type drm_connector registered [ 6.210060] igb 0000:07:00.0: added PHC on eth0 [ 6.210087] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.210089] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:44 [ 6.210164] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.210166] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.220388] nvme nvme0: 8/0/0 default/read/poll queues [ 6.221111] scsi host0: ahci [ 6.221497] scsi host1: ahci [ 6.221981] scsi host2: ahci [ 6.222100] scsi host3: ahci [ 6.222153] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 44 lpm-pol 0 [ 6.222155] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 44 lpm-pol 0 [ 6.222158] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 44 lpm-pol 0 [ 6.222160] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 44 lpm-pol 0 [ 6.222400] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.222404] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.238026] scsi host4: ahci [ 6.238137] scsi host5: ahci [ 6.238424] scsi host6: ahci [ 6.238525] scsi host7: ahci [ 6.238816] scsi host8: ahci [ 6.238910] scsi host9: ahci [ 6.238954] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.238957] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.238959] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.238962] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.238965] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.238967] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.266061] igb 0000:07:00.1: added PHC on eth1 [ 6.266091] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.266092] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:45 [ 6.266173] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.266174] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.267732] igfrom eth1 [ 6.272250] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.281537] Console: switching to colour dummy device 80x25 [ 6.281713] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.281714] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.281732] ast 0000:06:00.0: [drm] Using analog VGA [ 6.281741] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.281785] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.281943] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.302400] fbcon: astdrmfb (fb0) is primary device [ 6.327128] Console: switching to colour frame buffer device 128x48 [ 6.345684] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.530392] ata3: SATA link down (SStatus 0 SControl 300) [ 6.530745] ata2: SATA link down (SStatus 0 SControl 300) [ 6.530802] ata4: SATA link down (SStatus 0 SControl 300) [ 6.530975] ata1: SATA link down (SStatus 0 SControl 300) [ 6.545938] ata9: SATA link down (SStatus 0 SControl 300) [ 6.546011] ata10: SATA link down (SStatus 0 SControl 300) [ 6.546036] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.546185] ata6: SATA link down (SStatus 0 SControl 300) [ 6.546206] ata8: SATA link down (SStatus 0 SCo 6.546227] ataatus 0 SControl 60] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.547629] ata5.00: NCQ Send/Recv Log not supported [ 6.547630] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.549081] ata5.00: NCQ Send/Recv Log not supported [ 6.549085] ata5.00: configured for UDMA/133 [ 6.549156] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.625251] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.699613] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.699630] sd 4:0:0:0: [sda] Write Protect is off [ 6.699652] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.699678] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.714424] sda: sda1 [ 6.714476] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.314102] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.314391] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.314473] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.314474] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d7:c0 [ 7.317858] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.474870] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.475158] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.475239] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.475240] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d7:c1 [ 7.478568] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.486482] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.519712] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.755205] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [[0[ 8.061853] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). ;32m OK ] Finished Plymouth switch root service. Starting Switch Root... [ 8.580408] SELinux: policy capability network_peer_controls=1 [ 8.580411] SELinux: policy capability open_perms=1 [ 8.580412] SELinux: policy capability extended_socket_class=1 [ 8.580412] SELinux: policy capability always_check_network=0 [ 8.580413] SELinux: policy capability cgroup_seclabel=1 [ 8.580413] SELinux: policy capability nnp_nosuid_transition=1 [ 8.580414] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.623325] audit: type=1403 audit(1714134002.180:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.625640] systemd[1]: Successfully loaded SELinux policy in 108.859ms. [ 8.677364] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.035ms. [ 8.685418] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.685526] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.731863] systemd[1]: Hostname set to . [ OK [[ 9.563275] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.563365] systemd[1]: Stopped Switch Root. [ 9.563748] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.564041] systemd[1]: Created slice Slice /system/getty. 0m] Stopped [0;[ 9.591009] systemd[1]: Created slice Slice /system/modprobe. [ 9.591297] systemd[1]: Created slice Slice /system/serial-getty. 1;39mSwitch Root[ 9.591542] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.591787] systemd[1]: Created slice User and Session Slice. [ 9.612709] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.612854] systemd[1]: Started Forward Password Requests to Wall Directory Watch. . [[ 9.632456] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. OK ] Crea[ 9.650423] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.650456] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.650479] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. ted slice [0;1;[ 9.650502] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.650525] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.650545] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.650574] systemd[1]: Reached target Local Encrypted Volumes. [ 9.650606] systemd[1]: Stopped target Switch Root. [ 9.650637] systemd[1]: Stopped target Initrd File Systems. [ 9.705229] systemd[1]: Stopped target Initrd Root File System. [ 9.726944] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.738410] systemd[1]: Reached target Path Units. 39mSlice /system[ 9.749984] systemd[1]: Reached target Slice Units. [ 9.750014] systemd[1]: Reached target Swaps. [ 9.750036] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.750413] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.758569] systemd[1]: Listening on LVM2 poll daemon socket. /getty. [ OK ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/serial-getty. [ OK[ 9.792721] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.792764] systemd[1]: Reached target RPC Port Mapper. [ 9.794085] systemd[1]: Listening on Process Core Dump Socket. ] Created [ 9.812373] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.812797] systemd[1]: Listening on udev Control Socket. slice S[ 9.825833] systemd[1]: Listening on udev Kernel Socket. [ 9.826607] systemd[1]: Mounting Huge Pages File System... [ 9.827464] systemd[1]: Mounting POSIX Message Queue File System... [ 9.838568] systemd[1]: Mounting Kernel Debug File System... lice /system/ssh[ 9.850426] systemd[1]: Mounting Kernel Trace File System... [ 9.850539] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). d-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall[ 9.883075] systemd[1]: Starting Create List of Static Device Nodes... [ 9.883887] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Directory Watch[ 9.901367] systemd[1]: Starting Load Kernel Module configfs... [ 9.902124] systemd[1]: Starting Load Kernel Module drm... . [ OK ] Set [ 9.914132] systemd[1]: Starting Load Kernel Module fuse... up automount [0[ 9.916149] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.921782] systemd[1]: plymouth-switch-root.service: Deactivated successfully. ;1;39mArbitrary\xe2[ 9.921825] systemd[1]: Stopped Plymouth switch root service. [ 9.922004] systemd[1]: Stopped Journal Service. \x80\xa6s File System [ 9.950995] systemd[1]: Starting Journal Service... [ 9.952613] systemd[1]: Starting Load Kernel Modules... Automount Point. [ [ 9.962801] systemd[1]: Starting Generate network units from Kernel command line... [ 9.962844] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). OK ] Reach[ 9.963635] systemd[1]: Starting Remount Root and Kernel File Systems... ed target [0;1;[ 9.999034] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 9.999898] systemd[1]: Starting Coldplug All udev Devices... 39mceph target\xe2\x80[ 10.016509] systemd[1]: Started Journal Service. [ 10.019555] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. \xa6on@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 10.065188] systemd-journald[578]: Received client request to flush runtime journal. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] S[ 10.095322] fuse: init (API version 7.36) topped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug [ 10.287077] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.287094] device-mapper: uevent: version 1.0.3 [ 10.287150] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com All udev Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.688483] IPMI message handler: version 39.2 [ 10.693317] ipmi device interface [ 10.702984] ipmi_si: IPMI System Interface driver [ 10.702999] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.703001] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.703002] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.703055] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.703178] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.704611] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.704613] ipmi_si: Adding ACPI-specified kcs state machine [ 10.704679] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.755719] power_meter ACPI000D:00: Found ACPI power meter. [ 10.755745] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.755752] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.778565] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.778650] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 10.804525] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.823716] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.824572] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.825665] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.825668] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 10.833992] igb 0000:07:00.0: DCA enabled [ 10.834019] igb 0000:07:00.1: DCA enabled [ 10.848294] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.873789] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.873792] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.873793] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.906790] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.913600] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 10.964355] iTCO_vendor_support: vendor-support=0 [ 10.976437] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.976651] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Finished Create Volatile Files and Directories. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 11.175118] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.175120] EDAC sbridge: Ver: 1.1.2 [ 11.267719] RPC: Registered named UNIX socket transport module. [ OK [[ 11.267722] RPC: Registered udp transport module. 0m] Mounted [0;[ 11.267722] RPC: Registered tcp transport module. [ 11.267722] RPC: Registered tcp-with-tls transport module. 1;39mRPC Pipe Fi[ 11.267723] RPC: Registered tcp NFSv4.1 backchannel transport module. le System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.494204] intel_rapl_common: Found RAPL domain package [ 11.494209] intel_rapl_common: Found RAPL domain dram [ 11.494514] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.505760] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 11.505867] XFS (dm-4): Mounting V4 Filesystem 06f73296-8d0e-41ab-9a58-dada525e34bb [ 11.511029] XFS (dm-4): Ending clean mount [ 11.511071] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ 13.200424] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.353478] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.577354] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... [ 13.772720] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.772846] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready Starting OpenSSH server daemon... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. + myips=172.21.15.113 + attempts=1 + sleep 1 [ 20.184566] block sda: the capability attribute has been deprecated. + '[' 172.21.15.113 '!=' '' ']' + set -e + '[' -n 172.21.15.113 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.113 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.113 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi113.front.sepia.ceph.com + '[' -n smithi113.front.sepia.ceph.com ']' + hostname smithi113.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi113 + echo smithi113 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.113 smithi113.front.sepia.ceph.com smithi113/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 Starting SETroubleshoot da…ing new SELinux denial logs... [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Crash recovery kernel arming. CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:20:16.645 DEBUG:teuthology.orchestra.console.smithi113:expect after: smithi113 login: 2024-04-26T12:20:16.699 DEBUG:teuthology.orchestra.console.smithi113:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                      test failure, check cable PXE-M0F: Exiting Intel Boot Agent. PXE-E61: Media test failure, check cable Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.113 : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d7:c1)... Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D7 C1 GUID: 00000000 0000 0000 0000 0CC47AD8DB44 CLIENT IP: 172.21.15.113 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   Configuring (net0 0c:c4:7a:8f:d7:c1).... Configuring (net0 0c:c4:7a:8f:d7:c1)..... PXE-E61: Media test failure, check cable  [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9               The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            Use the * and * keys to change the selection.  The selected entry will be started automatically in 4s.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.     The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eaffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f62000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.684 MHz processor [ 0.000408] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000411] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000413] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000748] last_pfn = 0x78eb0 max_arch_pfn = 0x400000000 [ 0.006544] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006553] Using GB pages for direct mapping [ 0.006664] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006667] ACPI: Early table checksum verification disabled [ 0.006670] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006673] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.006677] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006681] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006684] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.006686] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006689] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006691] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006693] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006696] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006698] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006700] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006703] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006705] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006707] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006710] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006712] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006715] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006717] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006719] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006722] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006724] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006726] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.006727] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.006728] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.006728] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.006729] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.006729] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.006730] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.006731] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.006731] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.006732] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.006732] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.006733] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.006734] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.006734] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.006735] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.006735] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.006736] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.006737] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.006737] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.006738] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.006783] No NUMA configuration found [ 0.006784] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006793] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006987] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007022] Zone ranges: [ 0.007022] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007024] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007025] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007026] Device empty [ 0.007027] Movable zone start for each node [ 0.007029] Early memory node ranges [ 0.007029] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007031] node 0: [mem 0x0000000000100000-0x0000000078eaffff] [ 0.007031] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007035] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007039] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007076] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011878] On node 0, zone Normal: 29008 pages in unavailable ranges [ 0.011989] ACPI: PM-Timer IO Port: 0x408 [ 0.011996] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011997] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011998] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012010] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012015] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012016] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012018] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012021] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012022] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012026] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012027] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012037] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012038] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012039] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012040] PM: hibernation: Registered nosave memory: [mem 0x78eb0000-0x78f61fff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x78f62000-0x798affff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012045] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012046] Booting paravirtualized kernel on bare hardware [ 0.012048] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016371] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016590] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016614] Fallback order for Node 0: 0 [ 0.016617] Built 1 zonelists, mobility grouping on. Total pages: 8228725 [ 0.016618] Policy zone: Normal [ 0.016619] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016673] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016689] random: crng init done [ 0.018867] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020005] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020250] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020258] software IO TLB: area num 8. [ 0.047639] Memory: 1750092K/33437928K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989184K reserved, 0K cma-reserved) [ 0.047740] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047748] Kernel/User page tables isolation: enabled [ 0.047772] ftrace: allocating 46993 entries in 184 pages [ 0.065985] ftrace: allocated 184 pages with 4 groups [ 0.066493] Dynamic Preempt: voluntary [ 0.066522] rcu: Preemptible hierarchical RCU implementation. [ 0.066523] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066524] Trampoline variant of Tasks RCU enabled. [ 0.066524] Rude variant of Tasks RCU enabled. [ 0.066524] Tracing variant of Tasks RCU enabled. [ 0.066525] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066525] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069744] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069905] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070010] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075248] Console: colour VGA+ 80x25 [ 1.096689] printk: console [ttyS1] enabled [ 1.100880] ACPI: Core revision 20230331 [ 1.104975] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.114103] APIC: Switch to symmetric I/O mode setup [ 1.119073] DMAR: Host address width 46 [ 1.122916] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128233] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136229] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142496] DMAR: ATSR flags: 0x0 [ 1.145816] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.152084] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158435] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.164789] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170189] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170190] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185212] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190516] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196741] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.207111] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272269c7d7, max_idle_ns: 440795300785 ns [ 1.217622] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.36 BogoMIPS (lpj=3499684) [ 1.218640] CPU0: Thermal monitoring enabled (TM1) [ 1.219674] process: using mwait in idle threads [ 1.220622] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221621] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222622] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223622] Spectre V2 : Mitigation: Retpolines [ 1.224621] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225621] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226621] Speculative Store Bypass: Vulnerable [ 1.227627] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228621] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229621] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230624] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231621] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232621] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233621] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234621] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.247022] Freeing SMP alternatives memory: 36K [ 1.247622] pid_max: default: 32768 minimum: 301 [ 1.248639] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249626] Yama: becoming mindful. [ 1.250625] SELinux: Initializing. [ 1.251637] LSM support for eBPF active [ 1.252678] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253659] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357436] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358714] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359621] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360632] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361631] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362630] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363622] ... version: 3 [ 1.364621] ... bit width: 48 [ 1.365621] ... generic registers: 4 [ 1.366621] ... value mask: 0000ffffffffffff [ 1.367621] ... max period: 00007fffffffffff [ 1.368621] ... fixed-purpose events: 3 [ 1.369621] ... event mask: 000000070000000f [ 1.370704] signal: max sigframe size: 1776 [ 1.371632] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372646] rcu: Hierarchical SRCU implementation. [ 1.372646] rcu: Max phase no-delay instances is 400. [ 1.372654] printk: console [ttyS1] printing thread started [ 1.377209] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377275] smp: Bringing up secondary CPUs ... [ 1.377342] smpboot: x86: Booting SMP configuration: [ 1.377343] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.383888] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.383888] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.383888] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.383888] smp: Brought up 1 node, 8 CPUs [ 1.383888] smpboot: Max logical packages: 1 [ 1.383888] smpboot: Total of 8 processors activated (55994.94 BogoMIPS) [ 1.427642] node 0 deferred pages initialised in 36ms [ 1.429644] devtmpfs: initialized [ 1.429667] x86/mm: Memory block size: 128MB [ 1.430640] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.430718] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.430722] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.430756] pinctrl core: initialized pinctrl subsystem [ 1.440170] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.440257] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.440268] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.440275] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.440283] audit: initializing netlink subsys (disabled) [ 1.440633] audit: type=2000 audit(1714133993.243:1): state=initialized audit_enabled=0 res=1 [ 1.440691] thermal_sys: Registered thermal governor 'fair_share' [ 1.440692] thermal_sys: Registered thermal governor 'step_wise' [ 1.440692] thermal_sys: Registered thermal governor 'user_space' [ 1.448623] cpuidle: using governor menu [ 1.458641] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.458642] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.458687] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.458690] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.458698] PCI: Using configuration type 1 for base access [ 1.476649] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.476653] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.476653] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.476653] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.476653] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.483925] cryptd: max_cpu_qlen set to 1000 [ 1.500152] ACPI: Added _OSI(Module Device) [ 1.500153] ACPI: Added _OSI(Processor Device) [ 1.500153] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.500154] ACPI: Added _OSI(Processor Aggregator Device) [ 1.500155] ACPI: Added _OSI(Linux-Dell-Video) [ 1.500155] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.500156] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.523823] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.525991] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.527715] ACPI: Dynamic OEM Table Load: [ 1.545912] ACPI: _OSC evaluated successfully for all CPUs [ 1.546280] ACPI: Interpreter enabled [ 1.546291] ACPI: PM: (supports S0 S4 S5) [ 1.546292] ACPI: Using IOAPIC for interrupt routing [ 1.548464] HEST: Enabling Firmware First mode for corrected errors. [ 1.586784] HEST: Table parsing has been initialized. [ 1.586900] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.586902] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.586903] PCI: Using E820 reservations for host bridge windows [ 1.587344] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.608462] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.608466] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.609580] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.610109] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.610110] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.610136] PCI host bridge to bus 0000:ff [ 1.610138] pci_bus 0000:ff: root bus resource [bus ff] [ 1.610148] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.610190] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.610220] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.610249] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.610278] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.610307] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.610335] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.610363] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.610392] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.610419] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.610447] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.610475] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.610502] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.610530] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.610558] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.610587] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.610614] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.610644] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.610671] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.610691] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.610726] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610784] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610836] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610877] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610918] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610957] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.610996] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.611026] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.611057] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611098] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611138] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611177] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611216] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.611246] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.611277] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.611309] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.611341] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611381] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611423] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611466] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.611508] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.611542] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.611571] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.611602] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.611636] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.611666] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.611697] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.611726] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.611759] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.611787] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.611817] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.611847] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.611868] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.611899] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.611928] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.614130] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.614133] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.614265] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.614502] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.614503] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.614914] PCI host bridge to bus 0000:00 [ 1.614916] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.614917] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.614918] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.614919] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.614920] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.614921] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.614922] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.614941] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.615041] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.615053] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.615088] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.615176] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.615188] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.615191] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.615223] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.615309] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.615320] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.615322] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.615324] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.615328] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.615357] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.615437] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615445] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.615518] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615526] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.615597] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615605] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.615679] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615686] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.615758] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615765] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.615839] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615846] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.615919] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.615927] pci 00-0xfb417fff 64bi7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616006] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.616076] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616138] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616219] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.616274] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.616279] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.616358] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.616593] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.616613] pci 0000:00:11.4: BAR 0 1.616623] pci 00-0xf103] [ [io 0xf0f0-0xf0f7] [ 1.616645] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.616656] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.616667] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.616726] pci 0000:00:11.4: PME# supported from D3hot [ 1.616805] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.616829] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.616916] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.617002] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.617026] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.617112] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.617178] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.617202] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.617289] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.617370] pci 0000:00:1a.0: [8086:8ventional PCI endpoint [ 1.617392] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0 [ 1.617505] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.617582] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.617622] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.617714] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.617813] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.617850] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.617855] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.617858] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.617000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.618041] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.618080] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.618086] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.618089] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.618177] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.618277] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.618298] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.618412] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.618492] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.618697] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.618715] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.618726] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.618737] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.618747] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.618757] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.618769] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.618821] pci 0000:00:1f.2: PME# supported from D3hot [ 1.618881] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.618904] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.618933] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.619093] acpiphp: Slot [1] registered [ 1.619104] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.619210] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.619219] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.619235] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.619239] pci 0000:02:00.0: enabling Extended Tags [ 1.619339] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.619446] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.619457] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.619461] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.619471] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.619476] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.619511] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.619528] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619529] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.619537] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619538] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.619691] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.619701] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.619705] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.619715] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.619720] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.619755] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.619769] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619770] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.619778] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.619779] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.619916] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.619960] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.620052] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.620124] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.620137] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.620142] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.620196] pci 0000:05:00.0: enabling Extended Tags [ 1.620316] pci 0000:05:00.0: supports D1 D2 [ 1.620317] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.620450] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.620537] pci_bus 0000:06: extended config space not accessible [ 1.620570] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.620607] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.620626] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.620645] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.620744] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.620814] pci 0000:06:00.0: supports D1 D2 [ 1.620815] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.620966] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.621108] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.621141] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.621178] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.621196] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.621421] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.621483] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.621484] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.621516] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.621517] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.621849] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.621882] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.621918] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.621937] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.622153] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.622211] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.622211] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.622244] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.622245] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.622539] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.622550] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.623226] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.623256] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.623286] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.623315] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.623345] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.623346] ACPI: PCI: Interrupt link LNKE disabled [ 1.623375] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.623375] ACPI: PCI: Interrupt link LNKF disabled [ 1.623406] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.623406] ACPI: PCI: Interrupt link LNKG disabled [ 1.623436] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.623436] ACPI: PCI: Interrupt link LNKH disabled [ 1.623634] iommu: Default domain type: Translated [ 1.623634] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.623704] SCSI subsystem initialized [ 1.623719] ACPI: bus type USB registered [ 1.623730] usbcore: registered new interface driver usbfs [ 1.623735] usbcore: registered new interface driver hub [ 1.623739] usbcore: registered new device driver usb [ 1.623758] pps_core: LinuxPPS API ver. 1 registered [ 1.623759] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.623760] PTP clock support registered [ 1.623774] EDAC MC: Ver: 3.0.0 [ 1.624781] NetLabel: Initializing [ 1.624782] NetLabel: domain hash size = 128 [ 1.624782] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.624796] NetLabel: unlabeled traffic allowed by default [ 1.624797] PCI: Using ACPI for IRQ routing [ 1.634790] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.634790] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.634790] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.634790] vgaarb: loaded [ 1.634790] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.634790] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.639208] clocksource: Switched to clocksource tsc-early [ 1.647399] VFS: Disk quotas dquot_6.6.0 [ 1.647407] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.647454] pnp: PnP ACPI init [ 1.647774] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.647777] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.647779] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.647780] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.647781] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.647781] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.647782] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.647784] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.647785] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.647786] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.647786] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.647787] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.647788] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.647929] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.647930] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.647931] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.647931] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.647932] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.648599] pnp: PnP ACPI: found 5 devices [ 1.654059] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.654100] NET: Registered PF_INET protocol family [ 1.654267] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.656535] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.656564] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.656574] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.656795] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.656904] TCP: Hash tables configured (established 262144 bind 65536) [ 1.657018] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.657102] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.657157] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.657238] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.657242] NET: Registered PF_XDP protocol family [ 1.657263] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.657273] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.657276] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.657281] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.657283] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.657289] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657291] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657292] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657293] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657294] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657295] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657296] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657297] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657298] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657299] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657300] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657301] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657302] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657303] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657304] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.657305] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.657306] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.657307] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.657309] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.657311] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.657314] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.657329] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.657331] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.657339] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.657355] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.657357] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.657362] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.657372] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.657378] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.657384] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.657390] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.657396] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.657398] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.657404] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.657407] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.657413] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.657414] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.657415] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.657415] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.657416] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.657417] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.657418] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.657419] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.657420] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.657421] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.657422] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.657423] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.657424] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.657424] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.657425] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.657426] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.657427] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.657427] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.657591] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.674681] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16516 usecs [ 1.691670] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 16575 usecs [ 1.691684] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.691718] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.691719] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.691725] Trying to unpack rootfs image as initramfs... [ 1.691733] ACPI: bus type thunderbolt registered [ 1.767029] Initialise system trusted keyrings [ 1.767037] Key type blacklist registered [ 1.767074] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.768396] zbud: loaded [ 1.842146] integrity: Platform Keyring initialized [ 1.842151] integrity: Machine keyring initialized [ 1.849915] NET: Registered PF_ALG protocol family [ 1.849917] xor: automatically using best checksumming function avx [ 1.849919] Key type asymmetric registered [ 1.849920] Asymmetric key parser 'x509' registered [ 1.849920] Running certificate verification selftests [ 1.851330] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.851803] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.851822] io scheduler mq-deadline registered [ 1.851822] io scheduler kyber registered [ 1.851849] io scheduler bfq registered [ 1.867037] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.867336] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.867496] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.867643] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.867772] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.867927] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.868074] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.868229] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.868302] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.892039] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.892058] ACPI: button: Power Button [PWRB] [ 1.892078] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.892131] ACPI: button: Power Button [PWRF] [ 1.900522] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.900524] pstore: Registered erst as persistent store backend [ 1.900613] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.900703] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.908350] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.916957] Non-volatile memory driver v1.3 [ 1.924980] rdac: device handler registered [ 1.925008] hp_sw: device handler registered [ 1.925009] emc: device handler registered [ 1.925028] alua: device handler registered [ 1.925318] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.925369] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.925383] ehci-pci 0000:00:1d.0: debug port 2 [ 1.929310] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.934655] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.934689] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.934691] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.934692] usb usb1: Product: EHCI Host Controller [ 1.934693] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.934693] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.934777] hub 1-0:1.0: USB hub found [ 1.934781] hub 1-0:1.0: 2 ports detected [ 1.934887] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.934921] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.936007] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.936195] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.936220] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.936253] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 1.936255] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 1.936256] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.936272] ehci-pci 0000:00:1a.0: debug port 2 [ 1.936302] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.936304] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.936306] usb usb2: Product: xHCI Host Controller [ 1.936307] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.936307] usb usb2: SerialNumber: 0000:00:14.0 [ 1.936412] hub 2-0:1.0: USB hub found [ 1.936444] hub 2-0:1.0: 15 ports detected [ 1.939789] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.939792] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.939793] usb usb4: Product: xHCI Host Controller [ 1.939794] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.939795] usb usb4: SerialNumber: 0000:00:14.0 [ 1.939873] hub 4-0:1.0: USB hub found [ 1.939891] hub 4-0:1.0: 6 ports detected [ 1.940199] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.941243] usbcore: registered new interface driver usbserial_generic [ 1.941247] usbserial: USB Serial support registered for generic [ 1.941272] i8042: PNP: No PS/2 controller found. [ 1.941320] mousedev: PS/2 mouse device common for all mice [ 1.941372] rtc_cmos 00:00: RTC can wake from S4 [ 1.941654] rtc_cmos 00:00: registered as rtc0 [ 1.941701] rtc_cmos 00:00: setting system clock to 2024-04-26T12:19:55 UTC (1714133995) [ 1.941723] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.946656] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.946682] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.946683] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.946684] usb usb3: Product: EHCI Host Controller [ 1.946685] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.946686] usb usb3: SerialNumber: 0000:00:1a.0 [ 1.946760] hub 3-0:1.0: USB hub found [ 1.946763] hub 3-0:1.0: 2 ports detected [ 1.950858] intel_pstate: Intel P-state driver initializing [ 2.017307] Freeing initrd memory: 33136K [ 2.042422] hid: raw HID events driver (C) Jiri Kosina [ 2.042461] usbcore: registered new interface driver usbhid [ 2.042462] usbhid: USB HID core driver [ 2.042509] drop_monitor: Initializing network drop monitor service [ 2.050952] Initializing XFRM netlink socket [ 2.051031] NET: Registered PF_INET6 protocol family [ 2.055533] Segment Routing with IPv6 [ 2.055548] NET: Registered PF_PACKET protocol family [ 2.055568] mpls_gso: MPLS GSO support [ 2.093398] microcode: Current revision: 0x0b000010 [ 2.112004] resctrl: L3 allocation detected [ 2.112006] resctrl: L3 monitoring detected [ 2.112017] IPI shorthand broadcast: enabled [ 2.112021] AVX2 version of gcm_enc/dec engaged. [ 2.146413] AES CTR mode by8 optimization enabled [ 2.146451] sched_clock: Marking stable (1017933430, 1127687847)->(2550194282, -404573005) [ 2.163017] registered taskstats version 1 [ 2.179442] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.179619] Loading compiled-in X.509 certificates [ 2.180147] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.180413] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.180696] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.180838] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.180847] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.181012] zswap: loaded using pool lzo/zbud [ 2.187733] page_owner is disabled [ 2.187902] pstore: Using crash dump compression: deflate [ 2.187911] Key type big_key registered [ 2.193646] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.196000] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.290928] Key type encrypted registered [ 2.290934] ima: No TPM chip found, activating TPM-bypass! [ 2.290936] Loading compiled-in module X.509 certificates [ 2.291219] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.291221] ima: Allocated hash algorithm: sha256 [ 2.291229] ima: No architecture policies found [ 2.291236] evm: Initialising EVM extended attributes: [ 2.291237] evm: security.selinux [ 2.291237] evm: security.SMACK64 (disabled) [ 2.291238] evm: security.SMACK64EXEC (disabled) [ 2.291238] evm: security.SMACK64TRANSMUTE (disabled) [ 2.291238] evm: security.SMACK64MMAP (disabled) [ 2.291239] evm: security.apparmor (disabled) [ 2.291239] evm: security.ima [ 2.291239] evm: security.capability [ 2.291240] evm: HMAC attrs: 0x1 [ 2.320821] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.320823] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.321278] hub 2-12:1.0: USB hub found [ 2.321354] hub 2-12:1.0: 4 ports detected [ 2.357645] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.357648] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.357705] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.357707] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.363782] hub 3-1:1.0: USB hub found [ 2.363828] hub 1-1:1.0: USB hub found [ 2.371060] hub 3-1:1.0: 6 ports detected [ 2.371065] hub 1-1:1.0: 8 ports detected [ 2.616649] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.700658] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.700662] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.701381] clocksource: Switched to clocksource tsc [ 2.721030] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.721032] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.726119] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.777760] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.780442] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.780512] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.277759] Freeing unused decrypted memory: 2028K [ 5.278226] Freeing unused kernel image (initmem) memory: 3928K [ 5.289686] Write protecting the kernel read-only data: 28672k [ 5.289885] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.328181] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.328182] x86/mm: Checking user space page tables [ 5.364880] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.364890] Run /init as init process [ 5.378513] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.378612] systemd[1]: Detected architecture x86-64. Welcome to [0[ 5.378613] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.429842] systemd[1]: Hostname set to . [ OK [[ 5.485793] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.485904] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.507719] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.521692] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.533775] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.544689] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.556883] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.571778] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.585791] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.597759] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.611744] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.625761] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.644534] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.659855] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.671784] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.672350] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.694215] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.706300] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.719536] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.117777] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ [ 6.151038] igb: Intel(R) Gigabit Ethernet Network Driver OK ] Starte[ 6.151040] igb: Copyright (c) 2007-2014 Intel Corporation. d Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target [0;1;39[ 6.173201] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver mPath Units.[ 6.173204] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ OK ] Reached target Basic System. [ 6.204287] nvme nvme0: pci function 0000:02:00.0 [ 6.204403] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.204406] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.204555] ACPI: bus type drm_connector registered [ 6.210060] igb 0000:07:00.0: added PHC on eth0 [ 6.210087] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.210089] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:44 [ 6.210164] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.210166] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.220388] nvme nvme0: 8/0/0 default/read/poll queues [ 6.221111] scsi host0: ahci [ 6.221497] scsi host1: ahci [ 6.221981] scsi host2: ahci [ 6.222100] scsi host3: ahci [ 6.222153] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 44 lpm-pol 0 [ 6.222155] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 44 lpm-pol 0 [ 6.222158] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 44 lpm-pol 0 [ 6.222160] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 44 lpm-pol 0 [ 6.222400] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.222404] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.238026] scsi host4: ahci [ 6.238137] scsi host5: ahci [ 6.238424] scsi host6: ahci [ 6.238525] scsi host7: ahci [ 6.238816] scsi host8: ahci [ 6.238910] scsi host9: ahci [ 6.238954] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.238957] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.238959] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.238962] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.238965] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.238967] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.266061] igb 0000:07:00.1: added PHC on eth1 [ 6.266091] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.266092] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:db:45 [ 6.266173] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.266174] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.267732] igfrom eth1 [ 6.272250] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.281537] Console: switching to colour dummy device 80x25 [ 6.281713] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.281714] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.281732] ast 0000:06:00.0: [drm] Using analog VGA [ 6.281741] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.281785] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.281943] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.302400] fbcon: astdrmfb (fb0) is primary device [ 6.327128] Console: switching to colour frame buffer device 128x48 [ 6.345684] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.530392] ata3: SATA link down (SStatus 0 SControl 300) [ 6.530745] ata2: SATA link down (SStatus 0 SControl 300) [ 6.530802] ata4: SATA link down (SStatus 0 SControl 300) [ 6.530975] ata1: SATA link down (SStatus 0 SControl 300) [ 6.545938] ata9: SATA link down (SStatus 0 SControl 300) [ 6.546011] ata10: SATA link down (SStatus 0 SControl 300) [ 6.546036] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.546185] ata6: SATA link down (SStatus 0 SControl 300) [ 6.546206] ata8: SATA link down (SStatus 0 SCo 6.546227] ataatus 0 SControl 60] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.547629] ata5.00: NCQ Send/Recv Log not supported [ 6.547630] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.549081] ata5.00: NCQ Send/Recv Log not supported [ 6.549085] ata5.00: configured for UDMA/133 [ 6.549156] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.625251] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.699613] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.699630] sd 4:0:0:0: [sda] Write Protect is off [ 6.699652] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.699678] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.714424] sda: sda1 [ 6.714476] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.314102] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.314391] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.314473] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.314474] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d7:c0 [ 7.317858] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.474870] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.475158] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.475239] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.475240] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d7:c1 [ 7.478568] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.486482] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.519712] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.755205] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [[0[ 8.061853] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). ;32m OK ] Finished Plymouth switch root service. Starting Switch Root... [ 8.580408] SELinux: policy capability network_peer_controls=1 [ 8.580411] SELinux: policy capability open_perms=1 [ 8.580412] SELinux: policy capability extended_socket_class=1 [ 8.580412] SELinux: policy capability always_check_network=0 [ 8.580413] SELinux: policy capability cgroup_seclabel=1 [ 8.580413] SELinux: policy capability nnp_nosuid_transition=1 [ 8.580414] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.623325] audit: type=1403 audit(1714134002.180:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.625640] systemd[1]: Successfully loaded SELinux policy in 108.859ms. [ 8.677364] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.035ms. [ 8.685418] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.685526] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.731863] systemd[1]: Hostname set to . [ OK [[ 9.563275] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.563365] systemd[1]: Stopped Switch Root. [ 9.563748] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.564041] systemd[1]: Created slice Slice /system/getty. 0m] Stopped [0;[ 9.591009] systemd[1]: Created slice Slice /system/modprobe. [ 9.591297] systemd[1]: Created slice Slice /system/serial-getty. 1;39mSwitch Root[ 9.591542] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.591787] systemd[1]: Created slice User and Session Slice. [ 9.612709] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.612854] systemd[1]: Started Forward Password Requests to Wall Directory Watch. . [[ 9.632456] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. OK ] Crea[ 9.650423] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.650456] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.650479] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. ted slice [0;1;[ 9.650502] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.650525] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.650545] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.650574] systemd[1]: Reached target Local Encrypted Volumes. [ 9.650606] systemd[1]: Stopped target Switch Root. [ 9.650637] systemd[1]: Stopped target Initrd File Systems. [ 9.705229] systemd[1]: Stopped target Initrd Root File System. [ 9.726944] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.738410] systemd[1]: Reached target Path Units. 39mSlice /system[ 9.749984] systemd[1]: Reached target Slice Units. [ 9.750014] systemd[1]: Reached target Swaps. [ 9.750036] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.750413] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.758569] systemd[1]: Listening on LVM2 poll daemon socket. /getty. [ OK ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/serial-getty. [ OK[ 9.792721] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.792764] systemd[1]: Reached target RPC Port Mapper. [ 9.794085] systemd[1]: Listening on Process Core Dump Socket. ] Created [ 9.812373] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.812797] systemd[1]: Listening on udev Control Socket. slice S[ 9.825833] systemd[1]: Listening on udev Kernel Socket. [ 9.826607] systemd[1]: Mounting Huge Pages File System... [ 9.827464] systemd[1]: Mounting POSIX Message Queue File System... [ 9.838568] systemd[1]: Mounting Kernel Debug File System... lice /system/ssh[ 9.850426] systemd[1]: Mounting Kernel Trace File System... [ 9.850539] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). d-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall[ 9.883075] systemd[1]: Starting Create List of Static Device Nodes... [ 9.883887] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Directory Watch[ 9.901367] systemd[1]: Starting Load Kernel Module configfs... [ 9.902124] systemd[1]: Starting Load Kernel Module drm... . [ OK ] Set [ 9.914132] systemd[1]: Starting Load Kernel Module fuse... up automount [0[ 9.916149] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.921782] systemd[1]: plymouth-switch-root.service: Deactivated successfully. ;1;39mArbitrary\xe2[ 9.921825] systemd[1]: Stopped Plymouth switch root service. [ 9.922004] systemd[1]: Stopped Journal Service. \x80\xa6s File System [ 9.950995] systemd[1]: Starting Journal Service... [ 9.952613] systemd[1]: Starting Load Kernel Modules... Automount Point. [ [ 9.962801] systemd[1]: Starting Generate network units from Kernel command line... [ 9.962844] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). OK ] Reach[ 9.963635] systemd[1]: Starting Remount Root and Kernel File Systems... ed target [0;1;[ 9.999034] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 9.999898] systemd[1]: Starting Coldplug All udev Devices... 39mceph target\xe2\x80[ 10.016509] systemd[1]: Started Journal Service. [ 10.019555] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. \xa6on@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 10.065188] systemd-journald[578]: Received client request to flush runtime journal. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] S[ 10.095322] fuse: init (API version 7.36) topped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug [ 10.287077] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.287094] device-mapper: uevent: version 1.0.3 [ 10.287150] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com All udev Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.688483] IPMI message handler: version 39.2 [ 10.693317] ipmi device interface [ 10.702984] ipmi_si: IPMI System Interface driver [ 10.702999] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.703001] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.703002] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.703055] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.703178] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.704611] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.704613] ipmi_si: Adding ACPI-specified kcs state machine [ 10.704679] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.755719] power_meter ACPI000D:00: Found ACPI power meter. [ 10.755745] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.755752] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.778565] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.778650] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 10.804525] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.823716] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.824572] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.825665] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.825668] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 10.833992] igb 0000:07:00.0: DCA enabled [ 10.834019] igb 0000:07:00.1: DCA enabled [ 10.848294] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.873789] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.873792] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.873793] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.906790] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.913600] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 10.964355] iTCO_vendor_support: vendor-support=0 [ 10.976437] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.976651] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Finished Create Volatile Files and Directories. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ 11.175118] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.175120] EDAC sbridge: Ver: 1.1.2 [ 11.267719] RPC: Registered named UNIX socket transport module. [ OK [[ 11.267722] RPC: Registered udp transport module. 0m] Mounted [0;[ 11.267722] RPC: Registered tcp transport module. [ 11.267722] RPC: Registered tcp-with-tls transport module. 1;39mRPC Pipe Fi[ 11.267723] RPC: Registered tcp NFSv4.1 backchannel transport module. le System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.494204] intel_rapl_common: Found RAPL domain package [ 11.494209] intel_rapl_common: Found RAPL domain dram [ 11.494514] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.505760] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 11.505867] XFS (dm-4): Mounting V4 Filesystem 06f73296-8d0e-41ab-9a58-dada525e34bb [ 11.511029] XFS (dm-4): Ending clean mount [ 11.511071] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ 13.200424] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.353478] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.577354] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... [ 13.772720] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.772846] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready Starting OpenSSH server daemon... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. + myips=172.21.15.113 + attempts=1 + sleep 1 [ 20.184566] block sda: the capability attribute has been deprecated. + '[' 172.21.15.113 '!=' '' ']' + set -e + '[' -n 172.21.15.113 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.113 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.113 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi113.front.sepia.ceph.com + '[' -n smithi113.front.sepia.ceph.com ']' + hostname smithi113.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi113 + echo smithi113 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.113 smithi113.front.sepia.ceph.com smithi113/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 Starting SETroubleshoot da…ing new SELinux denial logs... [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Crash recovery kernel arming. CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi113 login: [disconnect] 2024-04-26T12:20:16.801 INFO:teuthology.misc:Re-opening connections... 2024-04-26T12:20:16.801 INFO:teuthology.misc:trying to connect to ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:20:16.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-26T12:20:16.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:20:17.075 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-04-26T12:20:17.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-26T12:20:17.507 DEBUG:teuthology.misc:waited 0.7061538696289062 2024-04-26T12:20:18.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~139s 2024-04-26T12:20:18.509 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:20:18.509 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi113.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-26T12:20:18.509 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:20:18.598 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:20:18.660 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:20:18.660 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:20:18.662 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:20:18.662 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:20:18.766 INFO:teuthology.orchestra.run.smithi113.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T12:20:18.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:20:18.769 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T12:20:19.625 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:20:19.623+0000 7f7b30224640 -1 Falling back to public interface 2024-04-26T12:20:23.330 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:20:23.329+0000 7f7b30224640 -1 osd.1 70 log_to_monitors true 2024-04-26T12:20:23.656 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-26T12:20:23.655+0000 7f7b23920640 -1 osd.1 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:20:23.770 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:20:23.884 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-26T12:20:23.884 INFO:teuthology.orchestra.run.smithi113.stdout: "ops": [], 2024-04-26T12:20:23.884 INFO:teuthology.orchestra.run.smithi113.stdout: "num_ops": 0 2024-04-26T12:20:23.884 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-26T12:20:23.893 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T12:20:24.016 INFO:teuthology.orchestra.run.smithi069.stdout:mon.a: {} 2024-04-26T12:20:24.016 INFO:teuthology.orchestra.run.smithi069.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:20:24.024 INFO:teuthology.orchestra.run.smithi069.stdout:mon.b: {} 2024-04-26T12:20:24.024 INFO:teuthology.orchestra.run.smithi069.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:20:24.033 INFO:teuthology.orchestra.run.smithi069.stdout:mon.c: {} 2024-04-26T12:20:24.033 INFO:teuthology.orchestra.run.smithi069.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:20:24.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:20:24.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi069.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:20:24.659 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T12:20:25.651 INFO:teuthology.orchestra.run.smithi069.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T12:20:25.666 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:20:26.658 INFO:teuthology.orchestra.run.smithi069.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:20:26.672 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T12:20:27.663 INFO:teuthology.orchestra.run.smithi069.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T12:20:27.678 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:20:28.673 INFO:teuthology.orchestra.run.smithi069.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:20:28.689 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T12:20:29.684 INFO:teuthology.orchestra.run.smithi069.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T12:20:29.700 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T12:20:29.700 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T12:20:29.700 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T12:20:29.700 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T12:20:29.700 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:20:29.701 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:20:29.982 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:29.983 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:20:29.676527+0000","last_up_change":"2024-04-26T12:20:24.639333+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":66,"last_clean_end":70,"up_from":74,"up_thru":74,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":1460},{"type":"v1","addr":"172.21.15.113:6801","nonce":1460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":1460},{"type":"v1","addr":"172.21.15.113:6803","nonce":1460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":1460},{"type":"v1","addr":"172.21.15.113:6807","nonce":1460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":1460},{"type":"v1","addr":"172.21.15.113:6805","nonce":1460}]},"public_addr":"172.21.15.113:6801/1460","cluster_addr":"172.21.15.113:6803/1460","heartbeat_back_addr":"172.21.15.113:6807/1460","heartbeat_front_addr":"172.21.15.113:6805/1460","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":70},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:20:29.995 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:20:29.995 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:20:30.271 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:30.271 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:20:29.676527+0000","last_up_change":"2024-04-26T12:20:24.639333+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":66,"last_clean_end":70,"up_from":74,"up_thru":74,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":1460},{"type":"v1","addr":"172.21.15.113:6801","nonce":1460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":1460},{"type":"v1","addr":"172.21.15.113:6803","nonce":1460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":1460},{"type":"v1","addr":"172.21.15.113:6807","nonce":1460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":1460},{"type":"v1","addr":"172.21.15.113:6805","nonce":1460}]},"public_addr":"172.21.15.113:6801/1460","cluster_addr":"172.21.15.113:6803/1460","heartbeat_back_addr":"172.21.15.113:6807/1460","heartbeat_front_addr":"172.21.15.113:6805/1460","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":70},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:20:30.283 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:20:30.283 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:20:30.284 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:20:30.419 INFO:teuthology.orchestra.run.smithi069.stdout:317827579907 2024-04-26T12:20:30.420 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:20:30.426 INFO:teuthology.orchestra.run.smithi069.stdout:34359738442 2024-04-26T12:20:30.427 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:20:30.427 INFO:teuthology.orchestra.run.smithi069.stdout:34359738442 2024-04-26T12:20:30.427 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:20:30.721 INFO:teuthology.orchestra.run.smithi069.stdout:317827579907 2024-04-26T12:20:30.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 317827579907 got 317827579907 for osd.1 2024-04-26T12:20:30.738 DEBUG:teuthology.parallel:result is None 2024-04-26T12:20:30.763 INFO:teuthology.orchestra.run.smithi069.stdout:34359738442 2024-04-26T12:20:30.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738442 got 34359738442 for osd.0 2024-04-26T12:20:30.776 INFO:teuthology.orchestra.run.smithi069.stdout:34359738442 2024-04-26T12:20:30.777 DEBUG:teuthology.parallel:result is None 2024-04-26T12:20:30.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738442 got 34359738442 for osd.2 2024-04-26T12:20:30.789 DEBUG:teuthology.parallel:result is None 2024-04-26T12:20:30.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:20:30.790 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:20:31.111 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:31.113 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:20:31.121 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T12:20:30.519337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834456,"kb_used_data":3692,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281064,"statfs":{"total":289910292480,"available":289055809536,"internally_reserved":0,"allocated":3780608,"data_stored":2205469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423367+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:29.423367+0000","last_peered":"2024-04-26T12:20:29.423367+0000","last_clean":"2024-04-26T12:20:29.423367+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:29.423367+0000","last_undegraded":"2024-04-26T12:20:29.423367+0000","last_fullsized":"2024-04-26T12:20:29.423367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423011+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:29.423011+0000","last_peered":"2024-04-26T12:20:29.423011+0000","last_clean":"2024-04-26T12:20:29.423011+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:29.423011+0000","last_undegraded":"2024-04-26T12:20:29.423011+0000","last_fullsized":"2024-04-26T12:20:29.423011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673852+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:28.673852+0000","last_peered":"2024-04-26T12:20:28.673852+0000","last_clean":"2024-04-26T12:20:28.673852+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:28.673852+0000","last_undegraded":"2024-04-26T12:20:28.673852+0000","last_fullsized":"2024-04-26T12:20:28.673852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:51.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673545+0000","last_change":"2024-04-26T12:20:25.662260+0000","last_active":"2024-04-26T12:20:28.673545+0000","last_peered":"2024-04-26T12:20:28.673545+0000","last_clean":"2024-04-26T12:20:28.673545+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:28.673545+0000","last_undegraded":"2024-04-26T12:20:28.673545+0000","last_fullsized":"2024-04-26T12:20:28.673545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:54.868104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422713+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:20:29.422713+0000","last_peered":"2024-04-26T12:20:29.422713+0000","last_clean":"2024-04-26T12:20:29.422713+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:20:29.422713+0000","last_undegraded":"2024-04-26T12:20:29.422713+0000","last_fullsized":"2024-04-26T12:20:29.422713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673502+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:28.673502+0000","last_peered":"2024-04-26T12:20:28.673502+0000","last_clean":"2024-04-26T12:20:28.673502+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:28.673502+0000","last_undegraded":"2024-04-26T12:20:28.673502+0000","last_fullsized":"2024-04-26T12:20:28.673502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:30.261523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:55.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672981+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:28.672981+0000","last_peered":"2024-04-26T12:20:28.672981+0000","last_clean":"2024-04-26T12:20:28.672981+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:28.672981+0000","last_undegraded":"2024-04-26T12:20:28.672981+0000","last_fullsized":"2024-04-26T12:20:28.672981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:24.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673427+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:28.673427+0000","last_peered":"2024-04-26T12:20:28.673427+0000","last_clean":"2024-04-26T12:20:28.673427+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:28.673427+0000","last_undegraded":"2024-04-26T12:20:28.673427+0000","last_fullsized":"2024-04-26T12:20:28.673427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423142+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:20:29.423142+0000","last_peered":"2024-04-26T12:20:29.423142+0000","last_clean":"2024-04-26T12:20:29.423142+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:29.423142+0000","last_undegraded":"2024-04-26T12:20:29.423142+0000","last_fullsized":"2024-04-26T12:20:29.423142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:47.821001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422776+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:29.422776+0000","last_peered":"2024-04-26T12:20:29.422776+0000","last_clean":"2024-04-26T12:20:29.422776+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:29.422776+0000","last_undegraded":"2024-04-26T12:20:29.422776+0000","last_fullsized":"2024-04-26T12:20:29.422776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:17.945553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422552+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:29.422552+0000","last_peered":"2024-04-26T12:20:29.422552+0000","last_clean":"2024-04-26T12:20:29.422552+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:29.422552+0000","last_undegraded":"2024-04-26T12:20:29.422552+0000","last_fullsized":"2024-04-26T12:20:29.422552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673434+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:28.673434+0000","last_peered":"2024-04-26T12:20:28.673434+0000","last_clean":"2024-04-26T12:20:28.673434+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:28.673434+0000","last_undegraded":"2024-04-26T12:20:28.673434+0000","last_fullsized":"2024-04-26T12:20:28.673434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:52.220501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673130+0000","last_change":"2024-04-26T12:20:25.658158+0000","last_active":"2024-04-26T12:20:28.673130+0000","last_peered":"2024-04-26T12:20:28.673130+0000","last_clean":"2024-04-26T12:20:28.673130+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:20:28.673130+0000","last_undegraded":"2024-04-26T12:20:28.673130+0000","last_fullsized":"2024-04-26T12:20:28.673130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:55.017516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673289+0000","last_change":"2024-04-26T12:20:25.664916+0000","last_active":"2024-04-26T12:20:28.673289+0000","last_peered":"2024-04-26T12:20:28.673289+0000","last_clean":"2024-04-26T12:20:28.673289+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:28.673289+0000","last_undegraded":"2024-04-26T12:20:28.673289+0000","last_fullsized":"2024-04-26T12:20:28.673289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:10.630467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673669+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:28.673669+0000","last_peered":"2024-04-26T12:20:28.673669+0000","last_clean":"2024-04-26T12:20:28.673669+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673669+0000","last_undegraded":"2024-04-26T12:20:28.673669+0000","last_fullsized":"2024-04-26T12:20:28.673669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423252+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:20:29.423252+0000","last_peered":"2024-04-26T12:20:29.423252+0000","last_clean":"2024-04-26T12:20:29.423252+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:29.423252+0000","last_undegraded":"2024-04-26T12:20:29.423252+0000","last_fullsized":"2024-04-26T12:20:29.423252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673295+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:28.673295+0000","last_peered":"2024-04-26T12:20:28.673295+0000","last_clean":"2024-04-26T12:20:28.673295+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:28.673295+0000","last_undegraded":"2024-04-26T12:20:28.673295+0000","last_fullsized":"2024-04-26T12:20:28.673295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673685+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:28.673685+0000","last_peered":"2024-04-26T12:20:28.673685+0000","last_clean":"2024-04-26T12:20:28.673685+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:28.673685+0000","last_undegraded":"2024-04-26T12:20:28.673685+0000","last_fullsized":"2024-04-26T12:20:28.673685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.225357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673896+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:28.673896+0000","last_peered":"2024-04-26T12:20:28.673896+0000","last_clean":"2024-04-26T12:20:28.673896+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:28.673896+0000","last_undegraded":"2024-04-26T12:20:28.673896+0000","last_fullsized":"2024-04-26T12:20:28.673896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:31.708071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422472+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:29.422472+0000","last_peered":"2024-04-26T12:20:29.422472+0000","last_clean":"2024-04-26T12:20:29.422472+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:29.422472+0000","last_undegraded":"2024-04-26T12:20:29.422472+0000","last_fullsized":"2024-04-26T12:20:29.422472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:58.603217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672548+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:28.672548+0000","last_peered":"2024-04-26T12:20:28.672548+0000","last_clean":"2024-04-26T12:20:28.672548+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:28.672548+0000","last_undegraded":"2024-04-26T12:20:28.672548+0000","last_fullsized":"2024-04-26T12:20:28.672548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:34.377929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422389+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:29.422389+0000","last_peered":"2024-04-26T12:20:29.422389+0000","last_clean":"2024-04-26T12:20:29.422389+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:29.422389+0000","last_undegraded":"2024-04-26T12:20:29.422389+0000","last_fullsized":"2024-04-26T12:20:29.422389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423356+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:29.423356+0000","last_peered":"2024-04-26T12:20:29.423356+0000","last_clean":"2024-04-26T12:20:29.423356+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:29.423356+0000","last_undegraded":"2024-04-26T12:20:29.423356+0000","last_fullsized":"2024-04-26T12:20:29.423356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:07.619412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673433+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:28.673433+0000","last_peered":"2024-04-26T12:20:28.673433+0000","last_clean":"2024-04-26T12:20:28.673433+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:28.673433+0000","last_undegraded":"2024-04-26T12:20:28.673433+0000","last_fullsized":"2024-04-26T12:20:28.673433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:18.666244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673765+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:28.673765+0000","last_peered":"2024-04-26T12:20:28.673765+0000","last_clean":"2024-04-26T12:20:28.673765+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:28.673765+0000","last_undegraded":"2024-04-26T12:20:28.673765+0000","last_fullsized":"2024-04-26T12:20:28.673765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:39.629549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423064+0000","last_change":"2024-04-26T12:20:25.665113+0000","last_active":"2024-04-26T12:20:29.423064+0000","last_peered":"2024-04-26T12:20:29.423064+0000","last_clean":"2024-04-26T12:20:29.423064+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:29.423064+0000","last_undegraded":"2024-04-26T12:20:29.423064+0000","last_fullsized":"2024-04-26T12:20:29.423064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:47.401100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672985+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:28.672985+0000","last_peered":"2024-04-26T12:20:28.672985+0000","last_clean":"2024-04-26T12:20:28.672985+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:28.672985+0000","last_undegraded":"2024-04-26T12:20:28.672985+0000","last_fullsized":"2024-04-26T12:20:28.672985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422843+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:29.422843+0000","last_peered":"2024-04-26T12:20:29.422843+0000","last_clean":"2024-04-26T12:20:29.422843+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:29.422843+0000","last_undegraded":"2024-04-26T12:20:29.422843+0000","last_fullsized":"2024-04-26T12:20:29.422843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.807141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672610+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:28.672610+0000","last_peered":"2024-04-26T12:20:28.672610+0000","last_clean":"2024-04-26T12:20:28.672610+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:28.672610+0000","last_undegraded":"2024-04-26T12:20:28.672610+0000","last_fullsized":"2024-04-26T12:20:28.672610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672844+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:28.672844+0000","last_peered":"2024-04-26T12:20:28.672844+0000","last_clean":"2024-04-26T12:20:28.672844+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:28.672844+0000","last_undegraded":"2024-04-26T12:20:28.672844+0000","last_fullsized":"2024-04-26T12:20:28.672844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:27.038124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422911+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:20:29.422911+0000","last_peered":"2024-04-26T12:20:29.422911+0000","last_clean":"2024-04-26T12:20:29.422911+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:20:29.422911+0000","last_undegraded":"2024-04-26T12:20:29.422911+0000","last_fullsized":"2024-04-26T12:20:29.422911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673469+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:28.673469+0000","last_peered":"2024-04-26T12:20:28.673469+0000","last_clean":"2024-04-26T12:20:28.673469+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:28.673469+0000","last_undegraded":"2024-04-26T12:20:28.673469+0000","last_fullsized":"2024-04-26T12:20:28.673469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:02.210041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423117+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:20:29.423117+0000","last_peered":"2024-04-26T12:20:29.423117+0000","last_clean":"2024-04-26T12:20:29.423117+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:29.423117+0000","last_undegraded":"2024-04-26T12:20:29.423117+0000","last_fullsized":"2024-04-26T12:20:29.423117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672907+0000","last_change":"2024-04-26T12:20:25.659060+0000","last_active":"2024-04-26T12:20:28.672907+0000","last_peered":"2024-04-26T12:20:28.672907+0000","last_clean":"2024-04-26T12:20:28.672907+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:28.672907+0000","last_undegraded":"2024-04-26T12:20:28.672907+0000","last_fullsized":"2024-04-26T12:20:28.672907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:23.462778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673599+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:28.673599+0000","last_peered":"2024-04-26T12:20:28.673599+0000","last_clean":"2024-04-26T12:20:28.673599+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:28.673599+0000","last_undegraded":"2024-04-26T12:20:28.673599+0000","last_fullsized":"2024-04-26T12:20:28.673599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:42.068061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422634+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:29.422634+0000","last_peered":"2024-04-26T12:20:29.422634+0000","last_clean":"2024-04-26T12:20:29.422634+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:29.422634+0000","last_undegraded":"2024-04-26T12:20:29.422634+0000","last_fullsized":"2024-04-26T12:20:29.422634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:33.454616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673440+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:28.673440+0000","last_peered":"2024-04-26T12:20:28.673440+0000","last_clean":"2024-04-26T12:20:28.673440+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:28.673440+0000","last_undegraded":"2024-04-26T12:20:28.673440+0000","last_fullsized":"2024-04-26T12:20:28.673440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:34.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672867+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:28.672867+0000","last_peered":"2024-04-26T12:20:28.672867+0000","last_clean":"2024-04-26T12:20:28.672867+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:28.672867+0000","last_undegraded":"2024-04-26T12:20:28.672867+0000","last_fullsized":"2024-04-26T12:20:28.672867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:27.283599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.209742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422375+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:29.422375+0000","last_peered":"2024-04-26T12:20:29.422375+0000","last_clean":"2024-04-26T12:20:29.422375+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:29.422375+0000","last_undegraded":"2024-04-26T12:20:29.422375+0000","last_fullsized":"2024-04-26T12:20:29.422375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:57.793936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423352+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:29.423352+0000","last_peered":"2024-04-26T12:20:29.423352+0000","last_clean":"2024-04-26T12:20:29.423352+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:29.423352+0000","last_undegraded":"2024-04-26T12:20:29.423352+0000","last_fullsized":"2024-04-26T12:20:29.423352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:51.515487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422363+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:29.422363+0000","last_peered":"2024-04-26T12:20:29.422363+0000","last_clean":"2024-04-26T12:20:29.422363+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:29.422363+0000","last_undegraded":"2024-04-26T12:20:29.422363+0000","last_fullsized":"2024-04-26T12:20:29.422363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:16.407869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673570+0000","last_change":"2024-04-26T12:20:25.663801+0000","last_active":"2024-04-26T12:20:28.673570+0000","last_peered":"2024-04-26T12:20:28.673570+0000","last_clean":"2024-04-26T12:20:28.673570+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:28.673570+0000","last_undegraded":"2024-04-26T12:20:28.673570+0000","last_fullsized":"2024-04-26T12:20:28.673570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:34.758119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673579+0000","last_change":"2024-04-26T12:20:25.663958+0000","last_active":"2024-04-26T12:20:28.673579+0000","last_peered":"2024-04-26T12:20:28.673579+0000","last_clean":"2024-04-26T12:20:28.673579+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:28.673579+0000","last_undegraded":"2024-04-26T12:20:28.673579+0000","last_fullsized":"2024-04-26T12:20:28.673579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:55.763498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673040+0000","last_change":"2024-04-26T12:20:25.658968+0000","last_active":"2024-04-26T12:20:28.673040+0000","last_peered":"2024-04-26T12:20:28.673040+0000","last_clean":"2024-04-26T12:20:28.673040+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:28.673040+0000","last_undegraded":"2024-04-26T12:20:28.673040+0000","last_fullsized":"2024-04-26T12:20:28.673040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:59.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673145+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:28.673145+0000","last_peered":"2024-04-26T12:20:28.673145+0000","last_clean":"2024-04-26T12:20:28.673145+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:28.673145+0000","last_undegraded":"2024-04-26T12:20:28.673145+0000","last_fullsized":"2024-04-26T12:20:28.673145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:48.149555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673934+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:28.673934+0000","last_peered":"2024-04-26T12:20:28.673934+0000","last_clean":"2024-04-26T12:20:28.673934+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:28.673934+0000","last_undegraded":"2024-04-26T12:20:28.673934+0000","last_fullsized":"2024-04-26T12:20:28.673934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:07.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673055+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:28.673055+0000","last_peered":"2024-04-26T12:20:28.673055+0000","last_clean":"2024-04-26T12:20:28.673055+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:28.673055+0000","last_undegraded":"2024-04-26T12:20:28.673055+0000","last_fullsized":"2024-04-26T12:20:28.673055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:43.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.665885+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:54.789896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422569+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:29.422569+0000","last_peered":"2024-04-26T12:20:29.422569+0000","last_clean":"2024-04-26T12:20:29.422569+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422569+0000","last_undegraded":"2024-04-26T12:20:29.422569+0000","last_fullsized":"2024-04-26T12:20:29.422569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:28.598257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.674018+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:28.674018+0000","last_peered":"2024-04-26T12:20:28.674018+0000","last_clean":"2024-04-26T12:20:28.674018+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:28.674018+0000","last_undegraded":"2024-04-26T12:20:28.674018+0000","last_fullsized":"2024-04-26T12:20:28.674018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.969416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422582+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:29.422582+0000","last_peered":"2024-04-26T12:20:29.422582+0000","last_clean":"2024-04-26T12:20:29.422582+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:29.422582+0000","last_undegraded":"2024-04-26T12:20:29.422582+0000","last_fullsized":"2024-04-26T12:20:29.422582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673506+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:20:28.673506+0000","last_peered":"2024-04-26T12:20:28.673506+0000","last_clean":"2024-04-26T12:20:28.673506+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:28.673506+0000","last_undegraded":"2024-04-26T12:20:28.673506+0000","last_fullsized":"2024-04-26T12:20:28.673506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672738+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:28.672738+0000","last_peered":"2024-04-26T12:20:28.672738+0000","last_clean":"2024-04-26T12:20:28.672738+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:28.672738+0000","last_undegraded":"2024-04-26T12:20:28.672738+0000","last_fullsized":"2024-04-26T12:20:28.672738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:21.176687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673105+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:28.673105+0000","last_peered":"2024-04-26T12:20:28.673105+0000","last_clean":"2024-04-26T12:20:28.673105+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:28.673105+0000","last_undegraded":"2024-04-26T12:20:28.673105+0000","last_fullsized":"2024-04-26T12:20:28.673105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.367763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673044+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:28.673044+0000","last_peered":"2024-04-26T12:20:28.673044+0000","last_clean":"2024-04-26T12:20:28.673044+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:28.673044+0000","last_undegraded":"2024-04-26T12:20:28.673044+0000","last_fullsized":"2024-04-26T12:20:28.673044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673730+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:28.673730+0000","last_peered":"2024-04-26T12:20:28.673730+0000","last_clean":"2024-04-26T12:20:28.673730+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:28.673730+0000","last_undegraded":"2024-04-26T12:20:28.673730+0000","last_fullsized":"2024-04-26T12:20:28.673730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:40.929552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673133+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:28.673133+0000","last_peered":"2024-04-26T12:20:28.673133+0000","last_clean":"2024-04-26T12:20:28.673133+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:28.673133+0000","last_undegraded":"2024-04-26T12:20:28.673133+0000","last_fullsized":"2024-04-26T12:20:28.673133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:22.695257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672781+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:28.672781+0000","last_peered":"2024-04-26T12:20:28.672781+0000","last_clean":"2024-04-26T12:20:28.672781+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:28.672781+0000","last_undegraded":"2024-04-26T12:20:28.672781+0000","last_fullsized":"2024-04-26T12:20:28.672781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:56.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423141+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:29.423141+0000","last_peered":"2024-04-26T12:20:29.423141+0000","last_clean":"2024-04-26T12:20:29.423141+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:29.423141+0000","last_undegraded":"2024-04-26T12:20:29.423141+0000","last_fullsized":"2024-04-26T12:20:29.423141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672912+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:28.672912+0000","last_peered":"2024-04-26T12:20:28.672912+0000","last_clean":"2024-04-26T12:20:28.672912+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:28.672912+0000","last_undegraded":"2024-04-26T12:20:28.672912+0000","last_fullsized":"2024-04-26T12:20:28.672912+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422741+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:29.422741+0000","last_peered":"2024-04-26T12:20:29.422741+0000","last_clean":"2024-04-26T12:20:29.422741+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422741+0000","last_undegraded":"2024-04-26T12:20:29.422741+0000","last_fullsized":"2024-04-26T12:20:29.422741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:47.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673527+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:20:28.673527+0000","last_peered":"2024-04-26T12:20:28.673527+0000","last_clean":"2024-04-26T12:20:28.673527+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673527+0000","last_undegraded":"2024-04-26T12:20:28.673527+0000","last_fullsized":"2024-04-26T12:20:28.673527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672986+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:28.672986+0000","last_peered":"2024-04-26T12:20:28.672986+0000","last_clean":"2024-04-26T12:20:28.672986+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:28.672986+0000","last_undegraded":"2024-04-26T12:20:28.672986+0000","last_fullsized":"2024-04-26T12:20:28.672986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:30.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673218+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:28.673218+0000","last_peered":"2024-04-26T12:20:28.673218+0000","last_clean":"2024-04-26T12:20:28.673218+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:28.673218+0000","last_undegraded":"2024-04-26T12:20:28.673218+0000","last_fullsized":"2024-04-26T12:20:28.673218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:00.363391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673325+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:20:28.673325+0000","last_peered":"2024-04-26T12:20:28.673325+0000","last_clean":"2024-04-26T12:20:28.673325+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:28.673325+0000","last_undegraded":"2024-04-26T12:20:28.673325+0000","last_fullsized":"2024-04-26T12:20:28.673325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673402+0000","last_change":"2024-04-26T12:20:25.664519+0000","last_active":"2024-04-26T12:20:28.673402+0000","last_peered":"2024-04-26T12:20:28.673402+0000","last_clean":"2024-04-26T12:20:28.673402+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:20:28.673402+0000","last_undegraded":"2024-04-26T12:20:28.673402+0000","last_fullsized":"2024-04-26T12:20:28.673402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.722939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673432+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:28.673432+0000","last_peered":"2024-04-26T12:20:28.673432+0000","last_clean":"2024-04-26T12:20:28.673432+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:28.673432+0000","last_undegraded":"2024-04-26T12:20:28.673432+0000","last_fullsized":"2024-04-26T12:20:28.673432+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422524+0000","last_change":"2024-04-26T12:20:25.659186+0000","last_active":"2024-04-26T12:20:29.422524+0000","last_peered":"2024-04-26T12:20:29.422524+0000","last_clean":"2024-04-26T12:20:29.422524+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:29.422524+0000","last_undegraded":"2024-04-26T12:20:29.422524+0000","last_fullsized":"2024-04-26T12:20:29.422524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:07.818179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673359+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:20:28.673359+0000","last_peered":"2024-04-26T12:20:28.673359+0000","last_clean":"2024-04-26T12:20:28.673359+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:20:28.673359+0000","last_undegraded":"2024-04-26T12:20:28.673359+0000","last_fullsized":"2024-04-26T12:20:28.673359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423388+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:29.423388+0000","last_peered":"2024-04-26T12:20:29.423388+0000","last_clean":"2024-04-26T12:20:29.423388+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:29.423388+0000","last_undegraded":"2024-04-26T12:20:29.423388+0000","last_fullsized":"2024-04-26T12:20:29.423388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422694+0000","last_change":"2024-04-26T12:20:25.659917+0000","last_active":"2024-04-26T12:20:29.422694+0000","last_peered":"2024-04-26T12:20:29.422694+0000","last_clean":"2024-04-26T12:20:29.422694+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:20:29.422694+0000","last_undegraded":"2024-04-26T12:20:29.422694+0000","last_fullsized":"2024-04-26T12:20:29.422694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:34.505551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673690+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:28.673690+0000","last_peered":"2024-04-26T12:20:28.673690+0000","last_clean":"2024-04-26T12:20:28.673690+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:28.673690+0000","last_undegraded":"2024-04-26T12:20:28.673690+0000","last_fullsized":"2024-04-26T12:20:28.673690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673666+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:28.673666+0000","last_peered":"2024-04-26T12:20:28.673666+0000","last_clean":"2024-04-26T12:20:28.673666+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:28.673666+0000","last_undegraded":"2024-04-26T12:20:28.673666+0000","last_fullsized":"2024-04-26T12:20:28.673666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672759+0000","last_change":"2024-04-26T12:20:25.658800+0000","last_active":"2024-04-26T12:20:28.672759+0000","last_peered":"2024-04-26T12:20:28.672759+0000","last_clean":"2024-04-26T12:20:28.672759+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:28.672759+0000","last_undegraded":"2024-04-26T12:20:28.672759+0000","last_fullsized":"2024-04-26T12:20:28.672759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:22.287193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673658+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:28.673658+0000","last_peered":"2024-04-26T12:20:28.673658+0000","last_clean":"2024-04-26T12:20:28.673658+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:28.673658+0000","last_undegraded":"2024-04-26T12:20:28.673658+0000","last_fullsized":"2024-04-26T12:20:28.673658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:10.121046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673823+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:28.673823+0000","last_peered":"2024-04-26T12:20:28.673823+0000","last_clean":"2024-04-26T12:20:28.673823+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:28.673823+0000","last_undegraded":"2024-04-26T12:20:28.673823+0000","last_fullsized":"2024-04-26T12:20:28.673823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:23.294093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422374+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:29.422374+0000","last_peered":"2024-04-26T12:20:29.422374+0000","last_clean":"2024-04-26T12:20:29.422374+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:29.422374+0000","last_undegraded":"2024-04-26T12:20:29.422374+0000","last_fullsized":"2024-04-26T12:20:29.422374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:22.842329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673624+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:28.673624+0000","last_peered":"2024-04-26T12:20:28.673624+0000","last_clean":"2024-04-26T12:20:28.673624+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:28.673624+0000","last_undegraded":"2024-04-26T12:20:28.673624+0000","last_fullsized":"2024-04-26T12:20:28.673624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:22.219973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:56.257240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672799+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:20:28.672799+0000","last_peered":"2024-04-26T12:20:28.672799+0000","last_clean":"2024-04-26T12:20:28.672799+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:20:28.672799+0000","last_undegraded":"2024-04-26T12:20:28.672799+0000","last_fullsized":"2024-04-26T12:20:28.672799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423272+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:29.423272+0000","last_peered":"2024-04-26T12:20:29.423272+0000","last_clean":"2024-04-26T12:20:29.423272+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:29.423272+0000","last_undegraded":"2024-04-26T12:20:29.423272+0000","last_fullsized":"2024-04-26T12:20:29.423272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.194671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673846+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:28.673846+0000","last_peered":"2024-04-26T12:20:28.673846+0000","last_clean":"2024-04-26T12:20:28.673846+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:28.673846+0000","last_undegraded":"2024-04-26T12:20:28.673846+0000","last_fullsized":"2024-04-26T12:20:28.673846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:41.999607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672646+0000","last_change":"2024-04-26T12:20:25.658549+0000","last_active":"2024-04-26T12:20:28.672646+0000","last_peered":"2024-04-26T12:20:28.672646+0000","last_clean":"2024-04-26T12:20:28.672646+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:28.672646+0000","last_undegraded":"2024-04-26T12:20:28.672646+0000","last_fullsized":"2024-04-26T12:20:28.672646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:26.372988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.658453+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:25.063788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672741+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:20:28.672741+0000","last_peered":"2024-04-26T12:20:28.672741+0000","last_clean":"2024-04-26T12:20:28.672741+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:28.672741+0000","last_undegraded":"2024-04-26T12:20:28.672741+0000","last_fullsized":"2024-04-26T12:20:28.672741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423415+0000","last_change":"2024-04-26T12:20:25.664482+0000","last_active":"2024-04-26T12:20:29.423415+0000","last_peered":"2024-04-26T12:20:29.423415+0000","last_clean":"2024-04-26T12:20:29.423415+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:29.423415+0000","last_undegraded":"2024-04-26T12:20:29.423415+0000","last_fullsized":"2024-04-26T12:20:29.423415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:15.256206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672847+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:28.672847+0000","last_peered":"2024-04-26T12:20:28.672847+0000","last_clean":"2024-04-26T12:20:28.672847+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:28.672847+0000","last_undegraded":"2024-04-26T12:20:28.672847+0000","last_fullsized":"2024-04-26T12:20:28.672847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673444+0000","last_change":"2024-04-26T12:20:25.659459+0000","last_active":"2024-04-26T12:20:28.673444+0000","last_peered":"2024-04-26T12:20:28.673444+0000","last_clean":"2024-04-26T12:20:28.673444+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:28.673444+0000","last_undegraded":"2024-04-26T12:20:28.673444+0000","last_fullsized":"2024-04-26T12:20:28.673444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:08.246812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672776+0000","last_change":"2024-04-26T12:20:25.659064+0000","last_active":"2024-04-26T12:20:28.672776+0000","last_peered":"2024-04-26T12:20:28.672776+0000","last_clean":"2024-04-26T12:20:28.672776+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:20:28.672776+0000","last_undegraded":"2024-04-26T12:20:28.672776+0000","last_fullsized":"2024-04-26T12:20:28.672776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:46.130193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423024+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:29.423024+0000","last_peered":"2024-04-26T12:20:29.423024+0000","last_clean":"2024-04-26T12:20:29.423024+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:29.423024+0000","last_undegraded":"2024-04-26T12:20:29.423024+0000","last_fullsized":"2024-04-26T12:20:29.423024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:37.387665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422819+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:29.422819+0000","last_peered":"2024-04-26T12:20:29.422819+0000","last_clean":"2024-04-26T12:20:29.422819+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:29.422819+0000","last_undegraded":"2024-04-26T12:20:29.422819+0000","last_fullsized":"2024-04-26T12:20:29.422819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422926+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:29.422926+0000","last_peered":"2024-04-26T12:20:29.422926+0000","last_clean":"2024-04-26T12:20:29.422926+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:29.422926+0000","last_undegraded":"2024-04-26T12:20:29.422926+0000","last_fullsized":"2024-04-26T12:20:29.422926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422854+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:29.422854+0000","last_peered":"2024-04-26T12:20:29.422854+0000","last_clean":"2024-04-26T12:20:29.422854+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:29.422854+0000","last_undegraded":"2024-04-26T12:20:29.422854+0000","last_fullsized":"2024-04-26T12:20:29.422854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:48.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673793+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:28.673793+0000","last_peered":"2024-04-26T12:20:28.673793+0000","last_clean":"2024-04-26T12:20:28.673793+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:28.673793+0000","last_undegraded":"2024-04-26T12:20:28.673793+0000","last_fullsized":"2024-04-26T12:20:28.673793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:42.215211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673302+0000","last_change":"2024-04-26T12:20:25.661093+0000","last_active":"2024-04-26T12:20:28.673302+0000","last_peered":"2024-04-26T12:20:28.673302+0000","last_clean":"2024-04-26T12:20:28.673302+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:20:28.673302+0000","last_undegraded":"2024-04-26T12:20:28.673302+0000","last_fullsized":"2024-04-26T12:20:28.673302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:42.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673207+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:28.673207+0000","last_peered":"2024-04-26T12:20:28.673207+0000","last_clean":"2024-04-26T12:20:28.673207+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:28.673207+0000","last_undegraded":"2024-04-26T12:20:28.673207+0000","last_fullsized":"2024-04-26T12:20:28.673207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:09.557685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423130+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:29.423130+0000","last_peered":"2024-04-26T12:20:29.423130+0000","last_clean":"2024-04-26T12:20:29.423130+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:29.423130+0000","last_undegraded":"2024-04-26T12:20:29.423130+0000","last_fullsized":"2024-04-26T12:20:29.423130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:12.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422739+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:29.422739+0000","last_peered":"2024-04-26T12:20:29.422739+0000","last_clean":"2024-04-26T12:20:29.422739+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:29.422739+0000","last_undegraded":"2024-04-26T12:20:29.422739+0000","last_fullsized":"2024-04-26T12:20:29.422739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673561+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:20:28.673561+0000","last_peered":"2024-04-26T12:20:28.673561+0000","last_clean":"2024-04-26T12:20:28.673561+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:28.673561+0000","last_undegraded":"2024-04-26T12:20:28.673561+0000","last_fullsized":"2024-04-26T12:20:28.673561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673220+0000","last_change":"2024-04-26T12:20:25.665062+0000","last_active":"2024-04-26T12:20:28.673220+0000","last_peered":"2024-04-26T12:20:28.673220+0000","last_clean":"2024-04-26T12:20:28.673220+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:28.673220+0000","last_undegraded":"2024-04-26T12:20:28.673220+0000","last_fullsized":"2024-04-26T12:20:28.673220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:01.241012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673566+0000","last_change":"2024-04-26T12:20:25.658932+0000","last_active":"2024-04-26T12:20:28.673566+0000","last_peered":"2024-04-26T12:20:28.673566+0000","last_clean":"2024-04-26T12:20:28.673566+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:28.673566+0000","last_undegraded":"2024-04-26T12:20:28.673566+0000","last_fullsized":"2024-04-26T12:20:28.673566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:37.375332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321304,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050536,"statfs":{"total":96636764160,"available":96307748864,"internally_reserved":0,"allocated":1454080,"data_stored":928586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:19:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.42499999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.60999999999999999,"5min":0.871,"15min":0.871},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.41899999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.58899999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579907,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29996,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341844,"statfs":{"total":96636764160,"available":96606048256,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483156,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888684,"statfs":{"total":96636764160,"available":96142012416,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.371,"5min":0.161,"15min":0.161},"max":{"1min":0.57099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.39300000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.68500000000000005,"5min":0.879,"15min":0.879},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:20:31.126 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:20:31.443 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:31.444 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:20:31.453 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T12:20:30.519337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834456,"kb_used_data":3692,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281064,"statfs":{"total":289910292480,"available":289055809536,"internally_reserved":0,"allocated":3780608,"data_stored":2205469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423367+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:29.423367+0000","last_peered":"2024-04-26T12:20:29.423367+0000","last_clean":"2024-04-26T12:20:29.423367+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:29.423367+0000","last_undegraded":"2024-04-26T12:20:29.423367+0000","last_fullsized":"2024-04-26T12:20:29.423367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423011+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:29.423011+0000","last_peered":"2024-04-26T12:20:29.423011+0000","last_clean":"2024-04-26T12:20:29.423011+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:29.423011+0000","last_undegraded":"2024-04-26T12:20:29.423011+0000","last_fullsized":"2024-04-26T12:20:29.423011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673852+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:28.673852+0000","last_peered":"2024-04-26T12:20:28.673852+0000","last_clean":"2024-04-26T12:20:28.673852+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:28.673852+0000","last_undegraded":"2024-04-26T12:20:28.673852+0000","last_fullsized":"2024-04-26T12:20:28.673852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:51.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673545+0000","last_change":"2024-04-26T12:20:25.662260+0000","last_active":"2024-04-26T12:20:28.673545+0000","last_peered":"2024-04-26T12:20:28.673545+0000","last_clean":"2024-04-26T12:20:28.673545+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:28.673545+0000","last_undegraded":"2024-04-26T12:20:28.673545+0000","last_fullsized":"2024-04-26T12:20:28.673545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:54.868104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422713+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:20:29.422713+0000","last_peered":"2024-04-26T12:20:29.422713+0000","last_clean":"2024-04-26T12:20:29.422713+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:20:29.422713+0000","last_undegraded":"2024-04-26T12:20:29.422713+0000","last_fullsized":"2024-04-26T12:20:29.422713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673502+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:28.673502+0000","last_peered":"2024-04-26T12:20:28.673502+0000","last_clean":"2024-04-26T12:20:28.673502+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:28.673502+0000","last_undegraded":"2024-04-26T12:20:28.673502+0000","last_fullsized":"2024-04-26T12:20:28.673502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:30.261523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:55.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672981+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:28.672981+0000","last_peered":"2024-04-26T12:20:28.672981+0000","last_clean":"2024-04-26T12:20:28.672981+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:28.672981+0000","last_undegraded":"2024-04-26T12:20:28.672981+0000","last_fullsized":"2024-04-26T12:20:28.672981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:24.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673427+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:28.673427+0000","last_peered":"2024-04-26T12:20:28.673427+0000","last_clean":"2024-04-26T12:20:28.673427+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:28.673427+0000","last_undegraded":"2024-04-26T12:20:28.673427+0000","last_fullsized":"2024-04-26T12:20:28.673427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423142+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:20:29.423142+0000","last_peered":"2024-04-26T12:20:29.423142+0000","last_clean":"2024-04-26T12:20:29.423142+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:29.423142+0000","last_undegraded":"2024-04-26T12:20:29.423142+0000","last_fullsized":"2024-04-26T12:20:29.423142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:47.821001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422776+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:29.422776+0000","last_peered":"2024-04-26T12:20:29.422776+0000","last_clean":"2024-04-26T12:20:29.422776+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:29.422776+0000","last_undegraded":"2024-04-26T12:20:29.422776+0000","last_fullsized":"2024-04-26T12:20:29.422776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:17.945553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422552+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:29.422552+0000","last_peered":"2024-04-26T12:20:29.422552+0000","last_clean":"2024-04-26T12:20:29.422552+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:29.422552+0000","last_undegraded":"2024-04-26T12:20:29.422552+0000","last_fullsized":"2024-04-26T12:20:29.422552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673434+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:28.673434+0000","last_peered":"2024-04-26T12:20:28.673434+0000","last_clean":"2024-04-26T12:20:28.673434+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:28.673434+0000","last_undegraded":"2024-04-26T12:20:28.673434+0000","last_fullsized":"2024-04-26T12:20:28.673434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:52.220501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673130+0000","last_change":"2024-04-26T12:20:25.658158+0000","last_active":"2024-04-26T12:20:28.673130+0000","last_peered":"2024-04-26T12:20:28.673130+0000","last_clean":"2024-04-26T12:20:28.673130+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:20:28.673130+0000","last_undegraded":"2024-04-26T12:20:28.673130+0000","last_fullsized":"2024-04-26T12:20:28.673130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:55.017516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673289+0000","last_change":"2024-04-26T12:20:25.664916+0000","last_active":"2024-04-26T12:20:28.673289+0000","last_peered":"2024-04-26T12:20:28.673289+0000","last_clean":"2024-04-26T12:20:28.673289+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:28.673289+0000","last_undegraded":"2024-04-26T12:20:28.673289+0000","last_fullsized":"2024-04-26T12:20:28.673289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:10.630467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673669+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:28.673669+0000","last_peered":"2024-04-26T12:20:28.673669+0000","last_clean":"2024-04-26T12:20:28.673669+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673669+0000","last_undegraded":"2024-04-26T12:20:28.673669+0000","last_fullsized":"2024-04-26T12:20:28.673669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423252+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:20:29.423252+0000","last_peered":"2024-04-26T12:20:29.423252+0000","last_clean":"2024-04-26T12:20:29.423252+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:29.423252+0000","last_undegraded":"2024-04-26T12:20:29.423252+0000","last_fullsized":"2024-04-26T12:20:29.423252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673295+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:28.673295+0000","last_peered":"2024-04-26T12:20:28.673295+0000","last_clean":"2024-04-26T12:20:28.673295+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:28.673295+0000","last_undegraded":"2024-04-26T12:20:28.673295+0000","last_fullsized":"2024-04-26T12:20:28.673295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673685+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:28.673685+0000","last_peered":"2024-04-26T12:20:28.673685+0000","last_clean":"2024-04-26T12:20:28.673685+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:28.673685+0000","last_undegraded":"2024-04-26T12:20:28.673685+0000","last_fullsized":"2024-04-26T12:20:28.673685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.225357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673896+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:28.673896+0000","last_peered":"2024-04-26T12:20:28.673896+0000","last_clean":"2024-04-26T12:20:28.673896+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:28.673896+0000","last_undegraded":"2024-04-26T12:20:28.673896+0000","last_fullsized":"2024-04-26T12:20:28.673896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:31.708071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422472+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:29.422472+0000","last_peered":"2024-04-26T12:20:29.422472+0000","last_clean":"2024-04-26T12:20:29.422472+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:29.422472+0000","last_undegraded":"2024-04-26T12:20:29.422472+0000","last_fullsized":"2024-04-26T12:20:29.422472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:58.603217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672548+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:28.672548+0000","last_peered":"2024-04-26T12:20:28.672548+0000","last_clean":"2024-04-26T12:20:28.672548+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:28.672548+0000","last_undegraded":"2024-04-26T12:20:28.672548+0000","last_fullsized":"2024-04-26T12:20:28.672548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:34.377929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422389+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:29.422389+0000","last_peered":"2024-04-26T12:20:29.422389+0000","last_clean":"2024-04-26T12:20:29.422389+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:29.422389+0000","last_undegraded":"2024-04-26T12:20:29.422389+0000","last_fullsized":"2024-04-26T12:20:29.422389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423356+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:29.423356+0000","last_peered":"2024-04-26T12:20:29.423356+0000","last_clean":"2024-04-26T12:20:29.423356+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:29.423356+0000","last_undegraded":"2024-04-26T12:20:29.423356+0000","last_fullsized":"2024-04-26T12:20:29.423356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:07.619412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673433+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:28.673433+0000","last_peered":"2024-04-26T12:20:28.673433+0000","last_clean":"2024-04-26T12:20:28.673433+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:28.673433+0000","last_undegraded":"2024-04-26T12:20:28.673433+0000","last_fullsized":"2024-04-26T12:20:28.673433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:18.666244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673765+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:28.673765+0000","last_peered":"2024-04-26T12:20:28.673765+0000","last_clean":"2024-04-26T12:20:28.673765+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:28.673765+0000","last_undegraded":"2024-04-26T12:20:28.673765+0000","last_fullsized":"2024-04-26T12:20:28.673765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:39.629549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423064+0000","last_change":"2024-04-26T12:20:25.665113+0000","last_active":"2024-04-26T12:20:29.423064+0000","last_peered":"2024-04-26T12:20:29.423064+0000","last_clean":"2024-04-26T12:20:29.423064+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:29.423064+0000","last_undegraded":"2024-04-26T12:20:29.423064+0000","last_fullsized":"2024-04-26T12:20:29.423064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:47.401100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672985+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:28.672985+0000","last_peered":"2024-04-26T12:20:28.672985+0000","last_clean":"2024-04-26T12:20:28.672985+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:28.672985+0000","last_undegraded":"2024-04-26T12:20:28.672985+0000","last_fullsized":"2024-04-26T12:20:28.672985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422843+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:29.422843+0000","last_peered":"2024-04-26T12:20:29.422843+0000","last_clean":"2024-04-26T12:20:29.422843+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:29.422843+0000","last_undegraded":"2024-04-26T12:20:29.422843+0000","last_fullsized":"2024-04-26T12:20:29.422843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.807141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672610+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:28.672610+0000","last_peered":"2024-04-26T12:20:28.672610+0000","last_clean":"2024-04-26T12:20:28.672610+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:28.672610+0000","last_undegraded":"2024-04-26T12:20:28.672610+0000","last_fullsized":"2024-04-26T12:20:28.672610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672844+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:28.672844+0000","last_peered":"2024-04-26T12:20:28.672844+0000","last_clean":"2024-04-26T12:20:28.672844+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:28.672844+0000","last_undegraded":"2024-04-26T12:20:28.672844+0000","last_fullsized":"2024-04-26T12:20:28.672844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:27.038124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422911+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:20:29.422911+0000","last_peered":"2024-04-26T12:20:29.422911+0000","last_clean":"2024-04-26T12:20:29.422911+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:20:29.422911+0000","last_undegraded":"2024-04-26T12:20:29.422911+0000","last_fullsized":"2024-04-26T12:20:29.422911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673469+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:28.673469+0000","last_peered":"2024-04-26T12:20:28.673469+0000","last_clean":"2024-04-26T12:20:28.673469+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:28.673469+0000","last_undegraded":"2024-04-26T12:20:28.673469+0000","last_fullsized":"2024-04-26T12:20:28.673469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:02.210041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423117+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:20:29.423117+0000","last_peered":"2024-04-26T12:20:29.423117+0000","last_clean":"2024-04-26T12:20:29.423117+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:29.423117+0000","last_undegraded":"2024-04-26T12:20:29.423117+0000","last_fullsized":"2024-04-26T12:20:29.423117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672907+0000","last_change":"2024-04-26T12:20:25.659060+0000","last_active":"2024-04-26T12:20:28.672907+0000","last_peered":"2024-04-26T12:20:28.672907+0000","last_clean":"2024-04-26T12:20:28.672907+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:28.672907+0000","last_undegraded":"2024-04-26T12:20:28.672907+0000","last_fullsized":"2024-04-26T12:20:28.672907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:23.462778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673599+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:28.673599+0000","last_peered":"2024-04-26T12:20:28.673599+0000","last_clean":"2024-04-26T12:20:28.673599+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:28.673599+0000","last_undegraded":"2024-04-26T12:20:28.673599+0000","last_fullsized":"2024-04-26T12:20:28.673599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:42.068061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422634+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:29.422634+0000","last_peered":"2024-04-26T12:20:29.422634+0000","last_clean":"2024-04-26T12:20:29.422634+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:29.422634+0000","last_undegraded":"2024-04-26T12:20:29.422634+0000","last_fullsized":"2024-04-26T12:20:29.422634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:33.454616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673440+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:28.673440+0000","last_peered":"2024-04-26T12:20:28.673440+0000","last_clean":"2024-04-26T12:20:28.673440+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:28.673440+0000","last_undegraded":"2024-04-26T12:20:28.673440+0000","last_fullsized":"2024-04-26T12:20:28.673440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:34.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672867+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:28.672867+0000","last_peered":"2024-04-26T12:20:28.672867+0000","last_clean":"2024-04-26T12:20:28.672867+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:28.672867+0000","last_undegraded":"2024-04-26T12:20:28.672867+0000","last_fullsized":"2024-04-26T12:20:28.672867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:27.283599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.209742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422375+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:29.422375+0000","last_peered":"2024-04-26T12:20:29.422375+0000","last_clean":"2024-04-26T12:20:29.422375+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:29.422375+0000","last_undegraded":"2024-04-26T12:20:29.422375+0000","last_fullsized":"2024-04-26T12:20:29.422375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:57.793936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423352+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:29.423352+0000","last_peered":"2024-04-26T12:20:29.423352+0000","last_clean":"2024-04-26T12:20:29.423352+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:29.423352+0000","last_undegraded":"2024-04-26T12:20:29.423352+0000","last_fullsized":"2024-04-26T12:20:29.423352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:51.515487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422363+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:29.422363+0000","last_peered":"2024-04-26T12:20:29.422363+0000","last_clean":"2024-04-26T12:20:29.422363+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:29.422363+0000","last_undegraded":"2024-04-26T12:20:29.422363+0000","last_fullsized":"2024-04-26T12:20:29.422363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:16.407869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673570+0000","last_change":"2024-04-26T12:20:25.663801+0000","last_active":"2024-04-26T12:20:28.673570+0000","last_peered":"2024-04-26T12:20:28.673570+0000","last_clean":"2024-04-26T12:20:28.673570+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:28.673570+0000","last_undegraded":"2024-04-26T12:20:28.673570+0000","last_fullsized":"2024-04-26T12:20:28.673570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:34.758119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673579+0000","last_change":"2024-04-26T12:20:25.663958+0000","last_active":"2024-04-26T12:20:28.673579+0000","last_peered":"2024-04-26T12:20:28.673579+0000","last_clean":"2024-04-26T12:20:28.673579+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:28.673579+0000","last_undegraded":"2024-04-26T12:20:28.673579+0000","last_fullsized":"2024-04-26T12:20:28.673579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:55.763498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673040+0000","last_change":"2024-04-26T12:20:25.658968+0000","last_active":"2024-04-26T12:20:28.673040+0000","last_peered":"2024-04-26T12:20:28.673040+0000","last_clean":"2024-04-26T12:20:28.673040+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:28.673040+0000","last_undegraded":"2024-04-26T12:20:28.673040+0000","last_fullsized":"2024-04-26T12:20:28.673040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:59.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673145+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:28.673145+0000","last_peered":"2024-04-26T12:20:28.673145+0000","last_clean":"2024-04-26T12:20:28.673145+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:28.673145+0000","last_undegraded":"2024-04-26T12:20:28.673145+0000","last_fullsized":"2024-04-26T12:20:28.673145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:48.149555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673934+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:28.673934+0000","last_peered":"2024-04-26T12:20:28.673934+0000","last_clean":"2024-04-26T12:20:28.673934+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:28.673934+0000","last_undegraded":"2024-04-26T12:20:28.673934+0000","last_fullsized":"2024-04-26T12:20:28.673934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:07.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673055+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:28.673055+0000","last_peered":"2024-04-26T12:20:28.673055+0000","last_clean":"2024-04-26T12:20:28.673055+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:28.673055+0000","last_undegraded":"2024-04-26T12:20:28.673055+0000","last_fullsized":"2024-04-26T12:20:28.673055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:43.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.665885+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:54.789896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422569+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:29.422569+0000","last_peered":"2024-04-26T12:20:29.422569+0000","last_clean":"2024-04-26T12:20:29.422569+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422569+0000","last_undegraded":"2024-04-26T12:20:29.422569+0000","last_fullsized":"2024-04-26T12:20:29.422569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:28.598257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.674018+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:28.674018+0000","last_peered":"2024-04-26T12:20:28.674018+0000","last_clean":"2024-04-26T12:20:28.674018+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:28.674018+0000","last_undegraded":"2024-04-26T12:20:28.674018+0000","last_fullsized":"2024-04-26T12:20:28.674018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.969416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422582+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:29.422582+0000","last_peered":"2024-04-26T12:20:29.422582+0000","last_clean":"2024-04-26T12:20:29.422582+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:29.422582+0000","last_undegraded":"2024-04-26T12:20:29.422582+0000","last_fullsized":"2024-04-26T12:20:29.422582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673506+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:20:28.673506+0000","last_peered":"2024-04-26T12:20:28.673506+0000","last_clean":"2024-04-26T12:20:28.673506+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:28.673506+0000","last_undegraded":"2024-04-26T12:20:28.673506+0000","last_fullsized":"2024-04-26T12:20:28.673506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672738+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:28.672738+0000","last_peered":"2024-04-26T12:20:28.672738+0000","last_clean":"2024-04-26T12:20:28.672738+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:28.672738+0000","last_undegraded":"2024-04-26T12:20:28.672738+0000","last_fullsized":"2024-04-26T12:20:28.672738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:21.176687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673105+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:28.673105+0000","last_peered":"2024-04-26T12:20:28.673105+0000","last_clean":"2024-04-26T12:20:28.673105+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:28.673105+0000","last_undegraded":"2024-04-26T12:20:28.673105+0000","last_fullsized":"2024-04-26T12:20:28.673105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.367763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673044+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:28.673044+0000","last_peered":"2024-04-26T12:20:28.673044+0000","last_clean":"2024-04-26T12:20:28.673044+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:28.673044+0000","last_undegraded":"2024-04-26T12:20:28.673044+0000","last_fullsized":"2024-04-26T12:20:28.673044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673730+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:28.673730+0000","last_peered":"2024-04-26T12:20:28.673730+0000","last_clean":"2024-04-26T12:20:28.673730+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:28.673730+0000","last_undegraded":"2024-04-26T12:20:28.673730+0000","last_fullsized":"2024-04-26T12:20:28.673730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:40.929552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673133+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:28.673133+0000","last_peered":"2024-04-26T12:20:28.673133+0000","last_clean":"2024-04-26T12:20:28.673133+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:28.673133+0000","last_undegraded":"2024-04-26T12:20:28.673133+0000","last_fullsized":"2024-04-26T12:20:28.673133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:22.695257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672781+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:28.672781+0000","last_peered":"2024-04-26T12:20:28.672781+0000","last_clean":"2024-04-26T12:20:28.672781+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:28.672781+0000","last_undegraded":"2024-04-26T12:20:28.672781+0000","last_fullsized":"2024-04-26T12:20:28.672781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:56.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423141+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:29.423141+0000","last_peered":"2024-04-26T12:20:29.423141+0000","last_clean":"2024-04-26T12:20:29.423141+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:29.423141+0000","last_undegraded":"2024-04-26T12:20:29.423141+0000","last_fullsized":"2024-04-26T12:20:29.423141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672912+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:28.672912+0000","last_peered":"2024-04-26T12:20:28.672912+0000","last_clean":"2024-04-26T12:20:28.672912+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:28.672912+0000","last_undegraded":"2024-04-26T12:20:28.672912+0000","last_fullsized":"2024-04-26T12:20:28.672912+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422741+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:29.422741+0000","last_peered":"2024-04-26T12:20:29.422741+0000","last_clean":"2024-04-26T12:20:29.422741+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422741+0000","last_undegraded":"2024-04-26T12:20:29.422741+0000","last_fullsized":"2024-04-26T12:20:29.422741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:47.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673527+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:20:28.673527+0000","last_peered":"2024-04-26T12:20:28.673527+0000","last_clean":"2024-04-26T12:20:28.673527+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673527+0000","last_undegraded":"2024-04-26T12:20:28.673527+0000","last_fullsized":"2024-04-26T12:20:28.673527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672986+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:28.672986+0000","last_peered":"2024-04-26T12:20:28.672986+0000","last_clean":"2024-04-26T12:20:28.672986+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:28.672986+0000","last_undegraded":"2024-04-26T12:20:28.672986+0000","last_fullsized":"2024-04-26T12:20:28.672986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:30.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673218+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:28.673218+0000","last_peered":"2024-04-26T12:20:28.673218+0000","last_clean":"2024-04-26T12:20:28.673218+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:28.673218+0000","last_undegraded":"2024-04-26T12:20:28.673218+0000","last_fullsized":"2024-04-26T12:20:28.673218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:00.363391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673325+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:20:28.673325+0000","last_peered":"2024-04-26T12:20:28.673325+0000","last_clean":"2024-04-26T12:20:28.673325+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:28.673325+0000","last_undegraded":"2024-04-26T12:20:28.673325+0000","last_fullsized":"2024-04-26T12:20:28.673325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673402+0000","last_change":"2024-04-26T12:20:25.664519+0000","last_active":"2024-04-26T12:20:28.673402+0000","last_peered":"2024-04-26T12:20:28.673402+0000","last_clean":"2024-04-26T12:20:28.673402+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:20:28.673402+0000","last_undegraded":"2024-04-26T12:20:28.673402+0000","last_fullsized":"2024-04-26T12:20:28.673402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.722939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673432+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:28.673432+0000","last_peered":"2024-04-26T12:20:28.673432+0000","last_clean":"2024-04-26T12:20:28.673432+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:28.673432+0000","last_undegraded":"2024-04-26T12:20:28.673432+0000","last_fullsized":"2024-04-26T12:20:28.673432+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422524+0000","last_change":"2024-04-26T12:20:25.659186+0000","last_active":"2024-04-26T12:20:29.422524+0000","last_peered":"2024-04-26T12:20:29.422524+0000","last_clean":"2024-04-26T12:20:29.422524+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:29.422524+0000","last_undegraded":"2024-04-26T12:20:29.422524+0000","last_fullsized":"2024-04-26T12:20:29.422524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:07.818179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673359+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:20:28.673359+0000","last_peered":"2024-04-26T12:20:28.673359+0000","last_clean":"2024-04-26T12:20:28.673359+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:20:28.673359+0000","last_undegraded":"2024-04-26T12:20:28.673359+0000","last_fullsized":"2024-04-26T12:20:28.673359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423388+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:29.423388+0000","last_peered":"2024-04-26T12:20:29.423388+0000","last_clean":"2024-04-26T12:20:29.423388+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:29.423388+0000","last_undegraded":"2024-04-26T12:20:29.423388+0000","last_fullsized":"2024-04-26T12:20:29.423388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422694+0000","last_change":"2024-04-26T12:20:25.659917+0000","last_active":"2024-04-26T12:20:29.422694+0000","last_peered":"2024-04-26T12:20:29.422694+0000","last_clean":"2024-04-26T12:20:29.422694+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:20:29.422694+0000","last_undegraded":"2024-04-26T12:20:29.422694+0000","last_fullsized":"2024-04-26T12:20:29.422694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:34.505551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673690+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:28.673690+0000","last_peered":"2024-04-26T12:20:28.673690+0000","last_clean":"2024-04-26T12:20:28.673690+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:28.673690+0000","last_undegraded":"2024-04-26T12:20:28.673690+0000","last_fullsized":"2024-04-26T12:20:28.673690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673666+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:28.673666+0000","last_peered":"2024-04-26T12:20:28.673666+0000","last_clean":"2024-04-26T12:20:28.673666+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:28.673666+0000","last_undegraded":"2024-04-26T12:20:28.673666+0000","last_fullsized":"2024-04-26T12:20:28.673666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672759+0000","last_change":"2024-04-26T12:20:25.658800+0000","last_active":"2024-04-26T12:20:28.672759+0000","last_peered":"2024-04-26T12:20:28.672759+0000","last_clean":"2024-04-26T12:20:28.672759+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:28.672759+0000","last_undegraded":"2024-04-26T12:20:28.672759+0000","last_fullsized":"2024-04-26T12:20:28.672759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:22.287193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673658+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:28.673658+0000","last_peered":"2024-04-26T12:20:28.673658+0000","last_clean":"2024-04-26T12:20:28.673658+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:28.673658+0000","last_undegraded":"2024-04-26T12:20:28.673658+0000","last_fullsized":"2024-04-26T12:20:28.673658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:10.121046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673823+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:28.673823+0000","last_peered":"2024-04-26T12:20:28.673823+0000","last_clean":"2024-04-26T12:20:28.673823+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:28.673823+0000","last_undegraded":"2024-04-26T12:20:28.673823+0000","last_fullsized":"2024-04-26T12:20:28.673823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:23.294093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422374+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:29.422374+0000","last_peered":"2024-04-26T12:20:29.422374+0000","last_clean":"2024-04-26T12:20:29.422374+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:29.422374+0000","last_undegraded":"2024-04-26T12:20:29.422374+0000","last_fullsized":"2024-04-26T12:20:29.422374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:22.842329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673624+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:28.673624+0000","last_peered":"2024-04-26T12:20:28.673624+0000","last_clean":"2024-04-26T12:20:28.673624+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:28.673624+0000","last_undegraded":"2024-04-26T12:20:28.673624+0000","last_fullsized":"2024-04-26T12:20:28.673624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:22.219973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:56.257240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672799+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:20:28.672799+0000","last_peered":"2024-04-26T12:20:28.672799+0000","last_clean":"2024-04-26T12:20:28.672799+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:20:28.672799+0000","last_undegraded":"2024-04-26T12:20:28.672799+0000","last_fullsized":"2024-04-26T12:20:28.672799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423272+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:29.423272+0000","last_peered":"2024-04-26T12:20:29.423272+0000","last_clean":"2024-04-26T12:20:29.423272+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:29.423272+0000","last_undegraded":"2024-04-26T12:20:29.423272+0000","last_fullsized":"2024-04-26T12:20:29.423272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.194671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673846+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:28.673846+0000","last_peered":"2024-04-26T12:20:28.673846+0000","last_clean":"2024-04-26T12:20:28.673846+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:28.673846+0000","last_undegraded":"2024-04-26T12:20:28.673846+0000","last_fullsized":"2024-04-26T12:20:28.673846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:41.999607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672646+0000","last_change":"2024-04-26T12:20:25.658549+0000","last_active":"2024-04-26T12:20:28.672646+0000","last_peered":"2024-04-26T12:20:28.672646+0000","last_clean":"2024-04-26T12:20:28.672646+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:28.672646+0000","last_undegraded":"2024-04-26T12:20:28.672646+0000","last_fullsized":"2024-04-26T12:20:28.672646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:26.372988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.658453+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:25.063788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672741+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:20:28.672741+0000","last_peered":"2024-04-26T12:20:28.672741+0000","last_clean":"2024-04-26T12:20:28.672741+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:28.672741+0000","last_undegraded":"2024-04-26T12:20:28.672741+0000","last_fullsized":"2024-04-26T12:20:28.672741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423415+0000","last_change":"2024-04-26T12:20:25.664482+0000","last_active":"2024-04-26T12:20:29.423415+0000","last_peered":"2024-04-26T12:20:29.423415+0000","last_clean":"2024-04-26T12:20:29.423415+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:29.423415+0000","last_undegraded":"2024-04-26T12:20:29.423415+0000","last_fullsized":"2024-04-26T12:20:29.423415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:15.256206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672847+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:28.672847+0000","last_peered":"2024-04-26T12:20:28.672847+0000","last_clean":"2024-04-26T12:20:28.672847+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:28.672847+0000","last_undegraded":"2024-04-26T12:20:28.672847+0000","last_fullsized":"2024-04-26T12:20:28.672847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673444+0000","last_change":"2024-04-26T12:20:25.659459+0000","last_active":"2024-04-26T12:20:28.673444+0000","last_peered":"2024-04-26T12:20:28.673444+0000","last_clean":"2024-04-26T12:20:28.673444+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:28.673444+0000","last_undegraded":"2024-04-26T12:20:28.673444+0000","last_fullsized":"2024-04-26T12:20:28.673444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:08.246812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672776+0000","last_change":"2024-04-26T12:20:25.659064+0000","last_active":"2024-04-26T12:20:28.672776+0000","last_peered":"2024-04-26T12:20:28.672776+0000","last_clean":"2024-04-26T12:20:28.672776+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:20:28.672776+0000","last_undegraded":"2024-04-26T12:20:28.672776+0000","last_fullsized":"2024-04-26T12:20:28.672776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:46.130193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423024+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:29.423024+0000","last_peered":"2024-04-26T12:20:29.423024+0000","last_clean":"2024-04-26T12:20:29.423024+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:29.423024+0000","last_undegraded":"2024-04-26T12:20:29.423024+0000","last_fullsized":"2024-04-26T12:20:29.423024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:37.387665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422819+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:29.422819+0000","last_peered":"2024-04-26T12:20:29.422819+0000","last_clean":"2024-04-26T12:20:29.422819+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:29.422819+0000","last_undegraded":"2024-04-26T12:20:29.422819+0000","last_fullsized":"2024-04-26T12:20:29.422819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422926+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:29.422926+0000","last_peered":"2024-04-26T12:20:29.422926+0000","last_clean":"2024-04-26T12:20:29.422926+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:29.422926+0000","last_undegraded":"2024-04-26T12:20:29.422926+0000","last_fullsized":"2024-04-26T12:20:29.422926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422854+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:29.422854+0000","last_peered":"2024-04-26T12:20:29.422854+0000","last_clean":"2024-04-26T12:20:29.422854+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:29.422854+0000","last_undegraded":"2024-04-26T12:20:29.422854+0000","last_fullsized":"2024-04-26T12:20:29.422854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:48.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673793+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:28.673793+0000","last_peered":"2024-04-26T12:20:28.673793+0000","last_clean":"2024-04-26T12:20:28.673793+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:28.673793+0000","last_undegraded":"2024-04-26T12:20:28.673793+0000","last_fullsized":"2024-04-26T12:20:28.673793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:42.215211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673302+0000","last_change":"2024-04-26T12:20:25.661093+0000","last_active":"2024-04-26T12:20:28.673302+0000","last_peered":"2024-04-26T12:20:28.673302+0000","last_clean":"2024-04-26T12:20:28.673302+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:20:28.673302+0000","last_undegraded":"2024-04-26T12:20:28.673302+0000","last_fullsized":"2024-04-26T12:20:28.673302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:42.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673207+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:28.673207+0000","last_peered":"2024-04-26T12:20:28.673207+0000","last_clean":"2024-04-26T12:20:28.673207+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:28.673207+0000","last_undegraded":"2024-04-26T12:20:28.673207+0000","last_fullsized":"2024-04-26T12:20:28.673207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:09.557685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423130+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:29.423130+0000","last_peered":"2024-04-26T12:20:29.423130+0000","last_clean":"2024-04-26T12:20:29.423130+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:29.423130+0000","last_undegraded":"2024-04-26T12:20:29.423130+0000","last_fullsized":"2024-04-26T12:20:29.423130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:12.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422739+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:29.422739+0000","last_peered":"2024-04-26T12:20:29.422739+0000","last_clean":"2024-04-26T12:20:29.422739+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:29.422739+0000","last_undegraded":"2024-04-26T12:20:29.422739+0000","last_fullsized":"2024-04-26T12:20:29.422739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673561+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:20:28.673561+0000","last_peered":"2024-04-26T12:20:28.673561+0000","last_clean":"2024-04-26T12:20:28.673561+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:28.673561+0000","last_undegraded":"2024-04-26T12:20:28.673561+0000","last_fullsized":"2024-04-26T12:20:28.673561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673220+0000","last_change":"2024-04-26T12:20:25.665062+0000","last_active":"2024-04-26T12:20:28.673220+0000","last_peered":"2024-04-26T12:20:28.673220+0000","last_clean":"2024-04-26T12:20:28.673220+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:28.673220+0000","last_undegraded":"2024-04-26T12:20:28.673220+0000","last_fullsized":"2024-04-26T12:20:28.673220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:01.241012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673566+0000","last_change":"2024-04-26T12:20:25.658932+0000","last_active":"2024-04-26T12:20:28.673566+0000","last_peered":"2024-04-26T12:20:28.673566+0000","last_clean":"2024-04-26T12:20:28.673566+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:28.673566+0000","last_undegraded":"2024-04-26T12:20:28.673566+0000","last_fullsized":"2024-04-26T12:20:28.673566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:37.375332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321304,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050536,"statfs":{"total":96636764160,"available":96307748864,"internally_reserved":0,"allocated":1454080,"data_stored":928586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:19:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.42499999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.60999999999999999,"5min":0.871,"15min":0.871},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.41899999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.58899999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579907,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29996,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341844,"statfs":{"total":96636764160,"available":96606048256,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483156,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888684,"statfs":{"total":96636764160,"available":96142012416,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.371,"5min":0.161,"15min":0.161},"max":{"1min":0.57099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.39300000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.68500000000000005,"5min":0.879,"15min":0.879},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:20:31.458 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:20:31.458 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T12:20:31.792 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:20:31.803 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:20:31.803 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:20:32.088 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:20:32.099 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T12:20:30.519337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834456,"kb_used_data":3692,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281064,"statfs":{"total":289910292480,"available":289055809536,"internally_reserved":0,"allocated":3780608,"data_stored":2205469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423367+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:29.423367+0000","last_peered":"2024-04-26T12:20:29.423367+0000","last_clean":"2024-04-26T12:20:29.423367+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:29.423367+0000","last_undegraded":"2024-04-26T12:20:29.423367+0000","last_fullsized":"2024-04-26T12:20:29.423367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423011+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:29.423011+0000","last_peered":"2024-04-26T12:20:29.423011+0000","last_clean":"2024-04-26T12:20:29.423011+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:29.423011+0000","last_undegraded":"2024-04-26T12:20:29.423011+0000","last_fullsized":"2024-04-26T12:20:29.423011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673852+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:28.673852+0000","last_peered":"2024-04-26T12:20:28.673852+0000","last_clean":"2024-04-26T12:20:28.673852+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:28.673852+0000","last_undegraded":"2024-04-26T12:20:28.673852+0000","last_fullsized":"2024-04-26T12:20:28.673852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:51.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673545+0000","last_change":"2024-04-26T12:20:25.662260+0000","last_active":"2024-04-26T12:20:28.673545+0000","last_peered":"2024-04-26T12:20:28.673545+0000","last_clean":"2024-04-26T12:20:28.673545+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:28.673545+0000","last_undegraded":"2024-04-26T12:20:28.673545+0000","last_fullsized":"2024-04-26T12:20:28.673545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:54.868104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422713+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:20:29.422713+0000","last_peered":"2024-04-26T12:20:29.422713+0000","last_clean":"2024-04-26T12:20:29.422713+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:20:29.422713+0000","last_undegraded":"2024-04-26T12:20:29.422713+0000","last_fullsized":"2024-04-26T12:20:29.422713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673502+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:28.673502+0000","last_peered":"2024-04-26T12:20:28.673502+0000","last_clean":"2024-04-26T12:20:28.673502+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:28.673502+0000","last_undegraded":"2024-04-26T12:20:28.673502+0000","last_fullsized":"2024-04-26T12:20:28.673502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:30.261523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:55.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672981+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:28.672981+0000","last_peered":"2024-04-26T12:20:28.672981+0000","last_clean":"2024-04-26T12:20:28.672981+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:28.672981+0000","last_undegraded":"2024-04-26T12:20:28.672981+0000","last_fullsized":"2024-04-26T12:20:28.672981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:24.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673427+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:28.673427+0000","last_peered":"2024-04-26T12:20:28.673427+0000","last_clean":"2024-04-26T12:20:28.673427+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:28.673427+0000","last_undegraded":"2024-04-26T12:20:28.673427+0000","last_fullsized":"2024-04-26T12:20:28.673427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423142+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:20:29.423142+0000","last_peered":"2024-04-26T12:20:29.423142+0000","last_clean":"2024-04-26T12:20:29.423142+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:29.423142+0000","last_undegraded":"2024-04-26T12:20:29.423142+0000","last_fullsized":"2024-04-26T12:20:29.423142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:47.821001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422776+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:29.422776+0000","last_peered":"2024-04-26T12:20:29.422776+0000","last_clean":"2024-04-26T12:20:29.422776+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:29.422776+0000","last_undegraded":"2024-04-26T12:20:29.422776+0000","last_fullsized":"2024-04-26T12:20:29.422776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:17.945553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422552+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:29.422552+0000","last_peered":"2024-04-26T12:20:29.422552+0000","last_clean":"2024-04-26T12:20:29.422552+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:29.422552+0000","last_undegraded":"2024-04-26T12:20:29.422552+0000","last_fullsized":"2024-04-26T12:20:29.422552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673434+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:28.673434+0000","last_peered":"2024-04-26T12:20:28.673434+0000","last_clean":"2024-04-26T12:20:28.673434+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:28.673434+0000","last_undegraded":"2024-04-26T12:20:28.673434+0000","last_fullsized":"2024-04-26T12:20:28.673434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:52.220501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673130+0000","last_change":"2024-04-26T12:20:25.658158+0000","last_active":"2024-04-26T12:20:28.673130+0000","last_peered":"2024-04-26T12:20:28.673130+0000","last_clean":"2024-04-26T12:20:28.673130+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:20:28.673130+0000","last_undegraded":"2024-04-26T12:20:28.673130+0000","last_fullsized":"2024-04-26T12:20:28.673130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:55.017516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673289+0000","last_change":"2024-04-26T12:20:25.664916+0000","last_active":"2024-04-26T12:20:28.673289+0000","last_peered":"2024-04-26T12:20:28.673289+0000","last_clean":"2024-04-26T12:20:28.673289+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:28.673289+0000","last_undegraded":"2024-04-26T12:20:28.673289+0000","last_fullsized":"2024-04-26T12:20:28.673289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:10.630467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673669+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:28.673669+0000","last_peered":"2024-04-26T12:20:28.673669+0000","last_clean":"2024-04-26T12:20:28.673669+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673669+0000","last_undegraded":"2024-04-26T12:20:28.673669+0000","last_fullsized":"2024-04-26T12:20:28.673669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423252+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:20:29.423252+0000","last_peered":"2024-04-26T12:20:29.423252+0000","last_clean":"2024-04-26T12:20:29.423252+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:29.423252+0000","last_undegraded":"2024-04-26T12:20:29.423252+0000","last_fullsized":"2024-04-26T12:20:29.423252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673295+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:28.673295+0000","last_peered":"2024-04-26T12:20:28.673295+0000","last_clean":"2024-04-26T12:20:28.673295+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:28.673295+0000","last_undegraded":"2024-04-26T12:20:28.673295+0000","last_fullsized":"2024-04-26T12:20:28.673295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673685+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:28.673685+0000","last_peered":"2024-04-26T12:20:28.673685+0000","last_clean":"2024-04-26T12:20:28.673685+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:28.673685+0000","last_undegraded":"2024-04-26T12:20:28.673685+0000","last_fullsized":"2024-04-26T12:20:28.673685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.225357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673896+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:28.673896+0000","last_peered":"2024-04-26T12:20:28.673896+0000","last_clean":"2024-04-26T12:20:28.673896+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:28.673896+0000","last_undegraded":"2024-04-26T12:20:28.673896+0000","last_fullsized":"2024-04-26T12:20:28.673896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:31.708071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422472+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:29.422472+0000","last_peered":"2024-04-26T12:20:29.422472+0000","last_clean":"2024-04-26T12:20:29.422472+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:29.422472+0000","last_undegraded":"2024-04-26T12:20:29.422472+0000","last_fullsized":"2024-04-26T12:20:29.422472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:58.603217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672548+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:28.672548+0000","last_peered":"2024-04-26T12:20:28.672548+0000","last_clean":"2024-04-26T12:20:28.672548+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:28.672548+0000","last_undegraded":"2024-04-26T12:20:28.672548+0000","last_fullsized":"2024-04-26T12:20:28.672548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:34.377929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422389+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:29.422389+0000","last_peered":"2024-04-26T12:20:29.422389+0000","last_clean":"2024-04-26T12:20:29.422389+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:29.422389+0000","last_undegraded":"2024-04-26T12:20:29.422389+0000","last_fullsized":"2024-04-26T12:20:29.422389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423356+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:29.423356+0000","last_peered":"2024-04-26T12:20:29.423356+0000","last_clean":"2024-04-26T12:20:29.423356+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:29.423356+0000","last_undegraded":"2024-04-26T12:20:29.423356+0000","last_fullsized":"2024-04-26T12:20:29.423356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:07.619412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673433+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:28.673433+0000","last_peered":"2024-04-26T12:20:28.673433+0000","last_clean":"2024-04-26T12:20:28.673433+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:28.673433+0000","last_undegraded":"2024-04-26T12:20:28.673433+0000","last_fullsized":"2024-04-26T12:20:28.673433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:18.666244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673765+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:28.673765+0000","last_peered":"2024-04-26T12:20:28.673765+0000","last_clean":"2024-04-26T12:20:28.673765+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:28.673765+0000","last_undegraded":"2024-04-26T12:20:28.673765+0000","last_fullsized":"2024-04-26T12:20:28.673765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:39.629549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423064+0000","last_change":"2024-04-26T12:20:25.665113+0000","last_active":"2024-04-26T12:20:29.423064+0000","last_peered":"2024-04-26T12:20:29.423064+0000","last_clean":"2024-04-26T12:20:29.423064+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:29.423064+0000","last_undegraded":"2024-04-26T12:20:29.423064+0000","last_fullsized":"2024-04-26T12:20:29.423064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:47.401100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672985+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:28.672985+0000","last_peered":"2024-04-26T12:20:28.672985+0000","last_clean":"2024-04-26T12:20:28.672985+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:28.672985+0000","last_undegraded":"2024-04-26T12:20:28.672985+0000","last_fullsized":"2024-04-26T12:20:28.672985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422843+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:29.422843+0000","last_peered":"2024-04-26T12:20:29.422843+0000","last_clean":"2024-04-26T12:20:29.422843+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:29.422843+0000","last_undegraded":"2024-04-26T12:20:29.422843+0000","last_fullsized":"2024-04-26T12:20:29.422843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.807141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672610+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:28.672610+0000","last_peered":"2024-04-26T12:20:28.672610+0000","last_clean":"2024-04-26T12:20:28.672610+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:28.672610+0000","last_undegraded":"2024-04-26T12:20:28.672610+0000","last_fullsized":"2024-04-26T12:20:28.672610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672844+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:28.672844+0000","last_peered":"2024-04-26T12:20:28.672844+0000","last_clean":"2024-04-26T12:20:28.672844+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:28.672844+0000","last_undegraded":"2024-04-26T12:20:28.672844+0000","last_fullsized":"2024-04-26T12:20:28.672844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:27.038124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422911+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:20:29.422911+0000","last_peered":"2024-04-26T12:20:29.422911+0000","last_clean":"2024-04-26T12:20:29.422911+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:20:29.422911+0000","last_undegraded":"2024-04-26T12:20:29.422911+0000","last_fullsized":"2024-04-26T12:20:29.422911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673469+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:28.673469+0000","last_peered":"2024-04-26T12:20:28.673469+0000","last_clean":"2024-04-26T12:20:28.673469+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:28.673469+0000","last_undegraded":"2024-04-26T12:20:28.673469+0000","last_fullsized":"2024-04-26T12:20:28.673469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:02.210041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423117+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:20:29.423117+0000","last_peered":"2024-04-26T12:20:29.423117+0000","last_clean":"2024-04-26T12:20:29.423117+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:29.423117+0000","last_undegraded":"2024-04-26T12:20:29.423117+0000","last_fullsized":"2024-04-26T12:20:29.423117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672907+0000","last_change":"2024-04-26T12:20:25.659060+0000","last_active":"2024-04-26T12:20:28.672907+0000","last_peered":"2024-04-26T12:20:28.672907+0000","last_clean":"2024-04-26T12:20:28.672907+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:28.672907+0000","last_undegraded":"2024-04-26T12:20:28.672907+0000","last_fullsized":"2024-04-26T12:20:28.672907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:23.462778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673599+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:28.673599+0000","last_peered":"2024-04-26T12:20:28.673599+0000","last_clean":"2024-04-26T12:20:28.673599+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:28.673599+0000","last_undegraded":"2024-04-26T12:20:28.673599+0000","last_fullsized":"2024-04-26T12:20:28.673599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:42.068061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422634+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:29.422634+0000","last_peered":"2024-04-26T12:20:29.422634+0000","last_clean":"2024-04-26T12:20:29.422634+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:29.422634+0000","last_undegraded":"2024-04-26T12:20:29.422634+0000","last_fullsized":"2024-04-26T12:20:29.422634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:33.454616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673440+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:28.673440+0000","last_peered":"2024-04-26T12:20:28.673440+0000","last_clean":"2024-04-26T12:20:28.673440+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:28.673440+0000","last_undegraded":"2024-04-26T12:20:28.673440+0000","last_fullsized":"2024-04-26T12:20:28.673440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:34.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672867+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:28.672867+0000","last_peered":"2024-04-26T12:20:28.672867+0000","last_clean":"2024-04-26T12:20:28.672867+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:28.672867+0000","last_undegraded":"2024-04-26T12:20:28.672867+0000","last_fullsized":"2024-04-26T12:20:28.672867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:27.283599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.209742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422375+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:29.422375+0000","last_peered":"2024-04-26T12:20:29.422375+0000","last_clean":"2024-04-26T12:20:29.422375+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:29.422375+0000","last_undegraded":"2024-04-26T12:20:29.422375+0000","last_fullsized":"2024-04-26T12:20:29.422375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:57.793936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423352+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:29.423352+0000","last_peered":"2024-04-26T12:20:29.423352+0000","last_clean":"2024-04-26T12:20:29.423352+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:29.423352+0000","last_undegraded":"2024-04-26T12:20:29.423352+0000","last_fullsized":"2024-04-26T12:20:29.423352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:51.515487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422363+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:29.422363+0000","last_peered":"2024-04-26T12:20:29.422363+0000","last_clean":"2024-04-26T12:20:29.422363+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:29.422363+0000","last_undegraded":"2024-04-26T12:20:29.422363+0000","last_fullsized":"2024-04-26T12:20:29.422363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:16.407869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673570+0000","last_change":"2024-04-26T12:20:25.663801+0000","last_active":"2024-04-26T12:20:28.673570+0000","last_peered":"2024-04-26T12:20:28.673570+0000","last_clean":"2024-04-26T12:20:28.673570+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:28.673570+0000","last_undegraded":"2024-04-26T12:20:28.673570+0000","last_fullsized":"2024-04-26T12:20:28.673570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:34.758119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673579+0000","last_change":"2024-04-26T12:20:25.663958+0000","last_active":"2024-04-26T12:20:28.673579+0000","last_peered":"2024-04-26T12:20:28.673579+0000","last_clean":"2024-04-26T12:20:28.673579+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:28.673579+0000","last_undegraded":"2024-04-26T12:20:28.673579+0000","last_fullsized":"2024-04-26T12:20:28.673579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:55.763498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673040+0000","last_change":"2024-04-26T12:20:25.658968+0000","last_active":"2024-04-26T12:20:28.673040+0000","last_peered":"2024-04-26T12:20:28.673040+0000","last_clean":"2024-04-26T12:20:28.673040+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:28.673040+0000","last_undegraded":"2024-04-26T12:20:28.673040+0000","last_fullsized":"2024-04-26T12:20:28.673040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:59.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673145+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:28.673145+0000","last_peered":"2024-04-26T12:20:28.673145+0000","last_clean":"2024-04-26T12:20:28.673145+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:28.673145+0000","last_undegraded":"2024-04-26T12:20:28.673145+0000","last_fullsized":"2024-04-26T12:20:28.673145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:48.149555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673934+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:28.673934+0000","last_peered":"2024-04-26T12:20:28.673934+0000","last_clean":"2024-04-26T12:20:28.673934+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:28.673934+0000","last_undegraded":"2024-04-26T12:20:28.673934+0000","last_fullsized":"2024-04-26T12:20:28.673934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:07.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673055+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:28.673055+0000","last_peered":"2024-04-26T12:20:28.673055+0000","last_clean":"2024-04-26T12:20:28.673055+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:28.673055+0000","last_undegraded":"2024-04-26T12:20:28.673055+0000","last_fullsized":"2024-04-26T12:20:28.673055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:43.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.665885+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:54.789896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422569+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:29.422569+0000","last_peered":"2024-04-26T12:20:29.422569+0000","last_clean":"2024-04-26T12:20:29.422569+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422569+0000","last_undegraded":"2024-04-26T12:20:29.422569+0000","last_fullsized":"2024-04-26T12:20:29.422569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:28.598257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.674018+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:28.674018+0000","last_peered":"2024-04-26T12:20:28.674018+0000","last_clean":"2024-04-26T12:20:28.674018+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:28.674018+0000","last_undegraded":"2024-04-26T12:20:28.674018+0000","last_fullsized":"2024-04-26T12:20:28.674018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.969416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422582+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:29.422582+0000","last_peered":"2024-04-26T12:20:29.422582+0000","last_clean":"2024-04-26T12:20:29.422582+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:29.422582+0000","last_undegraded":"2024-04-26T12:20:29.422582+0000","last_fullsized":"2024-04-26T12:20:29.422582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673506+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:20:28.673506+0000","last_peered":"2024-04-26T12:20:28.673506+0000","last_clean":"2024-04-26T12:20:28.673506+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:28.673506+0000","last_undegraded":"2024-04-26T12:20:28.673506+0000","last_fullsized":"2024-04-26T12:20:28.673506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672738+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:28.672738+0000","last_peered":"2024-04-26T12:20:28.672738+0000","last_clean":"2024-04-26T12:20:28.672738+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:28.672738+0000","last_undegraded":"2024-04-26T12:20:28.672738+0000","last_fullsized":"2024-04-26T12:20:28.672738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:21.176687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673105+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:28.673105+0000","last_peered":"2024-04-26T12:20:28.673105+0000","last_clean":"2024-04-26T12:20:28.673105+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:28.673105+0000","last_undegraded":"2024-04-26T12:20:28.673105+0000","last_fullsized":"2024-04-26T12:20:28.673105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.367763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673044+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:28.673044+0000","last_peered":"2024-04-26T12:20:28.673044+0000","last_clean":"2024-04-26T12:20:28.673044+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:28.673044+0000","last_undegraded":"2024-04-26T12:20:28.673044+0000","last_fullsized":"2024-04-26T12:20:28.673044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673730+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:28.673730+0000","last_peered":"2024-04-26T12:20:28.673730+0000","last_clean":"2024-04-26T12:20:28.673730+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:28.673730+0000","last_undegraded":"2024-04-26T12:20:28.673730+0000","last_fullsized":"2024-04-26T12:20:28.673730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:40.929552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673133+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:28.673133+0000","last_peered":"2024-04-26T12:20:28.673133+0000","last_clean":"2024-04-26T12:20:28.673133+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:28.673133+0000","last_undegraded":"2024-04-26T12:20:28.673133+0000","last_fullsized":"2024-04-26T12:20:28.673133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:22.695257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672781+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:28.672781+0000","last_peered":"2024-04-26T12:20:28.672781+0000","last_clean":"2024-04-26T12:20:28.672781+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:28.672781+0000","last_undegraded":"2024-04-26T12:20:28.672781+0000","last_fullsized":"2024-04-26T12:20:28.672781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:56.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423141+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:29.423141+0000","last_peered":"2024-04-26T12:20:29.423141+0000","last_clean":"2024-04-26T12:20:29.423141+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:29.423141+0000","last_undegraded":"2024-04-26T12:20:29.423141+0000","last_fullsized":"2024-04-26T12:20:29.423141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672912+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:28.672912+0000","last_peered":"2024-04-26T12:20:28.672912+0000","last_clean":"2024-04-26T12:20:28.672912+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:28.672912+0000","last_undegraded":"2024-04-26T12:20:28.672912+0000","last_fullsized":"2024-04-26T12:20:28.672912+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422741+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:29.422741+0000","last_peered":"2024-04-26T12:20:29.422741+0000","last_clean":"2024-04-26T12:20:29.422741+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422741+0000","last_undegraded":"2024-04-26T12:20:29.422741+0000","last_fullsized":"2024-04-26T12:20:29.422741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:47.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673527+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:20:28.673527+0000","last_peered":"2024-04-26T12:20:28.673527+0000","last_clean":"2024-04-26T12:20:28.673527+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673527+0000","last_undegraded":"2024-04-26T12:20:28.673527+0000","last_fullsized":"2024-04-26T12:20:28.673527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672986+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:28.672986+0000","last_peered":"2024-04-26T12:20:28.672986+0000","last_clean":"2024-04-26T12:20:28.672986+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:28.672986+0000","last_undegraded":"2024-04-26T12:20:28.672986+0000","last_fullsized":"2024-04-26T12:20:28.672986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:30.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673218+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:28.673218+0000","last_peered":"2024-04-26T12:20:28.673218+0000","last_clean":"2024-04-26T12:20:28.673218+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:28.673218+0000","last_undegraded":"2024-04-26T12:20:28.673218+0000","last_fullsized":"2024-04-26T12:20:28.673218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:00.363391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673325+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:20:28.673325+0000","last_peered":"2024-04-26T12:20:28.673325+0000","last_clean":"2024-04-26T12:20:28.673325+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:28.673325+0000","last_undegraded":"2024-04-26T12:20:28.673325+0000","last_fullsized":"2024-04-26T12:20:28.673325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673402+0000","last_change":"2024-04-26T12:20:25.664519+0000","last_active":"2024-04-26T12:20:28.673402+0000","last_peered":"2024-04-26T12:20:28.673402+0000","last_clean":"2024-04-26T12:20:28.673402+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:20:28.673402+0000","last_undegraded":"2024-04-26T12:20:28.673402+0000","last_fullsized":"2024-04-26T12:20:28.673402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.722939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673432+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:28.673432+0000","last_peered":"2024-04-26T12:20:28.673432+0000","last_clean":"2024-04-26T12:20:28.673432+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:28.673432+0000","last_undegraded":"2024-04-26T12:20:28.673432+0000","last_fullsized":"2024-04-26T12:20:28.673432+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422524+0000","last_change":"2024-04-26T12:20:25.659186+0000","last_active":"2024-04-26T12:20:29.422524+0000","last_peered":"2024-04-26T12:20:29.422524+0000","last_clean":"2024-04-26T12:20:29.422524+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:29.422524+0000","last_undegraded":"2024-04-26T12:20:29.422524+0000","last_fullsized":"2024-04-26T12:20:29.422524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:07.818179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673359+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:20:28.673359+0000","last_peered":"2024-04-26T12:20:28.673359+0000","last_clean":"2024-04-26T12:20:28.673359+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:20:28.673359+0000","last_undegraded":"2024-04-26T12:20:28.673359+0000","last_fullsized":"2024-04-26T12:20:28.673359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423388+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:29.423388+0000","last_peered":"2024-04-26T12:20:29.423388+0000","last_clean":"2024-04-26T12:20:29.423388+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:29.423388+0000","last_undegraded":"2024-04-26T12:20:29.423388+0000","last_fullsized":"2024-04-26T12:20:29.423388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422694+0000","last_change":"2024-04-26T12:20:25.659917+0000","last_active":"2024-04-26T12:20:29.422694+0000","last_peered":"2024-04-26T12:20:29.422694+0000","last_clean":"2024-04-26T12:20:29.422694+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:20:29.422694+0000","last_undegraded":"2024-04-26T12:20:29.422694+0000","last_fullsized":"2024-04-26T12:20:29.422694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:34.505551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673690+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:28.673690+0000","last_peered":"2024-04-26T12:20:28.673690+0000","last_clean":"2024-04-26T12:20:28.673690+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:28.673690+0000","last_undegraded":"2024-04-26T12:20:28.673690+0000","last_fullsized":"2024-04-26T12:20:28.673690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673666+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:28.673666+0000","last_peered":"2024-04-26T12:20:28.673666+0000","last_clean":"2024-04-26T12:20:28.673666+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:28.673666+0000","last_undegraded":"2024-04-26T12:20:28.673666+0000","last_fullsized":"2024-04-26T12:20:28.673666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672759+0000","last_change":"2024-04-26T12:20:25.658800+0000","last_active":"2024-04-26T12:20:28.672759+0000","last_peered":"2024-04-26T12:20:28.672759+0000","last_clean":"2024-04-26T12:20:28.672759+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:28.672759+0000","last_undegraded":"2024-04-26T12:20:28.672759+0000","last_fullsized":"2024-04-26T12:20:28.672759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:22.287193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673658+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:28.673658+0000","last_peered":"2024-04-26T12:20:28.673658+0000","last_clean":"2024-04-26T12:20:28.673658+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:28.673658+0000","last_undegraded":"2024-04-26T12:20:28.673658+0000","last_fullsized":"2024-04-26T12:20:28.673658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:10.121046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673823+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:28.673823+0000","last_peered":"2024-04-26T12:20:28.673823+0000","last_clean":"2024-04-26T12:20:28.673823+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:28.673823+0000","last_undegraded":"2024-04-26T12:20:28.673823+0000","last_fullsized":"2024-04-26T12:20:28.673823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:23.294093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422374+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:29.422374+0000","last_peered":"2024-04-26T12:20:29.422374+0000","last_clean":"2024-04-26T12:20:29.422374+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:29.422374+0000","last_undegraded":"2024-04-26T12:20:29.422374+0000","last_fullsized":"2024-04-26T12:20:29.422374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:22.842329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673624+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:28.673624+0000","last_peered":"2024-04-26T12:20:28.673624+0000","last_clean":"2024-04-26T12:20:28.673624+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:28.673624+0000","last_undegraded":"2024-04-26T12:20:28.673624+0000","last_fullsized":"2024-04-26T12:20:28.673624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:22.219973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:56.257240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672799+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:20:28.672799+0000","last_peered":"2024-04-26T12:20:28.672799+0000","last_clean":"2024-04-26T12:20:28.672799+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:20:28.672799+0000","last_undegraded":"2024-04-26T12:20:28.672799+0000","last_fullsized":"2024-04-26T12:20:28.672799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423272+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:29.423272+0000","last_peered":"2024-04-26T12:20:29.423272+0000","last_clean":"2024-04-26T12:20:29.423272+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:29.423272+0000","last_undegraded":"2024-04-26T12:20:29.423272+0000","last_fullsized":"2024-04-26T12:20:29.423272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.194671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673846+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:28.673846+0000","last_peered":"2024-04-26T12:20:28.673846+0000","last_clean":"2024-04-26T12:20:28.673846+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:28.673846+0000","last_undegraded":"2024-04-26T12:20:28.673846+0000","last_fullsized":"2024-04-26T12:20:28.673846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:41.999607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672646+0000","last_change":"2024-04-26T12:20:25.658549+0000","last_active":"2024-04-26T12:20:28.672646+0000","last_peered":"2024-04-26T12:20:28.672646+0000","last_clean":"2024-04-26T12:20:28.672646+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:28.672646+0000","last_undegraded":"2024-04-26T12:20:28.672646+0000","last_fullsized":"2024-04-26T12:20:28.672646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:26.372988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.658453+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:25.063788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672741+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:20:28.672741+0000","last_peered":"2024-04-26T12:20:28.672741+0000","last_clean":"2024-04-26T12:20:28.672741+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:28.672741+0000","last_undegraded":"2024-04-26T12:20:28.672741+0000","last_fullsized":"2024-04-26T12:20:28.672741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423415+0000","last_change":"2024-04-26T12:20:25.664482+0000","last_active":"2024-04-26T12:20:29.423415+0000","last_peered":"2024-04-26T12:20:29.423415+0000","last_clean":"2024-04-26T12:20:29.423415+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:29.423415+0000","last_undegraded":"2024-04-26T12:20:29.423415+0000","last_fullsized":"2024-04-26T12:20:29.423415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:15.256206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672847+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:28.672847+0000","last_peered":"2024-04-26T12:20:28.672847+0000","last_clean":"2024-04-26T12:20:28.672847+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:28.672847+0000","last_undegraded":"2024-04-26T12:20:28.672847+0000","last_fullsized":"2024-04-26T12:20:28.672847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673444+0000","last_change":"2024-04-26T12:20:25.659459+0000","last_active":"2024-04-26T12:20:28.673444+0000","last_peered":"2024-04-26T12:20:28.673444+0000","last_clean":"2024-04-26T12:20:28.673444+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:28.673444+0000","last_undegraded":"2024-04-26T12:20:28.673444+0000","last_fullsized":"2024-04-26T12:20:28.673444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:08.246812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672776+0000","last_change":"2024-04-26T12:20:25.659064+0000","last_active":"2024-04-26T12:20:28.672776+0000","last_peered":"2024-04-26T12:20:28.672776+0000","last_clean":"2024-04-26T12:20:28.672776+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:20:28.672776+0000","last_undegraded":"2024-04-26T12:20:28.672776+0000","last_fullsized":"2024-04-26T12:20:28.672776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:46.130193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423024+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:29.423024+0000","last_peered":"2024-04-26T12:20:29.423024+0000","last_clean":"2024-04-26T12:20:29.423024+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:29.423024+0000","last_undegraded":"2024-04-26T12:20:29.423024+0000","last_fullsized":"2024-04-26T12:20:29.423024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:37.387665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422819+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:29.422819+0000","last_peered":"2024-04-26T12:20:29.422819+0000","last_clean":"2024-04-26T12:20:29.422819+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:29.422819+0000","last_undegraded":"2024-04-26T12:20:29.422819+0000","last_fullsized":"2024-04-26T12:20:29.422819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422926+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:29.422926+0000","last_peered":"2024-04-26T12:20:29.422926+0000","last_clean":"2024-04-26T12:20:29.422926+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:29.422926+0000","last_undegraded":"2024-04-26T12:20:29.422926+0000","last_fullsized":"2024-04-26T12:20:29.422926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422854+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:29.422854+0000","last_peered":"2024-04-26T12:20:29.422854+0000","last_clean":"2024-04-26T12:20:29.422854+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:29.422854+0000","last_undegraded":"2024-04-26T12:20:29.422854+0000","last_fullsized":"2024-04-26T12:20:29.422854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:48.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673793+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:28.673793+0000","last_peered":"2024-04-26T12:20:28.673793+0000","last_clean":"2024-04-26T12:20:28.673793+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:28.673793+0000","last_undegraded":"2024-04-26T12:20:28.673793+0000","last_fullsized":"2024-04-26T12:20:28.673793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:42.215211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673302+0000","last_change":"2024-04-26T12:20:25.661093+0000","last_active":"2024-04-26T12:20:28.673302+0000","last_peered":"2024-04-26T12:20:28.673302+0000","last_clean":"2024-04-26T12:20:28.673302+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:20:28.673302+0000","last_undegraded":"2024-04-26T12:20:28.673302+0000","last_fullsized":"2024-04-26T12:20:28.673302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:42.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673207+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:28.673207+0000","last_peered":"2024-04-26T12:20:28.673207+0000","last_clean":"2024-04-26T12:20:28.673207+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:28.673207+0000","last_undegraded":"2024-04-26T12:20:28.673207+0000","last_fullsized":"2024-04-26T12:20:28.673207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:09.557685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423130+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:29.423130+0000","last_peered":"2024-04-26T12:20:29.423130+0000","last_clean":"2024-04-26T12:20:29.423130+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:29.423130+0000","last_undegraded":"2024-04-26T12:20:29.423130+0000","last_fullsized":"2024-04-26T12:20:29.423130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:12.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422739+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:29.422739+0000","last_peered":"2024-04-26T12:20:29.422739+0000","last_clean":"2024-04-26T12:20:29.422739+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:29.422739+0000","last_undegraded":"2024-04-26T12:20:29.422739+0000","last_fullsized":"2024-04-26T12:20:29.422739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673561+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:20:28.673561+0000","last_peered":"2024-04-26T12:20:28.673561+0000","last_clean":"2024-04-26T12:20:28.673561+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:28.673561+0000","last_undegraded":"2024-04-26T12:20:28.673561+0000","last_fullsized":"2024-04-26T12:20:28.673561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673220+0000","last_change":"2024-04-26T12:20:25.665062+0000","last_active":"2024-04-26T12:20:28.673220+0000","last_peered":"2024-04-26T12:20:28.673220+0000","last_clean":"2024-04-26T12:20:28.673220+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:28.673220+0000","last_undegraded":"2024-04-26T12:20:28.673220+0000","last_fullsized":"2024-04-26T12:20:28.673220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:01.241012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673566+0000","last_change":"2024-04-26T12:20:25.658932+0000","last_active":"2024-04-26T12:20:28.673566+0000","last_peered":"2024-04-26T12:20:28.673566+0000","last_clean":"2024-04-26T12:20:28.673566+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:28.673566+0000","last_undegraded":"2024-04-26T12:20:28.673566+0000","last_fullsized":"2024-04-26T12:20:28.673566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:37.375332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321304,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050536,"statfs":{"total":96636764160,"available":96307748864,"internally_reserved":0,"allocated":1454080,"data_stored":928586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:19:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.42499999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.60999999999999999,"5min":0.871,"15min":0.871},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.41899999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.58899999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579907,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29996,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341844,"statfs":{"total":96636764160,"available":96606048256,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483156,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888684,"statfs":{"total":96636764160,"available":96142012416,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.371,"5min":0.161,"15min":0.161},"max":{"1min":0.57099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.39300000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.68500000000000005,"5min":0.879,"15min":0.879},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:20:32.106 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:20:32.419 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:32.421 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:20:32.429 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T12:20:30.519337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834456,"kb_used_data":3692,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281064,"statfs":{"total":289910292480,"available":289055809536,"internally_reserved":0,"allocated":3780608,"data_stored":2205469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423367+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:29.423367+0000","last_peered":"2024-04-26T12:20:29.423367+0000","last_clean":"2024-04-26T12:20:29.423367+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:29.423367+0000","last_undegraded":"2024-04-26T12:20:29.423367+0000","last_fullsized":"2024-04-26T12:20:29.423367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423011+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:29.423011+0000","last_peered":"2024-04-26T12:20:29.423011+0000","last_clean":"2024-04-26T12:20:29.423011+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:29.423011+0000","last_undegraded":"2024-04-26T12:20:29.423011+0000","last_fullsized":"2024-04-26T12:20:29.423011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673852+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:28.673852+0000","last_peered":"2024-04-26T12:20:28.673852+0000","last_clean":"2024-04-26T12:20:28.673852+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:28.673852+0000","last_undegraded":"2024-04-26T12:20:28.673852+0000","last_fullsized":"2024-04-26T12:20:28.673852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:51.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673545+0000","last_change":"2024-04-26T12:20:25.662260+0000","last_active":"2024-04-26T12:20:28.673545+0000","last_peered":"2024-04-26T12:20:28.673545+0000","last_clean":"2024-04-26T12:20:28.673545+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:28.673545+0000","last_undegraded":"2024-04-26T12:20:28.673545+0000","last_fullsized":"2024-04-26T12:20:28.673545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:54.868104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422713+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:20:29.422713+0000","last_peered":"2024-04-26T12:20:29.422713+0000","last_clean":"2024-04-26T12:20:29.422713+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:20:29.422713+0000","last_undegraded":"2024-04-26T12:20:29.422713+0000","last_fullsized":"2024-04-26T12:20:29.422713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673502+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:28.673502+0000","last_peered":"2024-04-26T12:20:28.673502+0000","last_clean":"2024-04-26T12:20:28.673502+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:28.673502+0000","last_undegraded":"2024-04-26T12:20:28.673502+0000","last_fullsized":"2024-04-26T12:20:28.673502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:30.261523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:55.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672981+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:28.672981+0000","last_peered":"2024-04-26T12:20:28.672981+0000","last_clean":"2024-04-26T12:20:28.672981+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:28.672981+0000","last_undegraded":"2024-04-26T12:20:28.672981+0000","last_fullsized":"2024-04-26T12:20:28.672981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:24.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673427+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:28.673427+0000","last_peered":"2024-04-26T12:20:28.673427+0000","last_clean":"2024-04-26T12:20:28.673427+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:28.673427+0000","last_undegraded":"2024-04-26T12:20:28.673427+0000","last_fullsized":"2024-04-26T12:20:28.673427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423142+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:20:29.423142+0000","last_peered":"2024-04-26T12:20:29.423142+0000","last_clean":"2024-04-26T12:20:29.423142+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:29.423142+0000","last_undegraded":"2024-04-26T12:20:29.423142+0000","last_fullsized":"2024-04-26T12:20:29.423142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:47.821001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422776+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:29.422776+0000","last_peered":"2024-04-26T12:20:29.422776+0000","last_clean":"2024-04-26T12:20:29.422776+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:29.422776+0000","last_undegraded":"2024-04-26T12:20:29.422776+0000","last_fullsized":"2024-04-26T12:20:29.422776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:17.945553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422552+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:29.422552+0000","last_peered":"2024-04-26T12:20:29.422552+0000","last_clean":"2024-04-26T12:20:29.422552+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:29.422552+0000","last_undegraded":"2024-04-26T12:20:29.422552+0000","last_fullsized":"2024-04-26T12:20:29.422552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673434+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:28.673434+0000","last_peered":"2024-04-26T12:20:28.673434+0000","last_clean":"2024-04-26T12:20:28.673434+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:28.673434+0000","last_undegraded":"2024-04-26T12:20:28.673434+0000","last_fullsized":"2024-04-26T12:20:28.673434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:52.220501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673130+0000","last_change":"2024-04-26T12:20:25.658158+0000","last_active":"2024-04-26T12:20:28.673130+0000","last_peered":"2024-04-26T12:20:28.673130+0000","last_clean":"2024-04-26T12:20:28.673130+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:20:28.673130+0000","last_undegraded":"2024-04-26T12:20:28.673130+0000","last_fullsized":"2024-04-26T12:20:28.673130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:55.017516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673289+0000","last_change":"2024-04-26T12:20:25.664916+0000","last_active":"2024-04-26T12:20:28.673289+0000","last_peered":"2024-04-26T12:20:28.673289+0000","last_clean":"2024-04-26T12:20:28.673289+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:28.673289+0000","last_undegraded":"2024-04-26T12:20:28.673289+0000","last_fullsized":"2024-04-26T12:20:28.673289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:10.630467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673669+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:28.673669+0000","last_peered":"2024-04-26T12:20:28.673669+0000","last_clean":"2024-04-26T12:20:28.673669+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673669+0000","last_undegraded":"2024-04-26T12:20:28.673669+0000","last_fullsized":"2024-04-26T12:20:28.673669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423252+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:20:29.423252+0000","last_peered":"2024-04-26T12:20:29.423252+0000","last_clean":"2024-04-26T12:20:29.423252+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:29.423252+0000","last_undegraded":"2024-04-26T12:20:29.423252+0000","last_fullsized":"2024-04-26T12:20:29.423252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673295+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:28.673295+0000","last_peered":"2024-04-26T12:20:28.673295+0000","last_clean":"2024-04-26T12:20:28.673295+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:28.673295+0000","last_undegraded":"2024-04-26T12:20:28.673295+0000","last_fullsized":"2024-04-26T12:20:28.673295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673685+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:28.673685+0000","last_peered":"2024-04-26T12:20:28.673685+0000","last_clean":"2024-04-26T12:20:28.673685+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:28.673685+0000","last_undegraded":"2024-04-26T12:20:28.673685+0000","last_fullsized":"2024-04-26T12:20:28.673685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.225357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673896+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:28.673896+0000","last_peered":"2024-04-26T12:20:28.673896+0000","last_clean":"2024-04-26T12:20:28.673896+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:28.673896+0000","last_undegraded":"2024-04-26T12:20:28.673896+0000","last_fullsized":"2024-04-26T12:20:28.673896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:31.708071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422472+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:29.422472+0000","last_peered":"2024-04-26T12:20:29.422472+0000","last_clean":"2024-04-26T12:20:29.422472+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:29.422472+0000","last_undegraded":"2024-04-26T12:20:29.422472+0000","last_fullsized":"2024-04-26T12:20:29.422472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:58.603217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672548+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:28.672548+0000","last_peered":"2024-04-26T12:20:28.672548+0000","last_clean":"2024-04-26T12:20:28.672548+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:28.672548+0000","last_undegraded":"2024-04-26T12:20:28.672548+0000","last_fullsized":"2024-04-26T12:20:28.672548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:34.377929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422389+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:29.422389+0000","last_peered":"2024-04-26T12:20:29.422389+0000","last_clean":"2024-04-26T12:20:29.422389+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:29.422389+0000","last_undegraded":"2024-04-26T12:20:29.422389+0000","last_fullsized":"2024-04-26T12:20:29.422389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423356+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:29.423356+0000","last_peered":"2024-04-26T12:20:29.423356+0000","last_clean":"2024-04-26T12:20:29.423356+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:29.423356+0000","last_undegraded":"2024-04-26T12:20:29.423356+0000","last_fullsized":"2024-04-26T12:20:29.423356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:07.619412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673433+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:28.673433+0000","last_peered":"2024-04-26T12:20:28.673433+0000","last_clean":"2024-04-26T12:20:28.673433+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:28.673433+0000","last_undegraded":"2024-04-26T12:20:28.673433+0000","last_fullsized":"2024-04-26T12:20:28.673433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:18.666244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673765+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:28.673765+0000","last_peered":"2024-04-26T12:20:28.673765+0000","last_clean":"2024-04-26T12:20:28.673765+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:28.673765+0000","last_undegraded":"2024-04-26T12:20:28.673765+0000","last_fullsized":"2024-04-26T12:20:28.673765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:39.629549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423064+0000","last_change":"2024-04-26T12:20:25.665113+0000","last_active":"2024-04-26T12:20:29.423064+0000","last_peered":"2024-04-26T12:20:29.423064+0000","last_clean":"2024-04-26T12:20:29.423064+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:29.423064+0000","last_undegraded":"2024-04-26T12:20:29.423064+0000","last_fullsized":"2024-04-26T12:20:29.423064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:47.401100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672985+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:28.672985+0000","last_peered":"2024-04-26T12:20:28.672985+0000","last_clean":"2024-04-26T12:20:28.672985+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:28.672985+0000","last_undegraded":"2024-04-26T12:20:28.672985+0000","last_fullsized":"2024-04-26T12:20:28.672985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422843+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:29.422843+0000","last_peered":"2024-04-26T12:20:29.422843+0000","last_clean":"2024-04-26T12:20:29.422843+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:29.422843+0000","last_undegraded":"2024-04-26T12:20:29.422843+0000","last_fullsized":"2024-04-26T12:20:29.422843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.807141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672610+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:28.672610+0000","last_peered":"2024-04-26T12:20:28.672610+0000","last_clean":"2024-04-26T12:20:28.672610+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:28.672610+0000","last_undegraded":"2024-04-26T12:20:28.672610+0000","last_fullsized":"2024-04-26T12:20:28.672610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672844+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:28.672844+0000","last_peered":"2024-04-26T12:20:28.672844+0000","last_clean":"2024-04-26T12:20:28.672844+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:28.672844+0000","last_undegraded":"2024-04-26T12:20:28.672844+0000","last_fullsized":"2024-04-26T12:20:28.672844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:27.038124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422911+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:20:29.422911+0000","last_peered":"2024-04-26T12:20:29.422911+0000","last_clean":"2024-04-26T12:20:29.422911+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:20:29.422911+0000","last_undegraded":"2024-04-26T12:20:29.422911+0000","last_fullsized":"2024-04-26T12:20:29.422911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673469+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:28.673469+0000","last_peered":"2024-04-26T12:20:28.673469+0000","last_clean":"2024-04-26T12:20:28.673469+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:28.673469+0000","last_undegraded":"2024-04-26T12:20:28.673469+0000","last_fullsized":"2024-04-26T12:20:28.673469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:02.210041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423117+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:20:29.423117+0000","last_peered":"2024-04-26T12:20:29.423117+0000","last_clean":"2024-04-26T12:20:29.423117+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:29.423117+0000","last_undegraded":"2024-04-26T12:20:29.423117+0000","last_fullsized":"2024-04-26T12:20:29.423117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672907+0000","last_change":"2024-04-26T12:20:25.659060+0000","last_active":"2024-04-26T12:20:28.672907+0000","last_peered":"2024-04-26T12:20:28.672907+0000","last_clean":"2024-04-26T12:20:28.672907+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:28.672907+0000","last_undegraded":"2024-04-26T12:20:28.672907+0000","last_fullsized":"2024-04-26T12:20:28.672907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:23.462778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673599+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:28.673599+0000","last_peered":"2024-04-26T12:20:28.673599+0000","last_clean":"2024-04-26T12:20:28.673599+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:28.673599+0000","last_undegraded":"2024-04-26T12:20:28.673599+0000","last_fullsized":"2024-04-26T12:20:28.673599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:42.068061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422634+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:29.422634+0000","last_peered":"2024-04-26T12:20:29.422634+0000","last_clean":"2024-04-26T12:20:29.422634+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:29.422634+0000","last_undegraded":"2024-04-26T12:20:29.422634+0000","last_fullsized":"2024-04-26T12:20:29.422634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:33.454616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673440+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:28.673440+0000","last_peered":"2024-04-26T12:20:28.673440+0000","last_clean":"2024-04-26T12:20:28.673440+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:28.673440+0000","last_undegraded":"2024-04-26T12:20:28.673440+0000","last_fullsized":"2024-04-26T12:20:28.673440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:34.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672867+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:28.672867+0000","last_peered":"2024-04-26T12:20:28.672867+0000","last_clean":"2024-04-26T12:20:28.672867+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:28.672867+0000","last_undegraded":"2024-04-26T12:20:28.672867+0000","last_fullsized":"2024-04-26T12:20:28.672867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:27.283599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.209742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422375+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:29.422375+0000","last_peered":"2024-04-26T12:20:29.422375+0000","last_clean":"2024-04-26T12:20:29.422375+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:29.422375+0000","last_undegraded":"2024-04-26T12:20:29.422375+0000","last_fullsized":"2024-04-26T12:20:29.422375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:57.793936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423352+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:29.423352+0000","last_peered":"2024-04-26T12:20:29.423352+0000","last_clean":"2024-04-26T12:20:29.423352+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:29.423352+0000","last_undegraded":"2024-04-26T12:20:29.423352+0000","last_fullsized":"2024-04-26T12:20:29.423352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:51.515487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422363+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:29.422363+0000","last_peered":"2024-04-26T12:20:29.422363+0000","last_clean":"2024-04-26T12:20:29.422363+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:29.422363+0000","last_undegraded":"2024-04-26T12:20:29.422363+0000","last_fullsized":"2024-04-26T12:20:29.422363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:16.407869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673570+0000","last_change":"2024-04-26T12:20:25.663801+0000","last_active":"2024-04-26T12:20:28.673570+0000","last_peered":"2024-04-26T12:20:28.673570+0000","last_clean":"2024-04-26T12:20:28.673570+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:28.673570+0000","last_undegraded":"2024-04-26T12:20:28.673570+0000","last_fullsized":"2024-04-26T12:20:28.673570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:34.758119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673579+0000","last_change":"2024-04-26T12:20:25.663958+0000","last_active":"2024-04-26T12:20:28.673579+0000","last_peered":"2024-04-26T12:20:28.673579+0000","last_clean":"2024-04-26T12:20:28.673579+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:28.673579+0000","last_undegraded":"2024-04-26T12:20:28.673579+0000","last_fullsized":"2024-04-26T12:20:28.673579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:55.763498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673040+0000","last_change":"2024-04-26T12:20:25.658968+0000","last_active":"2024-04-26T12:20:28.673040+0000","last_peered":"2024-04-26T12:20:28.673040+0000","last_clean":"2024-04-26T12:20:28.673040+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:28.673040+0000","last_undegraded":"2024-04-26T12:20:28.673040+0000","last_fullsized":"2024-04-26T12:20:28.673040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:59.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673145+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:28.673145+0000","last_peered":"2024-04-26T12:20:28.673145+0000","last_clean":"2024-04-26T12:20:28.673145+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:28.673145+0000","last_undegraded":"2024-04-26T12:20:28.673145+0000","last_fullsized":"2024-04-26T12:20:28.673145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:48.149555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673934+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:28.673934+0000","last_peered":"2024-04-26T12:20:28.673934+0000","last_clean":"2024-04-26T12:20:28.673934+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:28.673934+0000","last_undegraded":"2024-04-26T12:20:28.673934+0000","last_fullsized":"2024-04-26T12:20:28.673934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:07.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673055+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:28.673055+0000","last_peered":"2024-04-26T12:20:28.673055+0000","last_clean":"2024-04-26T12:20:28.673055+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:28.673055+0000","last_undegraded":"2024-04-26T12:20:28.673055+0000","last_fullsized":"2024-04-26T12:20:28.673055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:43.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.665885+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:54.789896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422569+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:29.422569+0000","last_peered":"2024-04-26T12:20:29.422569+0000","last_clean":"2024-04-26T12:20:29.422569+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422569+0000","last_undegraded":"2024-04-26T12:20:29.422569+0000","last_fullsized":"2024-04-26T12:20:29.422569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:28.598257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.674018+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:28.674018+0000","last_peered":"2024-04-26T12:20:28.674018+0000","last_clean":"2024-04-26T12:20:28.674018+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:28.674018+0000","last_undegraded":"2024-04-26T12:20:28.674018+0000","last_fullsized":"2024-04-26T12:20:28.674018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.969416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422582+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:29.422582+0000","last_peered":"2024-04-26T12:20:29.422582+0000","last_clean":"2024-04-26T12:20:29.422582+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:29.422582+0000","last_undegraded":"2024-04-26T12:20:29.422582+0000","last_fullsized":"2024-04-26T12:20:29.422582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673506+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:20:28.673506+0000","last_peered":"2024-04-26T12:20:28.673506+0000","last_clean":"2024-04-26T12:20:28.673506+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:28.673506+0000","last_undegraded":"2024-04-26T12:20:28.673506+0000","last_fullsized":"2024-04-26T12:20:28.673506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672738+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:28.672738+0000","last_peered":"2024-04-26T12:20:28.672738+0000","last_clean":"2024-04-26T12:20:28.672738+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:28.672738+0000","last_undegraded":"2024-04-26T12:20:28.672738+0000","last_fullsized":"2024-04-26T12:20:28.672738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:21.176687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673105+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:28.673105+0000","last_peered":"2024-04-26T12:20:28.673105+0000","last_clean":"2024-04-26T12:20:28.673105+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:28.673105+0000","last_undegraded":"2024-04-26T12:20:28.673105+0000","last_fullsized":"2024-04-26T12:20:28.673105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.367763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673044+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:28.673044+0000","last_peered":"2024-04-26T12:20:28.673044+0000","last_clean":"2024-04-26T12:20:28.673044+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:28.673044+0000","last_undegraded":"2024-04-26T12:20:28.673044+0000","last_fullsized":"2024-04-26T12:20:28.673044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673730+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:28.673730+0000","last_peered":"2024-04-26T12:20:28.673730+0000","last_clean":"2024-04-26T12:20:28.673730+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:28.673730+0000","last_undegraded":"2024-04-26T12:20:28.673730+0000","last_fullsized":"2024-04-26T12:20:28.673730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:40.929552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673133+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:28.673133+0000","last_peered":"2024-04-26T12:20:28.673133+0000","last_clean":"2024-04-26T12:20:28.673133+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:28.673133+0000","last_undegraded":"2024-04-26T12:20:28.673133+0000","last_fullsized":"2024-04-26T12:20:28.673133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:22.695257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672781+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:28.672781+0000","last_peered":"2024-04-26T12:20:28.672781+0000","last_clean":"2024-04-26T12:20:28.672781+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:28.672781+0000","last_undegraded":"2024-04-26T12:20:28.672781+0000","last_fullsized":"2024-04-26T12:20:28.672781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:56.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423141+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:29.423141+0000","last_peered":"2024-04-26T12:20:29.423141+0000","last_clean":"2024-04-26T12:20:29.423141+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:29.423141+0000","last_undegraded":"2024-04-26T12:20:29.423141+0000","last_fullsized":"2024-04-26T12:20:29.423141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672912+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:28.672912+0000","last_peered":"2024-04-26T12:20:28.672912+0000","last_clean":"2024-04-26T12:20:28.672912+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:28.672912+0000","last_undegraded":"2024-04-26T12:20:28.672912+0000","last_fullsized":"2024-04-26T12:20:28.672912+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422741+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:29.422741+0000","last_peered":"2024-04-26T12:20:29.422741+0000","last_clean":"2024-04-26T12:20:29.422741+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422741+0000","last_undegraded":"2024-04-26T12:20:29.422741+0000","last_fullsized":"2024-04-26T12:20:29.422741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:47.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673527+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:20:28.673527+0000","last_peered":"2024-04-26T12:20:28.673527+0000","last_clean":"2024-04-26T12:20:28.673527+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673527+0000","last_undegraded":"2024-04-26T12:20:28.673527+0000","last_fullsized":"2024-04-26T12:20:28.673527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672986+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:28.672986+0000","last_peered":"2024-04-26T12:20:28.672986+0000","last_clean":"2024-04-26T12:20:28.672986+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:28.672986+0000","last_undegraded":"2024-04-26T12:20:28.672986+0000","last_fullsized":"2024-04-26T12:20:28.672986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:30.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673218+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:28.673218+0000","last_peered":"2024-04-26T12:20:28.673218+0000","last_clean":"2024-04-26T12:20:28.673218+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:28.673218+0000","last_undegraded":"2024-04-26T12:20:28.673218+0000","last_fullsized":"2024-04-26T12:20:28.673218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:00.363391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673325+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:20:28.673325+0000","last_peered":"2024-04-26T12:20:28.673325+0000","last_clean":"2024-04-26T12:20:28.673325+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:28.673325+0000","last_undegraded":"2024-04-26T12:20:28.673325+0000","last_fullsized":"2024-04-26T12:20:28.673325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673402+0000","last_change":"2024-04-26T12:20:25.664519+0000","last_active":"2024-04-26T12:20:28.673402+0000","last_peered":"2024-04-26T12:20:28.673402+0000","last_clean":"2024-04-26T12:20:28.673402+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:20:28.673402+0000","last_undegraded":"2024-04-26T12:20:28.673402+0000","last_fullsized":"2024-04-26T12:20:28.673402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.722939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673432+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:28.673432+0000","last_peered":"2024-04-26T12:20:28.673432+0000","last_clean":"2024-04-26T12:20:28.673432+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:28.673432+0000","last_undegraded":"2024-04-26T12:20:28.673432+0000","last_fullsized":"2024-04-26T12:20:28.673432+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422524+0000","last_change":"2024-04-26T12:20:25.659186+0000","last_active":"2024-04-26T12:20:29.422524+0000","last_peered":"2024-04-26T12:20:29.422524+0000","last_clean":"2024-04-26T12:20:29.422524+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:29.422524+0000","last_undegraded":"2024-04-26T12:20:29.422524+0000","last_fullsized":"2024-04-26T12:20:29.422524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:07.818179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673359+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:20:28.673359+0000","last_peered":"2024-04-26T12:20:28.673359+0000","last_clean":"2024-04-26T12:20:28.673359+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:20:28.673359+0000","last_undegraded":"2024-04-26T12:20:28.673359+0000","last_fullsized":"2024-04-26T12:20:28.673359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423388+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:29.423388+0000","last_peered":"2024-04-26T12:20:29.423388+0000","last_clean":"2024-04-26T12:20:29.423388+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:29.423388+0000","last_undegraded":"2024-04-26T12:20:29.423388+0000","last_fullsized":"2024-04-26T12:20:29.423388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422694+0000","last_change":"2024-04-26T12:20:25.659917+0000","last_active":"2024-04-26T12:20:29.422694+0000","last_peered":"2024-04-26T12:20:29.422694+0000","last_clean":"2024-04-26T12:20:29.422694+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:20:29.422694+0000","last_undegraded":"2024-04-26T12:20:29.422694+0000","last_fullsized":"2024-04-26T12:20:29.422694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:34.505551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673690+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:28.673690+0000","last_peered":"2024-04-26T12:20:28.673690+0000","last_clean":"2024-04-26T12:20:28.673690+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:28.673690+0000","last_undegraded":"2024-04-26T12:20:28.673690+0000","last_fullsized":"2024-04-26T12:20:28.673690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673666+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:28.673666+0000","last_peered":"2024-04-26T12:20:28.673666+0000","last_clean":"2024-04-26T12:20:28.673666+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:28.673666+0000","last_undegraded":"2024-04-26T12:20:28.673666+0000","last_fullsized":"2024-04-26T12:20:28.673666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672759+0000","last_change":"2024-04-26T12:20:25.658800+0000","last_active":"2024-04-26T12:20:28.672759+0000","last_peered":"2024-04-26T12:20:28.672759+0000","last_clean":"2024-04-26T12:20:28.672759+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:28.672759+0000","last_undegraded":"2024-04-26T12:20:28.672759+0000","last_fullsized":"2024-04-26T12:20:28.672759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:22.287193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673658+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:28.673658+0000","last_peered":"2024-04-26T12:20:28.673658+0000","last_clean":"2024-04-26T12:20:28.673658+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:28.673658+0000","last_undegraded":"2024-04-26T12:20:28.673658+0000","last_fullsized":"2024-04-26T12:20:28.673658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:10.121046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673823+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:28.673823+0000","last_peered":"2024-04-26T12:20:28.673823+0000","last_clean":"2024-04-26T12:20:28.673823+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:28.673823+0000","last_undegraded":"2024-04-26T12:20:28.673823+0000","last_fullsized":"2024-04-26T12:20:28.673823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:23.294093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422374+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:29.422374+0000","last_peered":"2024-04-26T12:20:29.422374+0000","last_clean":"2024-04-26T12:20:29.422374+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:29.422374+0000","last_undegraded":"2024-04-26T12:20:29.422374+0000","last_fullsized":"2024-04-26T12:20:29.422374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:22.842329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673624+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:28.673624+0000","last_peered":"2024-04-26T12:20:28.673624+0000","last_clean":"2024-04-26T12:20:28.673624+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:28.673624+0000","last_undegraded":"2024-04-26T12:20:28.673624+0000","last_fullsized":"2024-04-26T12:20:28.673624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:22.219973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:56.257240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672799+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:20:28.672799+0000","last_peered":"2024-04-26T12:20:28.672799+0000","last_clean":"2024-04-26T12:20:28.672799+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:20:28.672799+0000","last_undegraded":"2024-04-26T12:20:28.672799+0000","last_fullsized":"2024-04-26T12:20:28.672799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423272+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:29.423272+0000","last_peered":"2024-04-26T12:20:29.423272+0000","last_clean":"2024-04-26T12:20:29.423272+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:29.423272+0000","last_undegraded":"2024-04-26T12:20:29.423272+0000","last_fullsized":"2024-04-26T12:20:29.423272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.194671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673846+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:28.673846+0000","last_peered":"2024-04-26T12:20:28.673846+0000","last_clean":"2024-04-26T12:20:28.673846+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:28.673846+0000","last_undegraded":"2024-04-26T12:20:28.673846+0000","last_fullsized":"2024-04-26T12:20:28.673846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:41.999607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672646+0000","last_change":"2024-04-26T12:20:25.658549+0000","last_active":"2024-04-26T12:20:28.672646+0000","last_peered":"2024-04-26T12:20:28.672646+0000","last_clean":"2024-04-26T12:20:28.672646+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:28.672646+0000","last_undegraded":"2024-04-26T12:20:28.672646+0000","last_fullsized":"2024-04-26T12:20:28.672646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:26.372988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.658453+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:25.063788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672741+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:20:28.672741+0000","last_peered":"2024-04-26T12:20:28.672741+0000","last_clean":"2024-04-26T12:20:28.672741+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:28.672741+0000","last_undegraded":"2024-04-26T12:20:28.672741+0000","last_fullsized":"2024-04-26T12:20:28.672741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423415+0000","last_change":"2024-04-26T12:20:25.664482+0000","last_active":"2024-04-26T12:20:29.423415+0000","last_peered":"2024-04-26T12:20:29.423415+0000","last_clean":"2024-04-26T12:20:29.423415+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:29.423415+0000","last_undegraded":"2024-04-26T12:20:29.423415+0000","last_fullsized":"2024-04-26T12:20:29.423415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:15.256206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672847+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:28.672847+0000","last_peered":"2024-04-26T12:20:28.672847+0000","last_clean":"2024-04-26T12:20:28.672847+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:28.672847+0000","last_undegraded":"2024-04-26T12:20:28.672847+0000","last_fullsized":"2024-04-26T12:20:28.672847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673444+0000","last_change":"2024-04-26T12:20:25.659459+0000","last_active":"2024-04-26T12:20:28.673444+0000","last_peered":"2024-04-26T12:20:28.673444+0000","last_clean":"2024-04-26T12:20:28.673444+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:28.673444+0000","last_undegraded":"2024-04-26T12:20:28.673444+0000","last_fullsized":"2024-04-26T12:20:28.673444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:08.246812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672776+0000","last_change":"2024-04-26T12:20:25.659064+0000","last_active":"2024-04-26T12:20:28.672776+0000","last_peered":"2024-04-26T12:20:28.672776+0000","last_clean":"2024-04-26T12:20:28.672776+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:20:28.672776+0000","last_undegraded":"2024-04-26T12:20:28.672776+0000","last_fullsized":"2024-04-26T12:20:28.672776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:46.130193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423024+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:29.423024+0000","last_peered":"2024-04-26T12:20:29.423024+0000","last_clean":"2024-04-26T12:20:29.423024+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:29.423024+0000","last_undegraded":"2024-04-26T12:20:29.423024+0000","last_fullsized":"2024-04-26T12:20:29.423024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:37.387665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422819+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:29.422819+0000","last_peered":"2024-04-26T12:20:29.422819+0000","last_clean":"2024-04-26T12:20:29.422819+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:29.422819+0000","last_undegraded":"2024-04-26T12:20:29.422819+0000","last_fullsized":"2024-04-26T12:20:29.422819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422926+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:29.422926+0000","last_peered":"2024-04-26T12:20:29.422926+0000","last_clean":"2024-04-26T12:20:29.422926+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:29.422926+0000","last_undegraded":"2024-04-26T12:20:29.422926+0000","last_fullsized":"2024-04-26T12:20:29.422926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422854+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:29.422854+0000","last_peered":"2024-04-26T12:20:29.422854+0000","last_clean":"2024-04-26T12:20:29.422854+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:29.422854+0000","last_undegraded":"2024-04-26T12:20:29.422854+0000","last_fullsized":"2024-04-26T12:20:29.422854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:48.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673793+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:28.673793+0000","last_peered":"2024-04-26T12:20:28.673793+0000","last_clean":"2024-04-26T12:20:28.673793+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:28.673793+0000","last_undegraded":"2024-04-26T12:20:28.673793+0000","last_fullsized":"2024-04-26T12:20:28.673793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:42.215211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673302+0000","last_change":"2024-04-26T12:20:25.661093+0000","last_active":"2024-04-26T12:20:28.673302+0000","last_peered":"2024-04-26T12:20:28.673302+0000","last_clean":"2024-04-26T12:20:28.673302+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:20:28.673302+0000","last_undegraded":"2024-04-26T12:20:28.673302+0000","last_fullsized":"2024-04-26T12:20:28.673302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:42.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673207+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:28.673207+0000","last_peered":"2024-04-26T12:20:28.673207+0000","last_clean":"2024-04-26T12:20:28.673207+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:28.673207+0000","last_undegraded":"2024-04-26T12:20:28.673207+0000","last_fullsized":"2024-04-26T12:20:28.673207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:09.557685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423130+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:29.423130+0000","last_peered":"2024-04-26T12:20:29.423130+0000","last_clean":"2024-04-26T12:20:29.423130+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:29.423130+0000","last_undegraded":"2024-04-26T12:20:29.423130+0000","last_fullsized":"2024-04-26T12:20:29.423130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:12.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422739+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:29.422739+0000","last_peered":"2024-04-26T12:20:29.422739+0000","last_clean":"2024-04-26T12:20:29.422739+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:29.422739+0000","last_undegraded":"2024-04-26T12:20:29.422739+0000","last_fullsized":"2024-04-26T12:20:29.422739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673561+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:20:28.673561+0000","last_peered":"2024-04-26T12:20:28.673561+0000","last_clean":"2024-04-26T12:20:28.673561+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:28.673561+0000","last_undegraded":"2024-04-26T12:20:28.673561+0000","last_fullsized":"2024-04-26T12:20:28.673561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673220+0000","last_change":"2024-04-26T12:20:25.665062+0000","last_active":"2024-04-26T12:20:28.673220+0000","last_peered":"2024-04-26T12:20:28.673220+0000","last_clean":"2024-04-26T12:20:28.673220+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:28.673220+0000","last_undegraded":"2024-04-26T12:20:28.673220+0000","last_fullsized":"2024-04-26T12:20:28.673220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:01.241012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673566+0000","last_change":"2024-04-26T12:20:25.658932+0000","last_active":"2024-04-26T12:20:28.673566+0000","last_peered":"2024-04-26T12:20:28.673566+0000","last_clean":"2024-04-26T12:20:28.673566+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:28.673566+0000","last_undegraded":"2024-04-26T12:20:28.673566+0000","last_fullsized":"2024-04-26T12:20:28.673566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:37.375332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321304,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050536,"statfs":{"total":96636764160,"available":96307748864,"internally_reserved":0,"allocated":1454080,"data_stored":928586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:19:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.42499999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.60999999999999999,"5min":0.871,"15min":0.871},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.41899999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.58899999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579907,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29996,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341844,"statfs":{"total":96636764160,"available":96606048256,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483156,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888684,"statfs":{"total":96636764160,"available":96142012416,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.371,"5min":0.161,"15min":0.161},"max":{"1min":0.57099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.39300000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.68500000000000005,"5min":0.879,"15min":0.879},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:20:32.434 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:20:32.434 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:20:32.754 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:20:32.762 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-26T12:20:32.519862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834468,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281052,"statfs":{"total":289910292480,"available":289055797248,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-23,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.865364"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423367+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:29.423367+0000","last_peered":"2024-04-26T12:20:29.423367+0000","last_clean":"2024-04-26T12:20:29.423367+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:29.423367+0000","last_undegraded":"2024-04-26T12:20:29.423367+0000","last_fullsized":"2024-04-26T12:20:29.423367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423011+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:29.423011+0000","last_peered":"2024-04-26T12:20:29.423011+0000","last_clean":"2024-04-26T12:20:29.423011+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:29.423011+0000","last_undegraded":"2024-04-26T12:20:29.423011+0000","last_fullsized":"2024-04-26T12:20:29.423011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673852+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:28.673852+0000","last_peered":"2024-04-26T12:20:28.673852+0000","last_clean":"2024-04-26T12:20:28.673852+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:28.673852+0000","last_undegraded":"2024-04-26T12:20:28.673852+0000","last_fullsized":"2024-04-26T12:20:28.673852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:51.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673545+0000","last_change":"2024-04-26T12:20:25.662260+0000","last_active":"2024-04-26T12:20:28.673545+0000","last_peered":"2024-04-26T12:20:28.673545+0000","last_clean":"2024-04-26T12:20:28.673545+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:28.673545+0000","last_undegraded":"2024-04-26T12:20:28.673545+0000","last_fullsized":"2024-04-26T12:20:28.673545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:54.868104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422713+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:20:29.422713+0000","last_peered":"2024-04-26T12:20:29.422713+0000","last_clean":"2024-04-26T12:20:29.422713+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:20:29.422713+0000","last_undegraded":"2024-04-26T12:20:29.422713+0000","last_fullsized":"2024-04-26T12:20:29.422713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673502+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:28.673502+0000","last_peered":"2024-04-26T12:20:28.673502+0000","last_clean":"2024-04-26T12:20:28.673502+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:28.673502+0000","last_undegraded":"2024-04-26T12:20:28.673502+0000","last_fullsized":"2024-04-26T12:20:28.673502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:30.261523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:55.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672981+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:28.672981+0000","last_peered":"2024-04-26T12:20:28.672981+0000","last_clean":"2024-04-26T12:20:28.672981+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:28.672981+0000","last_undegraded":"2024-04-26T12:20:28.672981+0000","last_fullsized":"2024-04-26T12:20:28.672981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:24.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673427+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:28.673427+0000","last_peered":"2024-04-26T12:20:28.673427+0000","last_clean":"2024-04-26T12:20:28.673427+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:28.673427+0000","last_undegraded":"2024-04-26T12:20:28.673427+0000","last_fullsized":"2024-04-26T12:20:28.673427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423142+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:20:29.423142+0000","last_peered":"2024-04-26T12:20:29.423142+0000","last_clean":"2024-04-26T12:20:29.423142+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:29.423142+0000","last_undegraded":"2024-04-26T12:20:29.423142+0000","last_fullsized":"2024-04-26T12:20:29.423142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:47.821001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422776+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:29.422776+0000","last_peered":"2024-04-26T12:20:29.422776+0000","last_clean":"2024-04-26T12:20:29.422776+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:29.422776+0000","last_undegraded":"2024-04-26T12:20:29.422776+0000","last_fullsized":"2024-04-26T12:20:29.422776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:17.945553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422552+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:29.422552+0000","last_peered":"2024-04-26T12:20:29.422552+0000","last_clean":"2024-04-26T12:20:29.422552+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:29.422552+0000","last_undegraded":"2024-04-26T12:20:29.422552+0000","last_fullsized":"2024-04-26T12:20:29.422552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673434+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:28.673434+0000","last_peered":"2024-04-26T12:20:28.673434+0000","last_clean":"2024-04-26T12:20:28.673434+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:28.673434+0000","last_undegraded":"2024-04-26T12:20:28.673434+0000","last_fullsized":"2024-04-26T12:20:28.673434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:52.220501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673130+0000","last_change":"2024-04-26T12:20:25.658158+0000","last_active":"2024-04-26T12:20:28.673130+0000","last_peered":"2024-04-26T12:20:28.673130+0000","last_clean":"2024-04-26T12:20:28.673130+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:20:28.673130+0000","last_undegraded":"2024-04-26T12:20:28.673130+0000","last_fullsized":"2024-04-26T12:20:28.673130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:55.017516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673289+0000","last_change":"2024-04-26T12:20:25.664916+0000","last_active":"2024-04-26T12:20:28.673289+0000","last_peered":"2024-04-26T12:20:28.673289+0000","last_clean":"2024-04-26T12:20:28.673289+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:28.673289+0000","last_undegraded":"2024-04-26T12:20:28.673289+0000","last_fullsized":"2024-04-26T12:20:28.673289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:10.630467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673669+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:28.673669+0000","last_peered":"2024-04-26T12:20:28.673669+0000","last_clean":"2024-04-26T12:20:28.673669+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673669+0000","last_undegraded":"2024-04-26T12:20:28.673669+0000","last_fullsized":"2024-04-26T12:20:28.673669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423252+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:20:29.423252+0000","last_peered":"2024-04-26T12:20:29.423252+0000","last_clean":"2024-04-26T12:20:29.423252+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:29.423252+0000","last_undegraded":"2024-04-26T12:20:29.423252+0000","last_fullsized":"2024-04-26T12:20:29.423252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673295+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:28.673295+0000","last_peered":"2024-04-26T12:20:28.673295+0000","last_clean":"2024-04-26T12:20:28.673295+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:28.673295+0000","last_undegraded":"2024-04-26T12:20:28.673295+0000","last_fullsized":"2024-04-26T12:20:28.673295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673685+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:28.673685+0000","last_peered":"2024-04-26T12:20:28.673685+0000","last_clean":"2024-04-26T12:20:28.673685+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:28.673685+0000","last_undegraded":"2024-04-26T12:20:28.673685+0000","last_fullsized":"2024-04-26T12:20:28.673685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.225357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673896+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:28.673896+0000","last_peered":"2024-04-26T12:20:28.673896+0000","last_clean":"2024-04-26T12:20:28.673896+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:28.673896+0000","last_undegraded":"2024-04-26T12:20:28.673896+0000","last_fullsized":"2024-04-26T12:20:28.673896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:31.708071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422472+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:29.422472+0000","last_peered":"2024-04-26T12:20:29.422472+0000","last_clean":"2024-04-26T12:20:29.422472+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:29.422472+0000","last_undegraded":"2024-04-26T12:20:29.422472+0000","last_fullsized":"2024-04-26T12:20:29.422472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:58.603217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672548+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:28.672548+0000","last_peered":"2024-04-26T12:20:28.672548+0000","last_clean":"2024-04-26T12:20:28.672548+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:28.672548+0000","last_undegraded":"2024-04-26T12:20:28.672548+0000","last_fullsized":"2024-04-26T12:20:28.672548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:34.377929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422389+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:29.422389+0000","last_peered":"2024-04-26T12:20:29.422389+0000","last_clean":"2024-04-26T12:20:29.422389+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:29.422389+0000","last_undegraded":"2024-04-26T12:20:29.422389+0000","last_fullsized":"2024-04-26T12:20:29.422389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423356+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:29.423356+0000","last_peered":"2024-04-26T12:20:29.423356+0000","last_clean":"2024-04-26T12:20:29.423356+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:29.423356+0000","last_undegraded":"2024-04-26T12:20:29.423356+0000","last_fullsized":"2024-04-26T12:20:29.423356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:07.619412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673433+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:28.673433+0000","last_peered":"2024-04-26T12:20:28.673433+0000","last_clean":"2024-04-26T12:20:28.673433+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:28.673433+0000","last_undegraded":"2024-04-26T12:20:28.673433+0000","last_fullsized":"2024-04-26T12:20:28.673433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:18.666244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673765+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:28.673765+0000","last_peered":"2024-04-26T12:20:28.673765+0000","last_clean":"2024-04-26T12:20:28.673765+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:28.673765+0000","last_undegraded":"2024-04-26T12:20:28.673765+0000","last_fullsized":"2024-04-26T12:20:28.673765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:39.629549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423064+0000","last_change":"2024-04-26T12:20:25.665113+0000","last_active":"2024-04-26T12:20:29.423064+0000","last_peered":"2024-04-26T12:20:29.423064+0000","last_clean":"2024-04-26T12:20:29.423064+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:29.423064+0000","last_undegraded":"2024-04-26T12:20:29.423064+0000","last_fullsized":"2024-04-26T12:20:29.423064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:47.401100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672985+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:28.672985+0000","last_peered":"2024-04-26T12:20:28.672985+0000","last_clean":"2024-04-26T12:20:28.672985+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:28.672985+0000","last_undegraded":"2024-04-26T12:20:28.672985+0000","last_fullsized":"2024-04-26T12:20:28.672985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422843+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:29.422843+0000","last_peered":"2024-04-26T12:20:29.422843+0000","last_clean":"2024-04-26T12:20:29.422843+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:29.422843+0000","last_undegraded":"2024-04-26T12:20:29.422843+0000","last_fullsized":"2024-04-26T12:20:29.422843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.807141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672610+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:28.672610+0000","last_peered":"2024-04-26T12:20:28.672610+0000","last_clean":"2024-04-26T12:20:28.672610+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:28.672610+0000","last_undegraded":"2024-04-26T12:20:28.672610+0000","last_fullsized":"2024-04-26T12:20:28.672610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672844+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:28.672844+0000","last_peered":"2024-04-26T12:20:28.672844+0000","last_clean":"2024-04-26T12:20:28.672844+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:28.672844+0000","last_undegraded":"2024-04-26T12:20:28.672844+0000","last_fullsized":"2024-04-26T12:20:28.672844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:27.038124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422911+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:20:29.422911+0000","last_peered":"2024-04-26T12:20:29.422911+0000","last_clean":"2024-04-26T12:20:29.422911+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:20:29.422911+0000","last_undegraded":"2024-04-26T12:20:29.422911+0000","last_fullsized":"2024-04-26T12:20:29.422911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673469+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:28.673469+0000","last_peered":"2024-04-26T12:20:28.673469+0000","last_clean":"2024-04-26T12:20:28.673469+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:28.673469+0000","last_undegraded":"2024-04-26T12:20:28.673469+0000","last_fullsized":"2024-04-26T12:20:28.673469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:02.210041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423117+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:20:29.423117+0000","last_peered":"2024-04-26T12:20:29.423117+0000","last_clean":"2024-04-26T12:20:29.423117+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:29.423117+0000","last_undegraded":"2024-04-26T12:20:29.423117+0000","last_fullsized":"2024-04-26T12:20:29.423117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672907+0000","last_change":"2024-04-26T12:20:25.659060+0000","last_active":"2024-04-26T12:20:28.672907+0000","last_peered":"2024-04-26T12:20:28.672907+0000","last_clean":"2024-04-26T12:20:28.672907+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:28.672907+0000","last_undegraded":"2024-04-26T12:20:28.672907+0000","last_fullsized":"2024-04-26T12:20:28.672907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:23.462778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673599+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:28.673599+0000","last_peered":"2024-04-26T12:20:28.673599+0000","last_clean":"2024-04-26T12:20:28.673599+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:28.673599+0000","last_undegraded":"2024-04-26T12:20:28.673599+0000","last_fullsized":"2024-04-26T12:20:28.673599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:42.068061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422634+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:29.422634+0000","last_peered":"2024-04-26T12:20:29.422634+0000","last_clean":"2024-04-26T12:20:29.422634+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:29.422634+0000","last_undegraded":"2024-04-26T12:20:29.422634+0000","last_fullsized":"2024-04-26T12:20:29.422634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:33.454616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673440+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:28.673440+0000","last_peered":"2024-04-26T12:20:28.673440+0000","last_clean":"2024-04-26T12:20:28.673440+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:28.673440+0000","last_undegraded":"2024-04-26T12:20:28.673440+0000","last_fullsized":"2024-04-26T12:20:28.673440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:34.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672867+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:28.672867+0000","last_peered":"2024-04-26T12:20:28.672867+0000","last_clean":"2024-04-26T12:20:28.672867+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:28.672867+0000","last_undegraded":"2024-04-26T12:20:28.672867+0000","last_fullsized":"2024-04-26T12:20:28.672867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:27.283599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.209742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422375+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:29.422375+0000","last_peered":"2024-04-26T12:20:29.422375+0000","last_clean":"2024-04-26T12:20:29.422375+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:29.422375+0000","last_undegraded":"2024-04-26T12:20:29.422375+0000","last_fullsized":"2024-04-26T12:20:29.422375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:57.793936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423352+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:29.423352+0000","last_peered":"2024-04-26T12:20:29.423352+0000","last_clean":"2024-04-26T12:20:29.423352+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:29.423352+0000","last_undegraded":"2024-04-26T12:20:29.423352+0000","last_fullsized":"2024-04-26T12:20:29.423352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:51.515487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422363+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:29.422363+0000","last_peered":"2024-04-26T12:20:29.422363+0000","last_clean":"2024-04-26T12:20:29.422363+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:29.422363+0000","last_undegraded":"2024-04-26T12:20:29.422363+0000","last_fullsized":"2024-04-26T12:20:29.422363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:16.407869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673570+0000","last_change":"2024-04-26T12:20:25.663801+0000","last_active":"2024-04-26T12:20:28.673570+0000","last_peered":"2024-04-26T12:20:28.673570+0000","last_clean":"2024-04-26T12:20:28.673570+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:28.673570+0000","last_undegraded":"2024-04-26T12:20:28.673570+0000","last_fullsized":"2024-04-26T12:20:28.673570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:34.758119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673579+0000","last_change":"2024-04-26T12:20:25.663958+0000","last_active":"2024-04-26T12:20:28.673579+0000","last_peered":"2024-04-26T12:20:28.673579+0000","last_clean":"2024-04-26T12:20:28.673579+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:28.673579+0000","last_undegraded":"2024-04-26T12:20:28.673579+0000","last_fullsized":"2024-04-26T12:20:28.673579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:55.763498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673040+0000","last_change":"2024-04-26T12:20:25.658968+0000","last_active":"2024-04-26T12:20:28.673040+0000","last_peered":"2024-04-26T12:20:28.673040+0000","last_clean":"2024-04-26T12:20:28.673040+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:28.673040+0000","last_undegraded":"2024-04-26T12:20:28.673040+0000","last_fullsized":"2024-04-26T12:20:28.673040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:59.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673145+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:28.673145+0000","last_peered":"2024-04-26T12:20:28.673145+0000","last_clean":"2024-04-26T12:20:28.673145+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:28.673145+0000","last_undegraded":"2024-04-26T12:20:28.673145+0000","last_fullsized":"2024-04-26T12:20:28.673145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:48.149555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673934+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:28.673934+0000","last_peered":"2024-04-26T12:20:28.673934+0000","last_clean":"2024-04-26T12:20:28.673934+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:28.673934+0000","last_undegraded":"2024-04-26T12:20:28.673934+0000","last_fullsized":"2024-04-26T12:20:28.673934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:07.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673055+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:28.673055+0000","last_peered":"2024-04-26T12:20:28.673055+0000","last_clean":"2024-04-26T12:20:28.673055+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:28.673055+0000","last_undegraded":"2024-04-26T12:20:28.673055+0000","last_fullsized":"2024-04-26T12:20:28.673055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:43.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.665885+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:54.789896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422569+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:29.422569+0000","last_peered":"2024-04-26T12:20:29.422569+0000","last_clean":"2024-04-26T12:20:29.422569+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422569+0000","last_undegraded":"2024-04-26T12:20:29.422569+0000","last_fullsized":"2024-04-26T12:20:29.422569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:28.598257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.674018+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:28.674018+0000","last_peered":"2024-04-26T12:20:28.674018+0000","last_clean":"2024-04-26T12:20:28.674018+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:28.674018+0000","last_undegraded":"2024-04-26T12:20:28.674018+0000","last_fullsized":"2024-04-26T12:20:28.674018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.969416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422582+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:29.422582+0000","last_peered":"2024-04-26T12:20:29.422582+0000","last_clean":"2024-04-26T12:20:29.422582+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:29.422582+0000","last_undegraded":"2024-04-26T12:20:29.422582+0000","last_fullsized":"2024-04-26T12:20:29.422582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673506+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:20:28.673506+0000","last_peered":"2024-04-26T12:20:28.673506+0000","last_clean":"2024-04-26T12:20:28.673506+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:28.673506+0000","last_undegraded":"2024-04-26T12:20:28.673506+0000","last_fullsized":"2024-04-26T12:20:28.673506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672738+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:28.672738+0000","last_peered":"2024-04-26T12:20:28.672738+0000","last_clean":"2024-04-26T12:20:28.672738+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:28.672738+0000","last_undegraded":"2024-04-26T12:20:28.672738+0000","last_fullsized":"2024-04-26T12:20:28.672738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:21.176687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673105+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:28.673105+0000","last_peered":"2024-04-26T12:20:28.673105+0000","last_clean":"2024-04-26T12:20:28.673105+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:28.673105+0000","last_undegraded":"2024-04-26T12:20:28.673105+0000","last_fullsized":"2024-04-26T12:20:28.673105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.367763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673044+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:28.673044+0000","last_peered":"2024-04-26T12:20:28.673044+0000","last_clean":"2024-04-26T12:20:28.673044+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:28.673044+0000","last_undegraded":"2024-04-26T12:20:28.673044+0000","last_fullsized":"2024-04-26T12:20:28.673044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673730+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:28.673730+0000","last_peered":"2024-04-26T12:20:28.673730+0000","last_clean":"2024-04-26T12:20:28.673730+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:28.673730+0000","last_undegraded":"2024-04-26T12:20:28.673730+0000","last_fullsized":"2024-04-26T12:20:28.673730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:40.929552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673133+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:28.673133+0000","last_peered":"2024-04-26T12:20:28.673133+0000","last_clean":"2024-04-26T12:20:28.673133+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:28.673133+0000","last_undegraded":"2024-04-26T12:20:28.673133+0000","last_fullsized":"2024-04-26T12:20:28.673133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:22.695257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672781+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:28.672781+0000","last_peered":"2024-04-26T12:20:28.672781+0000","last_clean":"2024-04-26T12:20:28.672781+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:28.672781+0000","last_undegraded":"2024-04-26T12:20:28.672781+0000","last_fullsized":"2024-04-26T12:20:28.672781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:56.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423141+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:29.423141+0000","last_peered":"2024-04-26T12:20:29.423141+0000","last_clean":"2024-04-26T12:20:29.423141+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:29.423141+0000","last_undegraded":"2024-04-26T12:20:29.423141+0000","last_fullsized":"2024-04-26T12:20:29.423141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672912+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:28.672912+0000","last_peered":"2024-04-26T12:20:28.672912+0000","last_clean":"2024-04-26T12:20:28.672912+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:28.672912+0000","last_undegraded":"2024-04-26T12:20:28.672912+0000","last_fullsized":"2024-04-26T12:20:28.672912+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422741+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:29.422741+0000","last_peered":"2024-04-26T12:20:29.422741+0000","last_clean":"2024-04-26T12:20:29.422741+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422741+0000","last_undegraded":"2024-04-26T12:20:29.422741+0000","last_fullsized":"2024-04-26T12:20:29.422741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:47.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673527+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:20:28.673527+0000","last_peered":"2024-04-26T12:20:28.673527+0000","last_clean":"2024-04-26T12:20:28.673527+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673527+0000","last_undegraded":"2024-04-26T12:20:28.673527+0000","last_fullsized":"2024-04-26T12:20:28.673527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672986+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:28.672986+0000","last_peered":"2024-04-26T12:20:28.672986+0000","last_clean":"2024-04-26T12:20:28.672986+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:28.672986+0000","last_undegraded":"2024-04-26T12:20:28.672986+0000","last_fullsized":"2024-04-26T12:20:28.672986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:30.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673218+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:28.673218+0000","last_peered":"2024-04-26T12:20:28.673218+0000","last_clean":"2024-04-26T12:20:28.673218+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:28.673218+0000","last_undegraded":"2024-04-26T12:20:28.673218+0000","last_fullsized":"2024-04-26T12:20:28.673218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:00.363391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673325+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:20:28.673325+0000","last_peered":"2024-04-26T12:20:28.673325+0000","last_clean":"2024-04-26T12:20:28.673325+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:28.673325+0000","last_undegraded":"2024-04-26T12:20:28.673325+0000","last_fullsized":"2024-04-26T12:20:28.673325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673402+0000","last_change":"2024-04-26T12:20:25.664519+0000","last_active":"2024-04-26T12:20:28.673402+0000","last_peered":"2024-04-26T12:20:28.673402+0000","last_clean":"2024-04-26T12:20:28.673402+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:20:28.673402+0000","last_undegraded":"2024-04-26T12:20:28.673402+0000","last_fullsized":"2024-04-26T12:20:28.673402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.722939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673432+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:28.673432+0000","last_peered":"2024-04-26T12:20:28.673432+0000","last_clean":"2024-04-26T12:20:28.673432+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:28.673432+0000","last_undegraded":"2024-04-26T12:20:28.673432+0000","last_fullsized":"2024-04-26T12:20:28.673432+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422524+0000","last_change":"2024-04-26T12:20:25.659186+0000","last_active":"2024-04-26T12:20:29.422524+0000","last_peered":"2024-04-26T12:20:29.422524+0000","last_clean":"2024-04-26T12:20:29.422524+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:29.422524+0000","last_undegraded":"2024-04-26T12:20:29.422524+0000","last_fullsized":"2024-04-26T12:20:29.422524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:07.818179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673359+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:20:28.673359+0000","last_peered":"2024-04-26T12:20:28.673359+0000","last_clean":"2024-04-26T12:20:28.673359+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:20:28.673359+0000","last_undegraded":"2024-04-26T12:20:28.673359+0000","last_fullsized":"2024-04-26T12:20:28.673359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423388+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:29.423388+0000","last_peered":"2024-04-26T12:20:29.423388+0000","last_clean":"2024-04-26T12:20:29.423388+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:29.423388+0000","last_undegraded":"2024-04-26T12:20:29.423388+0000","last_fullsized":"2024-04-26T12:20:29.423388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422694+0000","last_change":"2024-04-26T12:20:25.659917+0000","last_active":"2024-04-26T12:20:29.422694+0000","last_peered":"2024-04-26T12:20:29.422694+0000","last_clean":"2024-04-26T12:20:29.422694+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:20:29.422694+0000","last_undegraded":"2024-04-26T12:20:29.422694+0000","last_fullsized":"2024-04-26T12:20:29.422694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:34.505551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673690+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:28.673690+0000","last_peered":"2024-04-26T12:20:28.673690+0000","last_clean":"2024-04-26T12:20:28.673690+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:28.673690+0000","last_undegraded":"2024-04-26T12:20:28.673690+0000","last_fullsized":"2024-04-26T12:20:28.673690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673666+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:28.673666+0000","last_peered":"2024-04-26T12:20:28.673666+0000","last_clean":"2024-04-26T12:20:28.673666+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:28.673666+0000","last_undegraded":"2024-04-26T12:20:28.673666+0000","last_fullsized":"2024-04-26T12:20:28.673666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672759+0000","last_change":"2024-04-26T12:20:25.658800+0000","last_active":"2024-04-26T12:20:28.672759+0000","last_peered":"2024-04-26T12:20:28.672759+0000","last_clean":"2024-04-26T12:20:28.672759+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:28.672759+0000","last_undegraded":"2024-04-26T12:20:28.672759+0000","last_fullsized":"2024-04-26T12:20:28.672759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:22.287193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673658+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:28.673658+0000","last_peered":"2024-04-26T12:20:28.673658+0000","last_clean":"2024-04-26T12:20:28.673658+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:28.673658+0000","last_undegraded":"2024-04-26T12:20:28.673658+0000","last_fullsized":"2024-04-26T12:20:28.673658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:10.121046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673823+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:28.673823+0000","last_peered":"2024-04-26T12:20:28.673823+0000","last_clean":"2024-04-26T12:20:28.673823+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:28.673823+0000","last_undegraded":"2024-04-26T12:20:28.673823+0000","last_fullsized":"2024-04-26T12:20:28.673823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:23.294093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422374+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:29.422374+0000","last_peered":"2024-04-26T12:20:29.422374+0000","last_clean":"2024-04-26T12:20:29.422374+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:29.422374+0000","last_undegraded":"2024-04-26T12:20:29.422374+0000","last_fullsized":"2024-04-26T12:20:29.422374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:22.842329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673624+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:28.673624+0000","last_peered":"2024-04-26T12:20:28.673624+0000","last_clean":"2024-04-26T12:20:28.673624+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:28.673624+0000","last_undegraded":"2024-04-26T12:20:28.673624+0000","last_fullsized":"2024-04-26T12:20:28.673624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:22.219973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:56.257240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672799+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:20:28.672799+0000","last_peered":"2024-04-26T12:20:28.672799+0000","last_clean":"2024-04-26T12:20:28.672799+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:20:28.672799+0000","last_undegraded":"2024-04-26T12:20:28.672799+0000","last_fullsized":"2024-04-26T12:20:28.672799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423272+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:29.423272+0000","last_peered":"2024-04-26T12:20:29.423272+0000","last_clean":"2024-04-26T12:20:29.423272+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:29.423272+0000","last_undegraded":"2024-04-26T12:20:29.423272+0000","last_fullsized":"2024-04-26T12:20:29.423272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.194671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673846+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:28.673846+0000","last_peered":"2024-04-26T12:20:28.673846+0000","last_clean":"2024-04-26T12:20:28.673846+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:28.673846+0000","last_undegraded":"2024-04-26T12:20:28.673846+0000","last_fullsized":"2024-04-26T12:20:28.673846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:41.999607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672646+0000","last_change":"2024-04-26T12:20:25.658549+0000","last_active":"2024-04-26T12:20:28.672646+0000","last_peered":"2024-04-26T12:20:28.672646+0000","last_clean":"2024-04-26T12:20:28.672646+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:28.672646+0000","last_undegraded":"2024-04-26T12:20:28.672646+0000","last_fullsized":"2024-04-26T12:20:28.672646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:26.372988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.658453+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:25.063788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672741+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:20:28.672741+0000","last_peered":"2024-04-26T12:20:28.672741+0000","last_clean":"2024-04-26T12:20:28.672741+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:28.672741+0000","last_undegraded":"2024-04-26T12:20:28.672741+0000","last_fullsized":"2024-04-26T12:20:28.672741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423415+0000","last_change":"2024-04-26T12:20:25.664482+0000","last_active":"2024-04-26T12:20:29.423415+0000","last_peered":"2024-04-26T12:20:29.423415+0000","last_clean":"2024-04-26T12:20:29.423415+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:29.423415+0000","last_undegraded":"2024-04-26T12:20:29.423415+0000","last_fullsized":"2024-04-26T12:20:29.423415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:15.256206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672847+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:28.672847+0000","last_peered":"2024-04-26T12:20:28.672847+0000","last_clean":"2024-04-26T12:20:28.672847+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:28.672847+0000","last_undegraded":"2024-04-26T12:20:28.672847+0000","last_fullsized":"2024-04-26T12:20:28.672847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673444+0000","last_change":"2024-04-26T12:20:25.659459+0000","last_active":"2024-04-26T12:20:28.673444+0000","last_peered":"2024-04-26T12:20:28.673444+0000","last_clean":"2024-04-26T12:20:28.673444+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:28.673444+0000","last_undegraded":"2024-04-26T12:20:28.673444+0000","last_fullsized":"2024-04-26T12:20:28.673444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:08.246812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672776+0000","last_change":"2024-04-26T12:20:25.659064+0000","last_active":"2024-04-26T12:20:28.672776+0000","last_peered":"2024-04-26T12:20:28.672776+0000","last_clean":"2024-04-26T12:20:28.672776+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:20:28.672776+0000","last_undegraded":"2024-04-26T12:20:28.672776+0000","last_fullsized":"2024-04-26T12:20:28.672776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:46.130193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423024+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:29.423024+0000","last_peered":"2024-04-26T12:20:29.423024+0000","last_clean":"2024-04-26T12:20:29.423024+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:29.423024+0000","last_undegraded":"2024-04-26T12:20:29.423024+0000","last_fullsized":"2024-04-26T12:20:29.423024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:37.387665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422819+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:29.422819+0000","last_peered":"2024-04-26T12:20:29.422819+0000","last_clean":"2024-04-26T12:20:29.422819+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:29.422819+0000","last_undegraded":"2024-04-26T12:20:29.422819+0000","last_fullsized":"2024-04-26T12:20:29.422819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422926+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:29.422926+0000","last_peered":"2024-04-26T12:20:29.422926+0000","last_clean":"2024-04-26T12:20:29.422926+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:29.422926+0000","last_undegraded":"2024-04-26T12:20:29.422926+0000","last_fullsized":"2024-04-26T12:20:29.422926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422854+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:29.422854+0000","last_peered":"2024-04-26T12:20:29.422854+0000","last_clean":"2024-04-26T12:20:29.422854+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:29.422854+0000","last_undegraded":"2024-04-26T12:20:29.422854+0000","last_fullsized":"2024-04-26T12:20:29.422854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:48.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673793+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:28.673793+0000","last_peered":"2024-04-26T12:20:28.673793+0000","last_clean":"2024-04-26T12:20:28.673793+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:28.673793+0000","last_undegraded":"2024-04-26T12:20:28.673793+0000","last_fullsized":"2024-04-26T12:20:28.673793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:42.215211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673302+0000","last_change":"2024-04-26T12:20:25.661093+0000","last_active":"2024-04-26T12:20:28.673302+0000","last_peered":"2024-04-26T12:20:28.673302+0000","last_clean":"2024-04-26T12:20:28.673302+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:20:28.673302+0000","last_undegraded":"2024-04-26T12:20:28.673302+0000","last_fullsized":"2024-04-26T12:20:28.673302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:42.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673207+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:28.673207+0000","last_peered":"2024-04-26T12:20:28.673207+0000","last_clean":"2024-04-26T12:20:28.673207+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:28.673207+0000","last_undegraded":"2024-04-26T12:20:28.673207+0000","last_fullsized":"2024-04-26T12:20:28.673207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:09.557685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423130+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:29.423130+0000","last_peered":"2024-04-26T12:20:29.423130+0000","last_clean":"2024-04-26T12:20:29.423130+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:29.423130+0000","last_undegraded":"2024-04-26T12:20:29.423130+0000","last_fullsized":"2024-04-26T12:20:29.423130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:12.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422739+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:29.422739+0000","last_peered":"2024-04-26T12:20:29.422739+0000","last_clean":"2024-04-26T12:20:29.422739+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:29.422739+0000","last_undegraded":"2024-04-26T12:20:29.422739+0000","last_fullsized":"2024-04-26T12:20:29.422739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673561+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:20:28.673561+0000","last_peered":"2024-04-26T12:20:28.673561+0000","last_clean":"2024-04-26T12:20:28.673561+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:28.673561+0000","last_undegraded":"2024-04-26T12:20:28.673561+0000","last_fullsized":"2024-04-26T12:20:28.673561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673220+0000","last_change":"2024-04-26T12:20:25.665062+0000","last_active":"2024-04-26T12:20:28.673220+0000","last_peered":"2024-04-26T12:20:28.673220+0000","last_clean":"2024-04-26T12:20:28.673220+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:28.673220+0000","last_undegraded":"2024-04-26T12:20:28.673220+0000","last_fullsized":"2024-04-26T12:20:28.673220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:01.241012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673566+0000","last_change":"2024-04-26T12:20:25.658932+0000","last_active":"2024-04-26T12:20:28.673566+0000","last_peered":"2024-04-26T12:20:28.673566+0000","last_clean":"2024-04-26T12:20:28.673566+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:28.673566+0000","last_undegraded":"2024-04-26T12:20:28.673566+0000","last_fullsized":"2024-04-26T12:20:28.673566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:37.375332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738443,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321316,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050524,"statfs":{"total":96636764160,"available":96307736576,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:19:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.42499999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.60999999999999999,"5min":0.871,"15min":0.871},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.41899999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.58899999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579907,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29996,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341844,"statfs":{"total":96636764160,"available":96606048256,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483156,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888684,"statfs":{"total":96636764160,"available":96142012416,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.371,"5min":0.161,"15min":0.161},"max":{"1min":0.57099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.39300000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.68500000000000005,"5min":0.879,"15min":0.879},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:20:32.766 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:20:33.080 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:33.080 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:20:29.676527+0000","last_up_change":"2024-04-26T12:20:24.639333+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":66,"last_clean_end":70,"up_from":74,"up_thru":74,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":1460},{"type":"v1","addr":"172.21.15.113:6801","nonce":1460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":1460},{"type":"v1","addr":"172.21.15.113:6803","nonce":1460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":1460},{"type":"v1","addr":"172.21.15.113:6807","nonce":1460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":1460},{"type":"v1","addr":"172.21.15.113:6805","nonce":1460}]},"public_addr":"172.21.15.113:6801/1460","cluster_addr":"172.21.15.113:6803/1460","heartbeat_back_addr":"172.21.15.113:6807/1460","heartbeat_front_addr":"172.21.15.113:6805/1460","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":70},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:20:34.093 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:20:34.094 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:20:34.226 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-26T12:20:34.226 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:20:34.226 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-26T12:20:34.237 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:20:34.513 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:20:34.526 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:20:34.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:20:34.646 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-26T12:20:34.646 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T12:20:34.646 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-26T12:20:34.656 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:20:34.935 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:20:34.947 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:20:34.948 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:20:35.068 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-26T12:20:35.068 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:20:35.068 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-26T12:20:35.078 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:20:35.354 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:20:35.367 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:20:35.654 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:35.655 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:20:35.665 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-26T12:20:34.520209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834468,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281052,"statfs":{"total":289910292480,"available":289055797248,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.859023"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423367+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:29.423367+0000","last_peered":"2024-04-26T12:20:29.423367+0000","last_clean":"2024-04-26T12:20:29.423367+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:29.423367+0000","last_undegraded":"2024-04-26T12:20:29.423367+0000","last_fullsized":"2024-04-26T12:20:29.423367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:45.115253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423011+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:29.423011+0000","last_peered":"2024-04-26T12:20:29.423011+0000","last_clean":"2024-04-26T12:20:29.423011+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:29.423011+0000","last_undegraded":"2024-04-26T12:20:29.423011+0000","last_fullsized":"2024-04-26T12:20:29.423011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.862981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673852+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:28.673852+0000","last_peered":"2024-04-26T12:20:28.673852+0000","last_clean":"2024-04-26T12:20:28.673852+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:28.673852+0000","last_undegraded":"2024-04-26T12:20:28.673852+0000","last_fullsized":"2024-04-26T12:20:28.673852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:51.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673545+0000","last_change":"2024-04-26T12:20:25.662260+0000","last_active":"2024-04-26T12:20:28.673545+0000","last_peered":"2024-04-26T12:20:28.673545+0000","last_clean":"2024-04-26T12:20:28.673545+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:28.673545+0000","last_undegraded":"2024-04-26T12:20:28.673545+0000","last_fullsized":"2024-04-26T12:20:28.673545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:54.868104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422713+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:20:29.422713+0000","last_peered":"2024-04-26T12:20:29.422713+0000","last_clean":"2024-04-26T12:20:29.422713+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:20:29.422713+0000","last_undegraded":"2024-04-26T12:20:29.422713+0000","last_fullsized":"2024-04-26T12:20:29.422713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673502+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:28.673502+0000","last_peered":"2024-04-26T12:20:28.673502+0000","last_clean":"2024-04-26T12:20:28.673502+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:28.673502+0000","last_undegraded":"2024-04-26T12:20:28.673502+0000","last_fullsized":"2024-04-26T12:20:28.673502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:30.261523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:55.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672981+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:28.672981+0000","last_peered":"2024-04-26T12:20:28.672981+0000","last_clean":"2024-04-26T12:20:28.672981+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:28.672981+0000","last_undegraded":"2024-04-26T12:20:28.672981+0000","last_fullsized":"2024-04-26T12:20:28.672981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:24.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673427+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:28.673427+0000","last_peered":"2024-04-26T12:20:28.673427+0000","last_clean":"2024-04-26T12:20:28.673427+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:28.673427+0000","last_undegraded":"2024-04-26T12:20:28.673427+0000","last_fullsized":"2024-04-26T12:20:28.673427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423142+0000","last_change":"2024-04-26T12:14:42.868453+0000","last_active":"2024-04-26T12:20:29.423142+0000","last_peered":"2024-04-26T12:20:29.423142+0000","last_clean":"2024-04-26T12:20:29.423142+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:29.423142+0000","last_undegraded":"2024-04-26T12:20:29.423142+0000","last_fullsized":"2024-04-26T12:20:29.423142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:58.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:47.821001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422776+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:29.422776+0000","last_peered":"2024-04-26T12:20:29.422776+0000","last_clean":"2024-04-26T12:20:29.422776+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:29.422776+0000","last_undegraded":"2024-04-26T12:20:29.422776+0000","last_fullsized":"2024-04-26T12:20:29.422776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:17.945553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422552+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:29.422552+0000","last_peered":"2024-04-26T12:20:29.422552+0000","last_clean":"2024-04-26T12:20:29.422552+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:29.422552+0000","last_undegraded":"2024-04-26T12:20:29.422552+0000","last_fullsized":"2024-04-26T12:20:29.422552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673434+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:28.673434+0000","last_peered":"2024-04-26T12:20:28.673434+0000","last_clean":"2024-04-26T12:20:28.673434+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:28.673434+0000","last_undegraded":"2024-04-26T12:20:28.673434+0000","last_fullsized":"2024-04-26T12:20:28.673434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:52.220501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673130+0000","last_change":"2024-04-26T12:20:25.658158+0000","last_active":"2024-04-26T12:20:28.673130+0000","last_peered":"2024-04-26T12:20:28.673130+0000","last_clean":"2024-04-26T12:20:28.673130+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:20:28.673130+0000","last_undegraded":"2024-04-26T12:20:28.673130+0000","last_fullsized":"2024-04-26T12:20:28.673130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:55.017516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673289+0000","last_change":"2024-04-26T12:20:25.664916+0000","last_active":"2024-04-26T12:20:28.673289+0000","last_peered":"2024-04-26T12:20:28.673289+0000","last_clean":"2024-04-26T12:20:28.673289+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:28.673289+0000","last_undegraded":"2024-04-26T12:20:28.673289+0000","last_fullsized":"2024-04-26T12:20:28.673289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:10.630467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673669+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:28.673669+0000","last_peered":"2024-04-26T12:20:28.673669+0000","last_clean":"2024-04-26T12:20:28.673669+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673669+0000","last_undegraded":"2024-04-26T12:20:28.673669+0000","last_fullsized":"2024-04-26T12:20:28.673669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423252+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:20:29.423252+0000","last_peered":"2024-04-26T12:20:29.423252+0000","last_clean":"2024-04-26T12:20:29.423252+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:29.423252+0000","last_undegraded":"2024-04-26T12:20:29.423252+0000","last_fullsized":"2024-04-26T12:20:29.423252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673295+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:28.673295+0000","last_peered":"2024-04-26T12:20:28.673295+0000","last_clean":"2024-04-26T12:20:28.673295+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:28.673295+0000","last_undegraded":"2024-04-26T12:20:28.673295+0000","last_fullsized":"2024-04-26T12:20:28.673295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:22.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673685+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:28.673685+0000","last_peered":"2024-04-26T12:20:28.673685+0000","last_clean":"2024-04-26T12:20:28.673685+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:28.673685+0000","last_undegraded":"2024-04-26T12:20:28.673685+0000","last_fullsized":"2024-04-26T12:20:28.673685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:20.225357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673896+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:28.673896+0000","last_peered":"2024-04-26T12:20:28.673896+0000","last_clean":"2024-04-26T12:20:28.673896+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:28.673896+0000","last_undegraded":"2024-04-26T12:20:28.673896+0000","last_fullsized":"2024-04-26T12:20:28.673896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:31.708071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422472+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:29.422472+0000","last_peered":"2024-04-26T12:20:29.422472+0000","last_clean":"2024-04-26T12:20:29.422472+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:29.422472+0000","last_undegraded":"2024-04-26T12:20:29.422472+0000","last_fullsized":"2024-04-26T12:20:29.422472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:58.603217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672548+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:28.672548+0000","last_peered":"2024-04-26T12:20:28.672548+0000","last_clean":"2024-04-26T12:20:28.672548+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:28.672548+0000","last_undegraded":"2024-04-26T12:20:28.672548+0000","last_fullsized":"2024-04-26T12:20:28.672548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:34.377929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422389+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:29.422389+0000","last_peered":"2024-04-26T12:20:29.422389+0000","last_clean":"2024-04-26T12:20:29.422389+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:29.422389+0000","last_undegraded":"2024-04-26T12:20:29.422389+0000","last_fullsized":"2024-04-26T12:20:29.422389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423356+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:29.423356+0000","last_peered":"2024-04-26T12:20:29.423356+0000","last_clean":"2024-04-26T12:20:29.423356+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:29.423356+0000","last_undegraded":"2024-04-26T12:20:29.423356+0000","last_fullsized":"2024-04-26T12:20:29.423356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:07.619412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673433+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:28.673433+0000","last_peered":"2024-04-26T12:20:28.673433+0000","last_clean":"2024-04-26T12:20:28.673433+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:28.673433+0000","last_undegraded":"2024-04-26T12:20:28.673433+0000","last_fullsized":"2024-04-26T12:20:28.673433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:18.666244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673765+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:28.673765+0000","last_peered":"2024-04-26T12:20:28.673765+0000","last_clean":"2024-04-26T12:20:28.673765+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:28.673765+0000","last_undegraded":"2024-04-26T12:20:28.673765+0000","last_fullsized":"2024-04-26T12:20:28.673765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:39.629549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423064+0000","last_change":"2024-04-26T12:20:25.665113+0000","last_active":"2024-04-26T12:20:29.423064+0000","last_peered":"2024-04-26T12:20:29.423064+0000","last_clean":"2024-04-26T12:20:29.423064+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:29.423064+0000","last_undegraded":"2024-04-26T12:20:29.423064+0000","last_fullsized":"2024-04-26T12:20:29.423064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:47.401100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672985+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:28.672985+0000","last_peered":"2024-04-26T12:20:28.672985+0000","last_clean":"2024-04-26T12:20:28.672985+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:28.672985+0000","last_undegraded":"2024-04-26T12:20:28.672985+0000","last_fullsized":"2024-04-26T12:20:28.672985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422843+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:29.422843+0000","last_peered":"2024-04-26T12:20:29.422843+0000","last_clean":"2024-04-26T12:20:29.422843+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:29.422843+0000","last_undegraded":"2024-04-26T12:20:29.422843+0000","last_fullsized":"2024-04-26T12:20:29.422843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.807141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672610+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:28.672610+0000","last_peered":"2024-04-26T12:20:28.672610+0000","last_clean":"2024-04-26T12:20:28.672610+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:28.672610+0000","last_undegraded":"2024-04-26T12:20:28.672610+0000","last_fullsized":"2024-04-26T12:20:28.672610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672844+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:28.672844+0000","last_peered":"2024-04-26T12:20:28.672844+0000","last_clean":"2024-04-26T12:20:28.672844+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:28.672844+0000","last_undegraded":"2024-04-26T12:20:28.672844+0000","last_fullsized":"2024-04-26T12:20:28.672844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:27.038124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422911+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:20:29.422911+0000","last_peered":"2024-04-26T12:20:29.422911+0000","last_clean":"2024-04-26T12:20:29.422911+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:20:29.422911+0000","last_undegraded":"2024-04-26T12:20:29.422911+0000","last_fullsized":"2024-04-26T12:20:29.422911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:35.123559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673469+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:28.673469+0000","last_peered":"2024-04-26T12:20:28.673469+0000","last_clean":"2024-04-26T12:20:28.673469+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:28.673469+0000","last_undegraded":"2024-04-26T12:20:28.673469+0000","last_fullsized":"2024-04-26T12:20:28.673469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:02.210041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423117+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:20:29.423117+0000","last_peered":"2024-04-26T12:20:29.423117+0000","last_clean":"2024-04-26T12:20:29.423117+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:29.423117+0000","last_undegraded":"2024-04-26T12:20:29.423117+0000","last_fullsized":"2024-04-26T12:20:29.423117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672907+0000","last_change":"2024-04-26T12:20:25.659060+0000","last_active":"2024-04-26T12:20:28.672907+0000","last_peered":"2024-04-26T12:20:28.672907+0000","last_clean":"2024-04-26T12:20:28.672907+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:28.672907+0000","last_undegraded":"2024-04-26T12:20:28.672907+0000","last_fullsized":"2024-04-26T12:20:28.672907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:23.462778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673599+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:28.673599+0000","last_peered":"2024-04-26T12:20:28.673599+0000","last_clean":"2024-04-26T12:20:28.673599+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:28.673599+0000","last_undegraded":"2024-04-26T12:20:28.673599+0000","last_fullsized":"2024-04-26T12:20:28.673599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:42.068061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422634+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:29.422634+0000","last_peered":"2024-04-26T12:20:29.422634+0000","last_clean":"2024-04-26T12:20:29.422634+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:29.422634+0000","last_undegraded":"2024-04-26T12:20:29.422634+0000","last_fullsized":"2024-04-26T12:20:29.422634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:33.454616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673440+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:28.673440+0000","last_peered":"2024-04-26T12:20:28.673440+0000","last_clean":"2024-04-26T12:20:28.673440+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:28.673440+0000","last_undegraded":"2024-04-26T12:20:28.673440+0000","last_fullsized":"2024-04-26T12:20:28.673440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:34.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672867+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:28.672867+0000","last_peered":"2024-04-26T12:20:28.672867+0000","last_clean":"2024-04-26T12:20:28.672867+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:28.672867+0000","last_undegraded":"2024-04-26T12:20:28.672867+0000","last_fullsized":"2024-04-26T12:20:28.672867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:27.283599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673989+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:28.673989+0000","last_peered":"2024-04-26T12:20:28.673989+0000","last_clean":"2024-04-26T12:20:28.673989+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:28.673989+0000","last_undegraded":"2024-04-26T12:20:28.673989+0000","last_fullsized":"2024-04-26T12:20:28.673989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.209742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422375+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:29.422375+0000","last_peered":"2024-04-26T12:20:29.422375+0000","last_clean":"2024-04-26T12:20:29.422375+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:29.422375+0000","last_undegraded":"2024-04-26T12:20:29.422375+0000","last_fullsized":"2024-04-26T12:20:29.422375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:57.793936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423352+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:29.423352+0000","last_peered":"2024-04-26T12:20:29.423352+0000","last_clean":"2024-04-26T12:20:29.423352+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:29.423352+0000","last_undegraded":"2024-04-26T12:20:29.423352+0000","last_fullsized":"2024-04-26T12:20:29.423352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:51.515487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422363+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:29.422363+0000","last_peered":"2024-04-26T12:20:29.422363+0000","last_clean":"2024-04-26T12:20:29.422363+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:29.422363+0000","last_undegraded":"2024-04-26T12:20:29.422363+0000","last_fullsized":"2024-04-26T12:20:29.422363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:53.295457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:16.407869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673570+0000","last_change":"2024-04-26T12:20:25.663801+0000","last_active":"2024-04-26T12:20:28.673570+0000","last_peered":"2024-04-26T12:20:28.673570+0000","last_clean":"2024-04-26T12:20:28.673570+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:28.673570+0000","last_undegraded":"2024-04-26T12:20:28.673570+0000","last_fullsized":"2024-04-26T12:20:28.673570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:34.758119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673579+0000","last_change":"2024-04-26T12:20:25.663958+0000","last_active":"2024-04-26T12:20:28.673579+0000","last_peered":"2024-04-26T12:20:28.673579+0000","last_clean":"2024-04-26T12:20:28.673579+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:28.673579+0000","last_undegraded":"2024-04-26T12:20:28.673579+0000","last_fullsized":"2024-04-26T12:20:28.673579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:55.763498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673040+0000","last_change":"2024-04-26T12:20:25.658968+0000","last_active":"2024-04-26T12:20:28.673040+0000","last_peered":"2024-04-26T12:20:28.673040+0000","last_clean":"2024-04-26T12:20:28.673040+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:28.673040+0000","last_undegraded":"2024-04-26T12:20:28.673040+0000","last_fullsized":"2024-04-26T12:20:28.673040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:59.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673145+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:28.673145+0000","last_peered":"2024-04-26T12:20:28.673145+0000","last_clean":"2024-04-26T12:20:28.673145+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:28.673145+0000","last_undegraded":"2024-04-26T12:20:28.673145+0000","last_fullsized":"2024-04-26T12:20:28.673145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:48.149555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673934+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:28.673934+0000","last_peered":"2024-04-26T12:20:28.673934+0000","last_clean":"2024-04-26T12:20:28.673934+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:28.673934+0000","last_undegraded":"2024-04-26T12:20:28.673934+0000","last_fullsized":"2024-04-26T12:20:28.673934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:07.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673055+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:28.673055+0000","last_peered":"2024-04-26T12:20:28.673055+0000","last_clean":"2024-04-26T12:20:28.673055+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:28.673055+0000","last_undegraded":"2024-04-26T12:20:28.673055+0000","last_fullsized":"2024-04-26T12:20:28.673055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:43.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.665885+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:54.789896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422569+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:29.422569+0000","last_peered":"2024-04-26T12:20:29.422569+0000","last_clean":"2024-04-26T12:20:29.422569+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422569+0000","last_undegraded":"2024-04-26T12:20:29.422569+0000","last_fullsized":"2024-04-26T12:20:29.422569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:28.598257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.674018+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:28.674018+0000","last_peered":"2024-04-26T12:20:28.674018+0000","last_clean":"2024-04-26T12:20:28.674018+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:28.674018+0000","last_undegraded":"2024-04-26T12:20:28.674018+0000","last_fullsized":"2024-04-26T12:20:28.674018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.969416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422582+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:29.422582+0000","last_peered":"2024-04-26T12:20:29.422582+0000","last_clean":"2024-04-26T12:20:29.422582+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:29.422582+0000","last_undegraded":"2024-04-26T12:20:29.422582+0000","last_fullsized":"2024-04-26T12:20:29.422582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673506+0000","last_change":"2024-04-26T12:14:42.867761+0000","last_active":"2024-04-26T12:20:28.673506+0000","last_peered":"2024-04-26T12:20:28.673506+0000","last_clean":"2024-04-26T12:20:28.673506+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:28.673506+0000","last_undegraded":"2024-04-26T12:20:28.673506+0000","last_fullsized":"2024-04-26T12:20:28.673506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:36.920144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672738+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:28.672738+0000","last_peered":"2024-04-26T12:20:28.672738+0000","last_clean":"2024-04-26T12:20:28.672738+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:28.672738+0000","last_undegraded":"2024-04-26T12:20:28.672738+0000","last_fullsized":"2024-04-26T12:20:28.672738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:21.176687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673105+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:28.673105+0000","last_peered":"2024-04-26T12:20:28.673105+0000","last_clean":"2024-04-26T12:20:28.673105+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:28.673105+0000","last_undegraded":"2024-04-26T12:20:28.673105+0000","last_fullsized":"2024-04-26T12:20:28.673105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.367763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673044+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:28.673044+0000","last_peered":"2024-04-26T12:20:28.673044+0000","last_clean":"2024-04-26T12:20:28.673044+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:28.673044+0000","last_undegraded":"2024-04-26T12:20:28.673044+0000","last_fullsized":"2024-04-26T12:20:28.673044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:49.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673730+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:28.673730+0000","last_peered":"2024-04-26T12:20:28.673730+0000","last_clean":"2024-04-26T12:20:28.673730+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:28.673730+0000","last_undegraded":"2024-04-26T12:20:28.673730+0000","last_fullsized":"2024-04-26T12:20:28.673730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:40.929552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673133+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:28.673133+0000","last_peered":"2024-04-26T12:20:28.673133+0000","last_clean":"2024-04-26T12:20:28.673133+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:28.673133+0000","last_undegraded":"2024-04-26T12:20:28.673133+0000","last_fullsized":"2024-04-26T12:20:28.673133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:22.695257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672781+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:28.672781+0000","last_peered":"2024-04-26T12:20:28.672781+0000","last_clean":"2024-04-26T12:20:28.672781+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:28.672781+0000","last_undegraded":"2024-04-26T12:20:28.672781+0000","last_fullsized":"2024-04-26T12:20:28.672781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:56.789330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423141+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:29.423141+0000","last_peered":"2024-04-26T12:20:29.423141+0000","last_clean":"2024-04-26T12:20:29.423141+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:29.423141+0000","last_undegraded":"2024-04-26T12:20:29.423141+0000","last_fullsized":"2024-04-26T12:20:29.423141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:16.368545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672912+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:28.672912+0000","last_peered":"2024-04-26T12:20:28.672912+0000","last_clean":"2024-04-26T12:20:28.672912+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:28.672912+0000","last_undegraded":"2024-04-26T12:20:28.672912+0000","last_fullsized":"2024-04-26T12:20:28.672912+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:19.095632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422741+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:29.422741+0000","last_peered":"2024-04-26T12:20:29.422741+0000","last_clean":"2024-04-26T12:20:29.422741+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:29.422741+0000","last_undegraded":"2024-04-26T12:20:29.422741+0000","last_fullsized":"2024-04-26T12:20:29.422741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:47.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673527+0000","last_change":"2024-04-26T12:14:42.872226+0000","last_active":"2024-04-26T12:20:28.673527+0000","last_peered":"2024-04-26T12:20:28.673527+0000","last_clean":"2024-04-26T12:20:28.673527+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:28.673527+0000","last_undegraded":"2024-04-26T12:20:28.673527+0000","last_fullsized":"2024-04-26T12:20:28.673527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.498915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672986+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:28.672986+0000","last_peered":"2024-04-26T12:20:28.672986+0000","last_clean":"2024-04-26T12:20:28.672986+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:28.672986+0000","last_undegraded":"2024-04-26T12:20:28.672986+0000","last_fullsized":"2024-04-26T12:20:28.672986+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:30.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673218+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:28.673218+0000","last_peered":"2024-04-26T12:20:28.673218+0000","last_clean":"2024-04-26T12:20:28.673218+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:28.673218+0000","last_undegraded":"2024-04-26T12:20:28.673218+0000","last_fullsized":"2024-04-26T12:20:28.673218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:00.363391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673325+0000","last_change":"2024-04-26T12:14:42.867423+0000","last_active":"2024-04-26T12:20:28.673325+0000","last_peered":"2024-04-26T12:20:28.673325+0000","last_clean":"2024-04-26T12:20:28.673325+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:28.673325+0000","last_undegraded":"2024-04-26T12:20:28.673325+0000","last_fullsized":"2024-04-26T12:20:28.673325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673402+0000","last_change":"2024-04-26T12:20:25.664519+0000","last_active":"2024-04-26T12:20:28.673402+0000","last_peered":"2024-04-26T12:20:28.673402+0000","last_clean":"2024-04-26T12:20:28.673402+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:20:28.673402+0000","last_undegraded":"2024-04-26T12:20:28.673402+0000","last_fullsized":"2024-04-26T12:20:28.673402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:03.722939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673432+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:28.673432+0000","last_peered":"2024-04-26T12:20:28.673432+0000","last_clean":"2024-04-26T12:20:28.673432+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:28.673432+0000","last_undegraded":"2024-04-26T12:20:28.673432+0000","last_fullsized":"2024-04-26T12:20:28.673432+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:08.096497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422524+0000","last_change":"2024-04-26T12:20:25.659186+0000","last_active":"2024-04-26T12:20:29.422524+0000","last_peered":"2024-04-26T12:20:29.422524+0000","last_clean":"2024-04-26T12:20:29.422524+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:29.422524+0000","last_undegraded":"2024-04-26T12:20:29.422524+0000","last_fullsized":"2024-04-26T12:20:29.422524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:07.818179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673359+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:20:28.673359+0000","last_peered":"2024-04-26T12:20:28.673359+0000","last_clean":"2024-04-26T12:20:28.673359+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:20:28.673359+0000","last_undegraded":"2024-04-26T12:20:28.673359+0000","last_fullsized":"2024-04-26T12:20:28.673359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:51.782566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423388+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:29.423388+0000","last_peered":"2024-04-26T12:20:29.423388+0000","last_clean":"2024-04-26T12:20:29.423388+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:29.423388+0000","last_undegraded":"2024-04-26T12:20:29.423388+0000","last_fullsized":"2024-04-26T12:20:29.423388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:52.494023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422694+0000","last_change":"2024-04-26T12:20:25.659917+0000","last_active":"2024-04-26T12:20:29.422694+0000","last_peered":"2024-04-26T12:20:29.422694+0000","last_clean":"2024-04-26T12:20:29.422694+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:20:29.422694+0000","last_undegraded":"2024-04-26T12:20:29.422694+0000","last_fullsized":"2024-04-26T12:20:29.422694+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:34.505551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673690+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:28.673690+0000","last_peered":"2024-04-26T12:20:28.673690+0000","last_clean":"2024-04-26T12:20:28.673690+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:28.673690+0000","last_undegraded":"2024-04-26T12:20:28.673690+0000","last_fullsized":"2024-04-26T12:20:28.673690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:46.654689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673666+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:28.673666+0000","last_peered":"2024-04-26T12:20:28.673666+0000","last_clean":"2024-04-26T12:20:28.673666+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:28.673666+0000","last_undegraded":"2024-04-26T12:20:28.673666+0000","last_fullsized":"2024-04-26T12:20:28.673666+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:08.544476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672759+0000","last_change":"2024-04-26T12:20:25.658800+0000","last_active":"2024-04-26T12:20:28.672759+0000","last_peered":"2024-04-26T12:20:28.672759+0000","last_clean":"2024-04-26T12:20:28.672759+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:28.672759+0000","last_undegraded":"2024-04-26T12:20:28.672759+0000","last_fullsized":"2024-04-26T12:20:28.672759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:22.287193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673658+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:28.673658+0000","last_peered":"2024-04-26T12:20:28.673658+0000","last_clean":"2024-04-26T12:20:28.673658+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:28.673658+0000","last_undegraded":"2024-04-26T12:20:28.673658+0000","last_fullsized":"2024-04-26T12:20:28.673658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:10.121046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673823+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:28.673823+0000","last_peered":"2024-04-26T12:20:28.673823+0000","last_clean":"2024-04-26T12:20:28.673823+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:28.673823+0000","last_undegraded":"2024-04-26T12:20:28.673823+0000","last_fullsized":"2024-04-26T12:20:28.673823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:23.294093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422374+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:29.422374+0000","last_peered":"2024-04-26T12:20:29.422374+0000","last_clean":"2024-04-26T12:20:29.422374+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:29.422374+0000","last_undegraded":"2024-04-26T12:20:29.422374+0000","last_fullsized":"2024-04-26T12:20:29.422374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:22.842329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673624+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:28.673624+0000","last_peered":"2024-04-26T12:20:28.673624+0000","last_clean":"2024-04-26T12:20:28.673624+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:28.673624+0000","last_undegraded":"2024-04-26T12:20:28.673624+0000","last_fullsized":"2024-04-26T12:20:28.673624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:22.219973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673242+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:28.673242+0000","last_peered":"2024-04-26T12:20:28.673242+0000","last_clean":"2024-04-26T12:20:28.673242+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:28.673242+0000","last_undegraded":"2024-04-26T12:20:28.673242+0000","last_fullsized":"2024-04-26T12:20:28.673242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:56.257240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672799+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:20:28.672799+0000","last_peered":"2024-04-26T12:20:28.672799+0000","last_clean":"2024-04-26T12:20:28.672799+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:20:28.672799+0000","last_undegraded":"2024-04-26T12:20:28.672799+0000","last_fullsized":"2024-04-26T12:20:28.672799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.059645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423272+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:29.423272+0000","last_peered":"2024-04-26T12:20:29.423272+0000","last_clean":"2024-04-26T12:20:29.423272+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:29.423272+0000","last_undegraded":"2024-04-26T12:20:29.423272+0000","last_fullsized":"2024-04-26T12:20:29.423272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.194671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673846+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:28.673846+0000","last_peered":"2024-04-26T12:20:28.673846+0000","last_clean":"2024-04-26T12:20:28.673846+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:28.673846+0000","last_undegraded":"2024-04-26T12:20:28.673846+0000","last_fullsized":"2024-04-26T12:20:28.673846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:41.999607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672646+0000","last_change":"2024-04-26T12:20:25.658549+0000","last_active":"2024-04-26T12:20:28.672646+0000","last_peered":"2024-04-26T12:20:28.672646+0000","last_clean":"2024-04-26T12:20:28.672646+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:28.672646+0000","last_undegraded":"2024-04-26T12:20:28.672646+0000","last_fullsized":"2024-04-26T12:20:28.672646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:26.372988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673627+0000","last_change":"2024-04-26T12:20:25.658453+0000","last_active":"2024-04-26T12:20:28.673627+0000","last_peered":"2024-04-26T12:20:28.673627+0000","last_clean":"2024-04-26T12:20:28.673627+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:28.673627+0000","last_undegraded":"2024-04-26T12:20:28.673627+0000","last_fullsized":"2024-04-26T12:20:28.673627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:25.063788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672741+0000","last_change":"2024-04-26T12:14:42.865284+0000","last_active":"2024-04-26T12:20:28.672741+0000","last_peered":"2024-04-26T12:20:28.672741+0000","last_clean":"2024-04-26T12:20:28.672741+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:28.672741+0000","last_undegraded":"2024-04-26T12:20:28.672741+0000","last_fullsized":"2024-04-26T12:20:28.672741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:02.105071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423415+0000","last_change":"2024-04-26T12:20:25.664482+0000","last_active":"2024-04-26T12:20:29.423415+0000","last_peered":"2024-04-26T12:20:29.423415+0000","last_clean":"2024-04-26T12:20:29.423415+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:29.423415+0000","last_undegraded":"2024-04-26T12:20:29.423415+0000","last_fullsized":"2024-04-26T12:20:29.423415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:15.256206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672847+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:28.672847+0000","last_peered":"2024-04-26T12:20:28.672847+0000","last_clean":"2024-04-26T12:20:28.672847+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:28.672847+0000","last_undegraded":"2024-04-26T12:20:28.672847+0000","last_fullsized":"2024-04-26T12:20:28.672847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673444+0000","last_change":"2024-04-26T12:20:25.659459+0000","last_active":"2024-04-26T12:20:28.673444+0000","last_peered":"2024-04-26T12:20:28.673444+0000","last_clean":"2024-04-26T12:20:28.673444+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:28.673444+0000","last_undegraded":"2024-04-26T12:20:28.673444+0000","last_fullsized":"2024-04-26T12:20:28.673444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:08.246812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.672776+0000","last_change":"2024-04-26T12:20:25.659064+0000","last_active":"2024-04-26T12:20:28.672776+0000","last_peered":"2024-04-26T12:20:28.672776+0000","last_clean":"2024-04-26T12:20:28.672776+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:20:28.672776+0000","last_undegraded":"2024-04-26T12:20:28.672776+0000","last_fullsized":"2024-04-26T12:20:28.672776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:46.130193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423024+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:29.423024+0000","last_peered":"2024-04-26T12:20:29.423024+0000","last_clean":"2024-04-26T12:20:29.423024+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:29.423024+0000","last_undegraded":"2024-04-26T12:20:29.423024+0000","last_fullsized":"2024-04-26T12:20:29.423024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:37.387665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422819+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:29.422819+0000","last_peered":"2024-04-26T12:20:29.422819+0000","last_clean":"2024-04-26T12:20:29.422819+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:29.422819+0000","last_undegraded":"2024-04-26T12:20:29.422819+0000","last_fullsized":"2024-04-26T12:20:29.422819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:44.220533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422926+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:29.422926+0000","last_peered":"2024-04-26T12:20:29.422926+0000","last_clean":"2024-04-26T12:20:29.422926+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:29.422926+0000","last_undegraded":"2024-04-26T12:20:29.422926+0000","last_fullsized":"2024-04-26T12:20:29.422926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:57.908368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422854+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:29.422854+0000","last_peered":"2024-04-26T12:20:29.422854+0000","last_clean":"2024-04-26T12:20:29.422854+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:29.422854+0000","last_undegraded":"2024-04-26T12:20:29.422854+0000","last_fullsized":"2024-04-26T12:20:29.422854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:48.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673793+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:28.673793+0000","last_peered":"2024-04-26T12:20:28.673793+0000","last_clean":"2024-04-26T12:20:28.673793+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:28.673793+0000","last_undegraded":"2024-04-26T12:20:28.673793+0000","last_fullsized":"2024-04-26T12:20:28.673793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:42.215211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673302+0000","last_change":"2024-04-26T12:20:25.661093+0000","last_active":"2024-04-26T12:20:28.673302+0000","last_peered":"2024-04-26T12:20:28.673302+0000","last_clean":"2024-04-26T12:20:28.673302+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:20:28.673302+0000","last_undegraded":"2024-04-26T12:20:28.673302+0000","last_fullsized":"2024-04-26T12:20:28.673302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:42.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673207+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:28.673207+0000","last_peered":"2024-04-26T12:20:28.673207+0000","last_clean":"2024-04-26T12:20:28.673207+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:28.673207+0000","last_undegraded":"2024-04-26T12:20:28.673207+0000","last_fullsized":"2024-04-26T12:20:28.673207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:09.557685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.423130+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:29.423130+0000","last_peered":"2024-04-26T12:20:29.423130+0000","last_clean":"2024-04-26T12:20:29.423130+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:29.423130+0000","last_undegraded":"2024-04-26T12:20:29.423130+0000","last_fullsized":"2024-04-26T12:20:29.423130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:12.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.422739+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:29.422739+0000","last_peered":"2024-04-26T12:20:29.422739+0000","last_clean":"2024-04-26T12:20:29.422739+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:29.422739+0000","last_undegraded":"2024-04-26T12:20:29.422739+0000","last_fullsized":"2024-04-26T12:20:29.422739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:29.974715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673561+0000","last_change":"2024-04-26T12:14:42.527181+0000","last_active":"2024-04-26T12:20:28.673561+0000","last_peered":"2024-04-26T12:20:28.673561+0000","last_clean":"2024-04-26T12:20:28.673561+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:28.673561+0000","last_undegraded":"2024-04-26T12:20:28.673561+0000","last_fullsized":"2024-04-26T12:20:28.673561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:00.112001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673220+0000","last_change":"2024-04-26T12:20:25.665062+0000","last_active":"2024-04-26T12:20:28.673220+0000","last_peered":"2024-04-26T12:20:28.673220+0000","last_clean":"2024-04-26T12:20:28.673220+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:28.673220+0000","last_undegraded":"2024-04-26T12:20:28.673220+0000","last_fullsized":"2024-04-26T12:20:28.673220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:01.241012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:20:28.673566+0000","last_change":"2024-04-26T12:20:25.658932+0000","last_active":"2024-04-26T12:20:28.673566+0000","last_peered":"2024-04-26T12:20:28.673566+0000","last_clean":"2024-04-26T12:20:28.673566+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:28.673566+0000","last_undegraded":"2024-04-26T12:20:28.673566+0000","last_fullsized":"2024-04-26T12:20:28.673566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:37.375332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738443,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321316,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050524,"statfs":{"total":96636764160,"available":96307736576,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:19:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.42499999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.60999999999999999,"5min":0.871,"15min":0.871},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.41899999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.58899999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579908,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29996,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341844,"statfs":{"total":96636764160,"available":96606048256,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483156,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888684,"statfs":{"total":96636764160,"available":96142012416,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:19:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.371,"5min":0.161,"15min":0.161},"max":{"1min":0.57099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.39300000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.68500000000000005,"5min":0.879,"15min":0.879},"last":0.55200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:20:35.675 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.675 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.675 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.675 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.675 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.676 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.677 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.678 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.679 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.680 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.681 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.682 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.683 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.684 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.685 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.686 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.687 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.687 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.687 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.687 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:35.687 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:20:55.688 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:20:55.985 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:20:55.987 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:20:55.996 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-04-26T12:20:54.525442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834444,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281076,"statfs":{"total":289910292480,"available":289055821824,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003587"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325140+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:30.325140+0000","last_peered":"2024-04-26T12:20:30.325140+0000","last_clean":"2024-04-26T12:20:30.325140+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:30.325140+0000","last_undegraded":"2024-04-26T12:20:30.325140+0000","last_fullsized":"2024-04-26T12:20:30.325140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324811+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:30.324811+0000","last_peered":"2024-04-26T12:20:30.324811+0000","last_clean":"2024-04-26T12:20:30.324811+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:30.324811+0000","last_undegraded":"2024-04-26T12:20:30.324811+0000","last_fullsized":"2024-04-26T12:20:30.324811+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683930+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:29.683930+0000","last_peered":"2024-04-26T12:20:29.683930+0000","last_clean":"2024-04-26T12:20:29.683930+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:29.683930+0000","last_undegraded":"2024-04-26T12:20:29.683930+0000","last_fullsized":"2024-04-26T12:20:29.683930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683322+0000","last_change":"2024-04-26T12:20:25.662260+0000","last_active":"2024-04-26T12:20:29.683322+0000","last_peered":"2024-04-26T12:20:29.683322+0000","last_clean":"2024-04-26T12:20:29.683322+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:29.683322+0000","last_undegraded":"2024-04-26T12:20:29.683322+0000","last_fullsized":"2024-04-26T12:20:29.683322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324530+0000","last_change":"2024-04-26T12:14:42.869632+0000","last_active":"2024-04-26T12:20:30.324530+0000","last_peered":"2024-04-26T12:20:30.324530+0000","last_clean":"2024-04-26T12:20:30.324530+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:20:30.324530+0000","last_undegraded":"2024-04-26T12:20:30.324530+0000","last_fullsized":"2024-04-26T12:20:30.324530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683632+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:29.683632+0000","last_peered":"2024-04-26T12:20:29.683632+0000","last_clean":"2024-04-26T12:20:29.683632+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:29.683632+0000","last_undegraded":"2024-04-26T12:20:29.683632+0000","last_fullsized":"2024-04-26T12:20:29.683632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683497+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:29.683497+0000","last_peered":"2024-04-26T12:20:29.683497+0000","last_clean":"2024-04-26T12:20:29.683497+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:29.683497+0000","last_undegraded":"2024-04-26T12:20:29.683497+0000","last_fullsized":"2024-04-26T12:20:29.683497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683060+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:29.683060+0000","last_peered":"2024-04-26T12:20:29.683060+0000","last_clean":"2024-04-26T12:20:29.683060+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:29.683060+0000","last_undegraded":"2024-04-26T12:20:29.683060+0000","last_fullsized":"2024-04-26T12:20:29.683060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683161+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:29.683161+0000","last_peered":"2024-04-26T12:20:29.683161+0000","last_clean":"2024-04-26T12:20:29.683161+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:29.683161+0000","last_undegraded":"2024-04-26T12:20:29.683161+0000","last_fullsized":"2024-04-26T12:20:29.683161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.790532+0000","last_change":"2024-04-26T12:20:41.790658+0000","last_active":"2024-04-26T12:20:41.790532+0000","last_peered":"2024-04-26T12:20:41.790532+0000","last_clean":"2024-04-26T12:20:41.790532+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:41.790532+0000","last_undegraded":"2024-04-26T12:20:41.790532+0000","last_fullsized":"2024-04-26T12:20:41.790532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.790495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:52.175594+0000","scrub_duration":0.0019401209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683869+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:29.683869+0000","last_peered":"2024-04-26T12:20:29.683869+0000","last_clean":"2024-04-26T12:20:29.683869+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:29.683869+0000","last_undegraded":"2024-04-26T12:20:29.683869+0000","last_fullsized":"2024-04-26T12:20:29.683869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324686+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:30.324686+0000","last_peered":"2024-04-26T12:20:30.324686+0000","last_clean":"2024-04-26T12:20:30.324686+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:30.324686+0000","last_undegraded":"2024-04-26T12:20:30.324686+0000","last_fullsized":"2024-04-26T12:20:30.324686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324442+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:30.324442+0000","last_peered":"2024-04-26T12:20:30.324442+0000","last_clean":"2024-04-26T12:20:30.324442+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:30.324442+0000","last_undegraded":"2024-04-26T12:20:30.324442+0000","last_fullsized":"2024-04-26T12:20:30.324442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683548+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:29.683548+0000","last_peered":"2024-04-26T12:20:29.683548+0000","last_clean":"2024-04-26T12:20:29.683548+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:29.683548+0000","last_undegraded":"2024-04-26T12:20:29.683548+0000","last_fullsized":"2024-04-26T12:20:29.683548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683118+0000","last_change":"2024-04-26T12:20:25.658158+0000","last_active":"2024-04-26T12:20:29.683118+0000","last_peered":"2024-04-26T12:20:29.683118+0000","last_clean":"2024-04-26T12:20:29.683118+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:20:29.683118+0000","last_undegraded":"2024-04-26T12:20:29.683118+0000","last_fullsized":"2024-04-26T12:20:29.683118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.219944+0000","last_change":"2024-04-26T12:20:41.220047+0000","last_active":"2024-04-26T12:20:41.219944+0000","last_peered":"2024-04-26T12:20:41.219944+0000","last_clean":"2024-04-26T12:20:41.219944+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:41.219944+0000","last_undegraded":"2024-04-26T12:20:41.219944+0000","last_fullsized":"2024-04-26T12:20:41.219944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.219912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:44.836560+0000","scrub_duration":0.001961516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683472+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:29.683472+0000","last_peered":"2024-04-26T12:20:29.683472+0000","last_clean":"2024-04-26T12:20:29.683472+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:29.683472+0000","last_undegraded":"2024-04-26T12:20:29.683472+0000","last_fullsized":"2024-04-26T12:20:29.683472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325054+0000","last_change":"2024-04-26T12:14:42.870674+0000","last_active":"2024-04-26T12:20:30.325054+0000","last_peered":"2024-04-26T12:20:30.325054+0000","last_clean":"2024-04-26T12:20:30.325054+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:30.325054+0000","last_undegraded":"2024-04-26T12:20:30.325054+0000","last_fullsized":"2024-04-26T12:20:30.325054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682934+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:29.682934+0000","last_peered":"2024-04-26T12:20:29.682934+0000","last_clean":"2024-04-26T12:20:29.682934+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:29.682934+0000","last_undegraded":"2024-04-26T12:20:29.682934+0000","last_fullsized":"2024-04-26T12:20:29.682934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683555+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:29.683555+0000","last_peered":"2024-04-26T12:20:29.683555+0000","last_clean":"2024-04-26T12:20:29.683555+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:29.683555+0000","last_undegraded":"2024-04-26T12:20:29.683555+0000","last_fullsized":"2024-04-26T12:20:29.683555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683903+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:29.683903+0000","last_peered":"2024-04-26T12:20:29.683903+0000","last_clean":"2024-04-26T12:20:29.683903+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:29.683903+0000","last_undegraded":"2024-04-26T12:20:29.683903+0000","last_fullsized":"2024-04-26T12:20:29.683903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324395+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:30.324395+0000","last_peered":"2024-04-26T12:20:30.324395+0000","last_clean":"2024-04-26T12:20:30.324395+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:30.324395+0000","last_undegraded":"2024-04-26T12:20:30.324395+0000","last_fullsized":"2024-04-26T12:20:30.324395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682282+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:29.682282+0000","last_peered":"2024-04-26T12:20:29.682282+0000","last_clean":"2024-04-26T12:20:29.682282+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:29.682282+0000","last_undegraded":"2024-04-26T12:20:29.682282+0000","last_fullsized":"2024-04-26T12:20:29.682282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324077+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:30.324077+0000","last_peered":"2024-04-26T12:20:30.324077+0000","last_clean":"2024-04-26T12:20:30.324077+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:30.324077+0000","last_undegraded":"2024-04-26T12:20:30.324077+0000","last_fullsized":"2024-04-26T12:20:30.324077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325209+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:30.325209+0000","last_peered":"2024-04-26T12:20:30.325209+0000","last_clean":"2024-04-26T12:20:30.325209+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:30.325209+0000","last_undegraded":"2024-04-26T12:20:30.325209+0000","last_fullsized":"2024-04-26T12:20:30.325209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683069+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:29.683069+0000","last_peered":"2024-04-26T12:20:29.683069+0000","last_clean":"2024-04-26T12:20:29.683069+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:29.683069+0000","last_undegraded":"2024-04-26T12:20:29.683069+0000","last_fullsized":"2024-04-26T12:20:29.683069+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683839+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:29.683839+0000","last_peered":"2024-04-26T12:20:29.683839+0000","last_clean":"2024-04-26T12:20:29.683839+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:29.683839+0000","last_undegraded":"2024-04-26T12:20:29.683839+0000","last_fullsized":"2024-04-26T12:20:29.683839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324801+0000","last_change":"2024-04-26T12:20:25.665113+0000","last_active":"2024-04-26T12:20:30.324801+0000","last_peered":"2024-04-26T12:20:30.324801+0000","last_clean":"2024-04-26T12:20:30.324801+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:30.324801+0000","last_undegraded":"2024-04-26T12:20:30.324801+0000","last_fullsized":"2024-04-26T12:20:30.324801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682726+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:29.682726+0000","last_peered":"2024-04-26T12:20:29.682726+0000","last_clean":"2024-04-26T12:20:29.682726+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:29.682726+0000","last_undegraded":"2024-04-26T12:20:29.682726+0000","last_fullsized":"2024-04-26T12:20:29.682726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324484+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:30.324484+0000","last_peered":"2024-04-26T12:20:30.324484+0000","last_clean":"2024-04-26T12:20:30.324484+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:30.324484+0000","last_undegraded":"2024-04-26T12:20:30.324484+0000","last_fullsized":"2024-04-26T12:20:30.324484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682322+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:29.682322+0000","last_peered":"2024-04-26T12:20:29.682322+0000","last_clean":"2024-04-26T12:20:29.682322+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:29.682322+0000","last_undegraded":"2024-04-26T12:20:29.682322+0000","last_fullsized":"2024-04-26T12:20:29.682322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682826+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:29.682826+0000","last_peered":"2024-04-26T12:20:29.682826+0000","last_clean":"2024-04-26T12:20:29.682826+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:29.682826+0000","last_undegraded":"2024-04-26T12:20:29.682826+0000","last_fullsized":"2024-04-26T12:20:29.682826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324763+0000","last_change":"2024-04-26T12:14:42.868792+0000","last_active":"2024-04-26T12:20:30.324763+0000","last_peered":"2024-04-26T12:20:30.324763+0000","last_clean":"2024-04-26T12:20:30.324763+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:20:30.324763+0000","last_undegraded":"2024-04-26T12:20:30.324763+0000","last_fullsized":"2024-04-26T12:20:30.324763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683200+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:29.683200+0000","last_peered":"2024-04-26T12:20:29.683200+0000","last_clean":"2024-04-26T12:20:29.683200+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:29.683200+0000","last_undegraded":"2024-04-26T12:20:29.683200+0000","last_fullsized":"2024-04-26T12:20:29.683200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324856+0000","last_change":"2024-04-26T12:14:42.864377+0000","last_active":"2024-04-26T12:20:30.324856+0000","last_peered":"2024-04-26T12:20:30.324856+0000","last_clean":"2024-04-26T12:20:30.324856+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:30.324856+0000","last_undegraded":"2024-04-26T12:20:30.324856+0000","last_fullsized":"2024-04-26T12:20:30.324856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:47.161936+0000","last_change":"2024-04-26T12:20:47.162047+0000","last_active":"2024-04-26T12:20:47.161936+0000","last_peered":"2024-04-26T12:20:47.161936+0000","last_clean":"2024-04-26T12:20:47.161936+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:47.161936+0000","last_undegraded":"2024-04-26T12:20:47.161936+0000","last_fullsized":"2024-04-26T12:20:47.161936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_clean_scrub_stamp":"2024-04-26T12:20:47.161913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:03.581394+0000","scrub_duration":0.00169505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683285+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:29.683285+0000","last_peered":"2024-04-26T12:20:29.683285+0000","last_clean":"2024-04-26T12:20:29.683285+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:29.683285+0000","last_undegraded":"2024-04-26T12:20:29.683285+0000","last_fullsized":"2024-04-26T12:20:29.683285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324314+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:30.324314+0000","last_peered":"2024-04-26T12:20:30.324314+0000","last_clean":"2024-04-26T12:20:30.324314+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:30.324314+0000","last_undegraded":"2024-04-26T12:20:30.324314+0000","last_fullsized":"2024-04-26T12:20:30.324314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683228+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:29.683228+0000","last_peered":"2024-04-26T12:20:29.683228+0000","last_clean":"2024-04-26T12:20:29.683228+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:29.683228+0000","last_undegraded":"2024-04-26T12:20:29.683228+0000","last_fullsized":"2024-04-26T12:20:29.683228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682823+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:29.682823+0000","last_peered":"2024-04-26T12:20:29.682823+0000","last_clean":"2024-04-26T12:20:29.682823+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:29.682823+0000","last_undegraded":"2024-04-26T12:20:29.682823+0000","last_fullsized":"2024-04-26T12:20:29.682823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683688+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:29.683688+0000","last_peered":"2024-04-26T12:20:29.683688+0000","last_clean":"2024-04-26T12:20:29.683688+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:29.683688+0000","last_undegraded":"2024-04-26T12:20:29.683688+0000","last_fullsized":"2024-04-26T12:20:29.683688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324087+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:30.324087+0000","last_peered":"2024-04-26T12:20:30.324087+0000","last_clean":"2024-04-26T12:20:30.324087+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:30.324087+0000","last_undegraded":"2024-04-26T12:20:30.324087+0000","last_fullsized":"2024-04-26T12:20:30.324087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325057+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:30.325057+0000","last_peered":"2024-04-26T12:20:30.325057+0000","last_clean":"2024-04-26T12:20:30.325057+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:30.325057+0000","last_undegraded":"2024-04-26T12:20:30.325057+0000","last_fullsized":"2024-04-26T12:20:30.325057+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324162+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:30.324162+0000","last_peered":"2024-04-26T12:20:30.324162+0000","last_clean":"2024-04-26T12:20:30.324162+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:30.324162+0000","last_undegraded":"2024-04-26T12:20:30.324162+0000","last_fullsized":"2024-04-26T12:20:30.324162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683701+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:29.683701+0000","last_peered":"2024-04-26T12:20:29.683701+0000","last_clean":"2024-04-26T12:20:29.683701+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:29.683701+0000","last_undegraded":"2024-04-26T12:20:29.683701+0000","last_fullsized":"2024-04-26T12:20:29.683701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.239958+0000","last_change":"2024-04-26T12:20:51.240064+0000","last_active":"2024-04-26T12:20:51.239958+0000","last_peered":"2024-04-26T12:20:51.239958+0000","last_clean":"2024-04-26T12:20:51.239958+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:51.239958+0000","last_undegraded":"2024-04-26T12:20:51.239958+0000","last_fullsized":"2024-04-26T12:20:51.239958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.239936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:38.455956+0000","scrub_duration":0.0018569750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.195154+0000","last_change":"2024-04-26T12:20:45.195262+0000","last_active":"2024-04-26T12:20:45.195154+0000","last_peered":"2024-04-26T12:20:45.195154+0000","last_clean":"2024-04-26T12:20:45.195154+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:45.195154+0000","last_undegraded":"2024-04-26T12:20:45.195154+0000","last_fullsized":"2024-04-26T12:20:45.195154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.195132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:03.642870+0000","scrub_duration":0.001821214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:44.227904+0000","last_change":"2024-04-26T12:20:44.228054+0000","last_active":"2024-04-26T12:20:44.227904+0000","last_peered":"2024-04-26T12:20:44.227904+0000","last_clean":"2024-04-26T12:20:44.227904+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:44.227904+0000","last_undegraded":"2024-04-26T12:20:44.227904+0000","last_fullsized":"2024-04-26T12:20:44.227904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_clean_scrub_stamp":"2024-04-26T12:20:44.227884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:28.326058+0000","scrub_duration":0.037590602000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682890+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:29.682890+0000","last_peered":"2024-04-26T12:20:29.682890+0000","last_clean":"2024-04-26T12:20:29.682890+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:29.682890+0000","last_undegraded":"2024-04-26T12:20:29.682890+0000","last_fullsized":"2024-04-26T12:20:29.682890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683745+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:29.683745+0000","last_peered":"2024-04-26T12:20:29.683745+0000","last_clean":"2024-04-26T12:20:29.683745+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:29.683745+0000","last_undegraded":"2024-04-26T12:20:29.683745+0000","last_fullsized":"2024-04-26T12:20:29.683745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683120+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:29.683120+0000","last_peered":"2024-04-26T12:20:29.683120+0000","last_clean":"2024-04-26T12:20:29.683120+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:29.683120+0000","last_undegraded":"2024-04-26T12:20:29.683120+0000","last_fullsized":"2024-04-26T12:20:29.683120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.185645+0000","last_change":"2024-04-26T12:20:37.185781+0000","last_active":"2024-04-26T12:20:37.185645+0000","last_peered":"2024-04-26T12:20:37.185645+0000","last_clean":"2024-04-26T12:20:37.185645+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:37.185645+0000","last_undegraded":"2024-04-26T12:20:37.185645+0000","last_fullsized":"2024-04-26T12:20:37.185645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.185622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:13.134344+0000","scrub_duration":0.0022406729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324298+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:30.324298+0000","last_peered":"2024-04-26T12:20:30.324298+0000","last_clean":"2024-04-26T12:20:30.324298+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:30.324298+0000","last_undegraded":"2024-04-26T12:20:30.324298+0000","last_fullsized":"2024-04-26T12:20:30.324298+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683887+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:29.683887+0000","last_peered":"2024-04-26T12:20:29.683887+0000","last_clean":"2024-04-26T12:20:29.683887+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:29.683887+0000","last_undegraded":"2024-04-26T12:20:29.683887+0000","last_fullsized":"2024-04-26T12:20:29.683887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324210+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:30.324210+0000","last_peered":"2024-04-26T12:20:30.324210+0000","last_clean":"2024-04-26T12:20:30.324210+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:30.324210+0000","last_undegraded":"2024-04-26T12:20:30.324210+0000","last_fullsized":"2024-04-26T12:20:30.324210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.243830+0000","last_change":"2024-04-26T12:20:46.243964+0000","last_active":"2024-04-26T12:20:46.243830+0000","last_peered":"2024-04-26T12:20:46.243830+0000","last_clean":"2024-04-26T12:20:46.243830+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:46.243830+0000","last_undegraded":"2024-04-26T12:20:46.243830+0000","last_fullsized":"2024-04-26T12:20:46.243830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_clean_scrub_stamp":"2024-04-26T12:20:46.243795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.992132+0000","scrub_duration":0.071910356999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682732+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:29.682732+0000","last_peered":"2024-04-26T12:20:29.682732+0000","last_clean":"2024-04-26T12:20:29.682732+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:29.682732+0000","last_undegraded":"2024-04-26T12:20:29.682732+0000","last_fullsized":"2024-04-26T12:20:29.682732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683211+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:29.683211+0000","last_peered":"2024-04-26T12:20:29.683211+0000","last_clean":"2024-04-26T12:20:29.683211+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:29.683211+0000","last_undegraded":"2024-04-26T12:20:29.683211+0000","last_fullsized":"2024-04-26T12:20:29.683211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683095+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:29.683095+0000","last_peered":"2024-04-26T12:20:29.683095+0000","last_clean":"2024-04-26T12:20:29.683095+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:29.683095+0000","last_undegraded":"2024-04-26T12:20:29.683095+0000","last_fullsized":"2024-04-26T12:20:29.683095+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683812+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:29.683812+0000","last_peered":"2024-04-26T12:20:29.683812+0000","last_clean":"2024-04-26T12:20:29.683812+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:29.683812+0000","last_undegraded":"2024-04-26T12:20:29.683812+0000","last_fullsized":"2024-04-26T12:20:29.683812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683010+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:29.683010+0000","last_peered":"2024-04-26T12:20:29.683010+0000","last_clean":"2024-04-26T12:20:29.683010+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:29.683010+0000","last_undegraded":"2024-04-26T12:20:29.683010+0000","last_fullsized":"2024-04-26T12:20:29.683010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682522+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:29.682522+0000","last_peered":"2024-04-26T12:20:29.682522+0000","last_clean":"2024-04-26T12:20:29.682522+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:29.682522+0000","last_undegraded":"2024-04-26T12:20:29.682522+0000","last_fullsized":"2024-04-26T12:20:29.682522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324927+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:30.324927+0000","last_peered":"2024-04-26T12:20:30.324927+0000","last_clean":"2024-04-26T12:20:30.324927+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:30.324927+0000","last_undegraded":"2024-04-26T12:20:30.324927+0000","last_fullsized":"2024-04-26T12:20:30.324927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682710+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:29.682710+0000","last_peered":"2024-04-26T12:20:29.682710+0000","last_clean":"2024-04-26T12:20:29.682710+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:29.682710+0000","last_undegraded":"2024-04-26T12:20:29.682710+0000","last_fullsized":"2024-04-26T12:20:29.682710+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354702+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:35.354702+0000","last_peered":"2024-04-26T12:20:35.354702+0000","last_clean":"2024-04-26T12:20:35.354702+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:35.354702+0000","last_undegraded":"2024-04-26T12:20:35.354702+0000","last_fullsized":"2024-04-26T12:20:35.354702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:40.233447+0000","last_change":"2024-04-26T12:20:40.233585+0000","last_active":"2024-04-26T12:20:40.233447+0000","last_peered":"2024-04-26T12:20:40.233447+0000","last_clean":"2024-04-26T12:20:40.233447+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:40.233447+0000","last_undegraded":"2024-04-26T12:20:40.233447+0000","last_fullsized":"2024-04-26T12:20:40.233447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_clean_scrub_stamp":"2024-04-26T12:20:40.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.531307+0000","scrub_duration":0.037253345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682902+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:29.682902+0000","last_peered":"2024-04-26T12:20:29.682902+0000","last_clean":"2024-04-26T12:20:29.682902+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:29.682902+0000","last_undegraded":"2024-04-26T12:20:29.682902+0000","last_fullsized":"2024-04-26T12:20:29.682902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683060+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:29.683060+0000","last_peered":"2024-04-26T12:20:29.683060+0000","last_clean":"2024-04-26T12:20:29.683060+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:29.683060+0000","last_undegraded":"2024-04-26T12:20:29.683060+0000","last_fullsized":"2024-04-26T12:20:29.683060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:38.217789+0000","last_change":"2024-04-26T12:20:38.217915+0000","last_active":"2024-04-26T12:20:38.217789+0000","last_peered":"2024-04-26T12:20:38.217789+0000","last_clean":"2024-04-26T12:20:38.217789+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:38.217789+0000","last_undegraded":"2024-04-26T12:20:38.217789+0000","last_fullsized":"2024-04-26T12:20:38.217789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_clean_scrub_stamp":"2024-04-26T12:20:38.217739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:53.024648+0000","scrub_duration":0.001837775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683328+0000","last_change":"2024-04-26T12:20:25.664519+0000","last_active":"2024-04-26T12:20:29.683328+0000","last_peered":"2024-04-26T12:20:29.683328+0000","last_clean":"2024-04-26T12:20:29.683328+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:20:29.683328+0000","last_undegraded":"2024-04-26T12:20:29.683328+0000","last_fullsized":"2024-04-26T12:20:29.683328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683229+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:29.683229+0000","last_peered":"2024-04-26T12:20:29.683229+0000","last_clean":"2024-04-26T12:20:29.683229+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:29.683229+0000","last_undegraded":"2024-04-26T12:20:29.683229+0000","last_fullsized":"2024-04-26T12:20:29.683229+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.788852+0000","last_change":"2024-04-26T12:20:42.788962+0000","last_active":"2024-04-26T12:20:42.788852+0000","last_peered":"2024-04-26T12:20:42.788852+0000","last_clean":"2024-04-26T12:20:42.788852+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:42.788852+0000","last_undegraded":"2024-04-26T12:20:42.788852+0000","last_fullsized":"2024-04-26T12:20:42.788852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.788831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:48.051123+0000","scrub_duration":0.0018731360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683192+0000","last_change":"2024-04-26T12:14:42.527220+0000","last_active":"2024-04-26T12:20:29.683192+0000","last_peered":"2024-04-26T12:20:29.683192+0000","last_clean":"2024-04-26T12:20:29.683192+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:20:29.683192+0000","last_undegraded":"2024-04-26T12:20:29.683192+0000","last_fullsized":"2024-04-26T12:20:29.683192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.323923+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:30.323923+0000","last_peered":"2024-04-26T12:20:30.323923+0000","last_clean":"2024-04-26T12:20:30.323923+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:30.323923+0000","last_undegraded":"2024-04-26T12:20:30.323923+0000","last_fullsized":"2024-04-26T12:20:30.323923+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324491+0000","last_change":"2024-04-26T12:20:25.659917+0000","last_active":"2024-04-26T12:20:30.324491+0000","last_peered":"2024-04-26T12:20:30.324491+0000","last_clean":"2024-04-26T12:20:30.324491+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:20:30.324491+0000","last_undegraded":"2024-04-26T12:20:30.324491+0000","last_fullsized":"2024-04-26T12:20:30.324491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683498+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:29.683498+0000","last_peered":"2024-04-26T12:20:29.683498+0000","last_clean":"2024-04-26T12:20:29.683498+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:29.683498+0000","last_undegraded":"2024-04-26T12:20:29.683498+0000","last_fullsized":"2024-04-26T12:20:29.683498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683386+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:29.683386+0000","last_peered":"2024-04-26T12:20:29.683386+0000","last_clean":"2024-04-26T12:20:29.683386+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:29.683386+0000","last_undegraded":"2024-04-26T12:20:29.683386+0000","last_fullsized":"2024-04-26T12:20:29.683386+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:39.239308+0000","last_change":"2024-04-26T12:20:39.239308+0000","last_active":"2024-04-26T12:20:39.239308+0000","last_peered":"2024-04-26T12:20:39.239308+0000","last_clean":"2024-04-26T12:20:39.239308+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:39.239308+0000","last_undegraded":"2024-04-26T12:20:39.239308+0000","last_fullsized":"2024-04-26T12:20:39.239308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_clean_scrub_stamp":"2024-04-26T12:20:39.239159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:05.765227+0000","scrub_duration":0.001927977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683376+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:29.683376+0000","last_peered":"2024-04-26T12:20:29.683376+0000","last_clean":"2024-04-26T12:20:29.683376+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:29.683376+0000","last_undegraded":"2024-04-26T12:20:29.683376+0000","last_fullsized":"2024-04-26T12:20:29.683376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683615+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:29.683615+0000","last_peered":"2024-04-26T12:20:29.683615+0000","last_clean":"2024-04-26T12:20:29.683615+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:29.683615+0000","last_undegraded":"2024-04-26T12:20:29.683615+0000","last_fullsized":"2024-04-26T12:20:29.683615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324166+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:30.324166+0000","last_peered":"2024-04-26T12:20:30.324166+0000","last_clean":"2024-04-26T12:20:30.324166+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:30.324166+0000","last_undegraded":"2024-04-26T12:20:30.324166+0000","last_fullsized":"2024-04-26T12:20:30.324166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683612+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:29.683612+0000","last_peered":"2024-04-26T12:20:29.683612+0000","last_clean":"2024-04-26T12:20:29.683612+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:29.683612+0000","last_undegraded":"2024-04-26T12:20:29.683612+0000","last_fullsized":"2024-04-26T12:20:29.683612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683168+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:29.683168+0000","last_peered":"2024-04-26T12:20:29.683168+0000","last_clean":"2024-04-26T12:20:29.683168+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:29.683168+0000","last_undegraded":"2024-04-26T12:20:29.683168+0000","last_fullsized":"2024-04-26T12:20:29.683168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682590+0000","last_change":"2024-04-26T12:14:42.866132+0000","last_active":"2024-04-26T12:20:29.682590+0000","last_peered":"2024-04-26T12:20:29.682590+0000","last_clean":"2024-04-26T12:20:29.682590+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:20:29.682590+0000","last_undegraded":"2024-04-26T12:20:29.682590+0000","last_fullsized":"2024-04-26T12:20:29.682590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":107,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325030+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:30.325030+0000","last_peered":"2024-04-26T12:20:30.325030+0000","last_clean":"2024-04-26T12:20:30.325030+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:30.325030+0000","last_undegraded":"2024-04-26T12:20:30.325030+0000","last_fullsized":"2024-04-26T12:20:30.325030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683794+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:29.683794+0000","last_peered":"2024-04-26T12:20:29.683794+0000","last_clean":"2024-04-26T12:20:29.683794+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:29.683794+0000","last_undegraded":"2024-04-26T12:20:29.683794+0000","last_fullsized":"2024-04-26T12:20:29.683794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682393+0000","last_change":"2024-04-26T12:20:25.658549+0000","last_active":"2024-04-26T12:20:29.682393+0000","last_peered":"2024-04-26T12:20:29.682393+0000","last_clean":"2024-04-26T12:20:29.682393+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:29.682393+0000","last_undegraded":"2024-04-26T12:20:29.682393+0000","last_fullsized":"2024-04-26T12:20:29.682393+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.148566+0000","last_change":"2024-04-26T12:20:45.148696+0000","last_active":"2024-04-26T12:20:45.148566+0000","last_peered":"2024-04-26T12:20:45.148566+0000","last_clean":"2024-04-26T12:20:45.148566+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:45.148566+0000","last_undegraded":"2024-04-26T12:20:45.148566+0000","last_fullsized":"2024-04-26T12:20:45.148566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.148548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.383636+0000","scrub_duration":0.0018031029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:49.111826+0000","last_change":"2024-04-26T12:20:49.111929+0000","last_active":"2024-04-26T12:20:49.111826+0000","last_peered":"2024-04-26T12:20:49.111826+0000","last_clean":"2024-04-26T12:20:49.111826+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:49.111826+0000","last_undegraded":"2024-04-26T12:20:49.111826+0000","last_fullsized":"2024-04-26T12:20:49.111826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_clean_scrub_stamp":"2024-04-26T12:20:49.111806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:18.633109+0000","scrub_duration":0.0015728319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325186+0000","last_change":"2024-04-26T12:20:25.664482+0000","last_active":"2024-04-26T12:20:30.325186+0000","last_peered":"2024-04-26T12:20:30.325186+0000","last_clean":"2024-04-26T12:20:30.325186+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:30.325186+0000","last_undegraded":"2024-04-26T12:20:30.325186+0000","last_fullsized":"2024-04-26T12:20:30.325186+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682524+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:29.682524+0000","last_peered":"2024-04-26T12:20:29.682524+0000","last_clean":"2024-04-26T12:20:29.682524+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:29.682524+0000","last_undegraded":"2024-04-26T12:20:29.682524+0000","last_fullsized":"2024-04-26T12:20:29.682524+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.267347+0000","last_change":"2024-04-26T12:20:37.267347+0000","last_active":"2024-04-26T12:20:37.267347+0000","last_peered":"2024-04-26T12:20:37.267347+0000","last_clean":"2024-04-26T12:20:37.267347+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:37.267347+0000","last_undegraded":"2024-04-26T12:20:37.267347+0000","last_fullsized":"2024-04-26T12:20:37.267347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.267215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:21.882383+0000","scrub_duration":0.0018490620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682540+0000","last_change":"2024-04-26T12:20:25.659064+0000","last_active":"2024-04-26T12:20:29.682540+0000","last_peered":"2024-04-26T12:20:29.682540+0000","last_clean":"2024-04-26T12:20:29.682540+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:20:29.682540+0000","last_undegraded":"2024-04-26T12:20:29.682540+0000","last_fullsized":"2024-04-26T12:20:29.682540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324790+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:30.324790+0000","last_peered":"2024-04-26T12:20:30.324790+0000","last_clean":"2024-04-26T12:20:30.324790+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:30.324790+0000","last_undegraded":"2024-04-26T12:20:30.324790+0000","last_fullsized":"2024-04-26T12:20:30.324790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324513+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:30.324513+0000","last_peered":"2024-04-26T12:20:30.324513+0000","last_clean":"2024-04-26T12:20:30.324513+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:30.324513+0000","last_undegraded":"2024-04-26T12:20:30.324513+0000","last_fullsized":"2024-04-26T12:20:30.324513+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324678+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:30.324678+0000","last_peered":"2024-04-26T12:20:30.324678+0000","last_clean":"2024-04-26T12:20:30.324678+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:30.324678+0000","last_undegraded":"2024-04-26T12:20:30.324678+0000","last_fullsized":"2024-04-26T12:20:30.324678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324594+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:30.324594+0000","last_peered":"2024-04-26T12:20:30.324594+0000","last_clean":"2024-04-26T12:20:30.324594+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:30.324594+0000","last_undegraded":"2024-04-26T12:20:30.324594+0000","last_fullsized":"2024-04-26T12:20:30.324594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683765+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:29.683765+0000","last_peered":"2024-04-26T12:20:29.683765+0000","last_clean":"2024-04-26T12:20:29.683765+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:29.683765+0000","last_undegraded":"2024-04-26T12:20:29.683765+0000","last_fullsized":"2024-04-26T12:20:29.683765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683367+0000","last_change":"2024-04-26T12:20:25.661093+0000","last_active":"2024-04-26T12:20:29.683367+0000","last_peered":"2024-04-26T12:20:29.683367+0000","last_clean":"2024-04-26T12:20:29.683367+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:20:29.683367+0000","last_undegraded":"2024-04-26T12:20:29.683367+0000","last_fullsized":"2024-04-26T12:20:29.683367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683212+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:29.683212+0000","last_peered":"2024-04-26T12:20:29.683212+0000","last_clean":"2024-04-26T12:20:29.683212+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:29.683212+0000","last_undegraded":"2024-04-26T12:20:29.683212+0000","last_fullsized":"2024-04-26T12:20:29.683212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324898+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:30.324898+0000","last_peered":"2024-04-26T12:20:30.324898+0000","last_clean":"2024-04-26T12:20:30.324898+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:30.324898+0000","last_undegraded":"2024-04-26T12:20:30.324898+0000","last_fullsized":"2024-04-26T12:20:30.324898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324457+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:30.324457+0000","last_peered":"2024-04-26T12:20:30.324457+0000","last_clean":"2024-04-26T12:20:30.324457+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:30.324457+0000","last_undegraded":"2024-04-26T12:20:30.324457+0000","last_fullsized":"2024-04-26T12:20:30.324457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.113455+0000","last_change":"2024-04-26T12:20:51.113577+0000","last_active":"2024-04-26T12:20:51.113455+0000","last_peered":"2024-04-26T12:20:51.113455+0000","last_clean":"2024-04-26T12:20:51.113455+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:51.113455+0000","last_undegraded":"2024-04-26T12:20:51.113455+0000","last_fullsized":"2024-04-26T12:20:51.113455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.113432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:11.752649+0000","scrub_duration":0.0017589649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683145+0000","last_change":"2024-04-26T12:20:25.665062+0000","last_active":"2024-04-26T12:20:29.683145+0000","last_peered":"2024-04-26T12:20:29.683145+0000","last_clean":"2024-04-26T12:20:29.683145+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:29.683145+0000","last_undegraded":"2024-04-26T12:20:29.683145+0000","last_fullsized":"2024-04-26T12:20:29.683145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.241788+0000","last_change":"2024-04-26T12:20:42.241925+0000","last_active":"2024-04-26T12:20:42.241788+0000","last_peered":"2024-04-26T12:20:42.241788+0000","last_clean":"2024-04-26T12:20:42.241788+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:42.241788+0000","last_undegraded":"2024-04-26T12:20:42.241788+0000","last_fullsized":"2024-04-26T12:20:42.241788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.241764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:44.362930+0000","scrub_duration":0.0044497909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321308,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050532,"statfs":{"total":96636764160,"available":96307744768,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:19:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.42499999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.60999999999999999,"5min":0.871,"15min":0.871},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.41899999999999998,"5min":0.192,"15min":0.192},"max":{"1min":0.58899999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":74,"seq":317827579912,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483144,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888696,"statfs":{"total":96636764160,"available":96142024704,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42099999999999999,"15min":0.371},"min":{"1min":0.36699999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.65300000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.375,"5min":0.185,"15min":0.185},"max":{"1min":0.58499999999999996,"5min":0.879,"15min":0.879},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:20:56.002 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.002 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.003 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.003 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.003 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.003 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.003 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.003 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.004 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.005 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.005 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.005 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.005 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.006 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.006 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.006 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.007 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.007 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.008 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.008 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.008 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.008 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.008 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.008 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.009 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.009 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.009 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.009 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.009 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.010 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.010 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.010 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.010 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.010 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.011 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.011 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.011 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.011 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.011 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.011 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.011 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.012 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.012 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.012 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.012 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.012 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.012 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.012 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.013 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.013 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.013 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.013 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.013 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.013 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.013 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.014 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.015 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.015 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.015 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.015 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.015 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.016 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.016 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.016 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.016 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.016 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:20:56.017 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:21:16.018 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:21:16.311 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:21:16.313 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:21:16.322 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-04-26T12:21:14.530798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834444,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281076,"statfs":{"total":289910292480,"available":289055821824,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003394"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.355056+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:35.355056+0000","last_peered":"2024-04-26T12:20:35.355056+0000","last_clean":"2024-04-26T12:20:35.355056+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:35.355056+0000","last_undegraded":"2024-04-26T12:20:35.355056+0000","last_fullsized":"2024-04-26T12:20:35.355056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.355031+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:35.355031+0000","last_peered":"2024-04-26T12:20:35.355031+0000","last_clean":"2024-04-26T12:20:35.355031+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:35.355031+0000","last_undegraded":"2024-04-26T12:20:35.355031+0000","last_fullsized":"2024-04-26T12:20:35.355031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683930+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:29.683930+0000","last_peered":"2024-04-26T12:20:29.683930+0000","last_clean":"2024-04-26T12:20:29.683930+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:29.683930+0000","last_undegraded":"2024-04-26T12:20:29.683930+0000","last_fullsized":"2024-04-26T12:20:29.683930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:57.265439+0000","last_change":"2024-04-26T12:20:57.265567+0000","last_active":"2024-04-26T12:20:57.265439+0000","last_peered":"2024-04-26T12:20:57.265439+0000","last_clean":"2024-04-26T12:20:57.265439+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:57.265439+0000","last_undegraded":"2024-04-26T12:20:57.265439+0000","last_fullsized":"2024-04-26T12:20:57.265439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_clean_scrub_stamp":"2024-04-26T12:20:57.265416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:34.758945+0000","scrub_duration":0.0019165709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:03.872257+0000","last_change":"2024-04-26T12:21:03.872380+0000","last_active":"2024-04-26T12:21:03.872257+0000","last_peered":"2024-04-26T12:21:03.872257+0000","last_clean":"2024-04-26T12:21:03.872257+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:21:03.872257+0000","last_undegraded":"2024-04-26T12:21:03.872257+0000","last_fullsized":"2024-04-26T12:21:03.872257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_clean_scrub_stamp":"2024-04-26T12:21:03.872236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.873602+0000","scrub_duration":0.021825418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683632+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:29.683632+0000","last_peered":"2024-04-26T12:20:29.683632+0000","last_clean":"2024-04-26T12:20:29.683632+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:29.683632+0000","last_undegraded":"2024-04-26T12:20:29.683632+0000","last_fullsized":"2024-04-26T12:20:29.683632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683497+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:29.683497+0000","last_peered":"2024-04-26T12:20:29.683497+0000","last_clean":"2024-04-26T12:20:29.683497+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:29.683497+0000","last_undegraded":"2024-04-26T12:20:29.683497+0000","last_fullsized":"2024-04-26T12:20:29.683497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683060+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:29.683060+0000","last_peered":"2024-04-26T12:20:29.683060+0000","last_clean":"2024-04-26T12:20:29.683060+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:29.683060+0000","last_undegraded":"2024-04-26T12:20:29.683060+0000","last_fullsized":"2024-04-26T12:20:29.683060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683161+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:29.683161+0000","last_peered":"2024-04-26T12:20:29.683161+0000","last_clean":"2024-04-26T12:20:29.683161+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:29.683161+0000","last_undegraded":"2024-04-26T12:20:29.683161+0000","last_fullsized":"2024-04-26T12:20:29.683161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.790532+0000","last_change":"2024-04-26T12:20:41.790658+0000","last_active":"2024-04-26T12:20:41.790532+0000","last_peered":"2024-04-26T12:20:41.790532+0000","last_clean":"2024-04-26T12:20:41.790532+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:41.790532+0000","last_undegraded":"2024-04-26T12:20:41.790532+0000","last_fullsized":"2024-04-26T12:20:41.790532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.790495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:52.175594+0000","scrub_duration":0.0019401209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683869+0000","last_change":"2024-04-26T12:20:25.665569+0000","last_active":"2024-04-26T12:20:29.683869+0000","last_peered":"2024-04-26T12:20:29.683869+0000","last_clean":"2024-04-26T12:20:29.683869+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:20:29.683869+0000","last_undegraded":"2024-04-26T12:20:29.683869+0000","last_fullsized":"2024-04-26T12:20:29.683869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324686+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:30.324686+0000","last_peered":"2024-04-26T12:20:30.324686+0000","last_clean":"2024-04-26T12:20:30.324686+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:30.324686+0000","last_undegraded":"2024-04-26T12:20:30.324686+0000","last_fullsized":"2024-04-26T12:20:30.324686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324442+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:30.324442+0000","last_peered":"2024-04-26T12:20:30.324442+0000","last_clean":"2024-04-26T12:20:30.324442+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:30.324442+0000","last_undegraded":"2024-04-26T12:20:30.324442+0000","last_fullsized":"2024-04-26T12:20:30.324442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683548+0000","last_change":"2024-04-26T12:20:25.663102+0000","last_active":"2024-04-26T12:20:29.683548+0000","last_peered":"2024-04-26T12:20:29.683548+0000","last_clean":"2024-04-26T12:20:29.683548+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:20:29.683548+0000","last_undegraded":"2024-04-26T12:20:29.683548+0000","last_fullsized":"2024-04-26T12:20:29.683548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:04.377717+0000","last_change":"2024-04-26T12:21:04.377824+0000","last_active":"2024-04-26T12:21:04.377717+0000","last_peered":"2024-04-26T12:21:04.377717+0000","last_clean":"2024-04-26T12:21:04.377717+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:21:04.377717+0000","last_undegraded":"2024-04-26T12:21:04.377717+0000","last_fullsized":"2024-04-26T12:21:04.377717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_clean_scrub_stamp":"2024-04-26T12:21:04.377697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.199940+0000","scrub_duration":0.0019611149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.219944+0000","last_change":"2024-04-26T12:20:41.220047+0000","last_active":"2024-04-26T12:20:41.219944+0000","last_peered":"2024-04-26T12:20:41.219944+0000","last_clean":"2024-04-26T12:20:41.219944+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:41.219944+0000","last_undegraded":"2024-04-26T12:20:41.219944+0000","last_fullsized":"2024-04-26T12:20:41.219944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.219912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:44.836560+0000","scrub_duration":0.001961516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683472+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:29.683472+0000","last_peered":"2024-04-26T12:20:29.683472+0000","last_clean":"2024-04-26T12:20:29.683472+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:29.683472+0000","last_undegraded":"2024-04-26T12:20:29.683472+0000","last_fullsized":"2024-04-26T12:20:29.683472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:52.790048+0000","last_change":"2024-04-26T12:20:52.790151+0000","last_active":"2024-04-26T12:20:52.790048+0000","last_peered":"2024-04-26T12:20:52.790048+0000","last_clean":"2024-04-26T12:20:52.790048+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:52.790048+0000","last_undegraded":"2024-04-26T12:20:52.790048+0000","last_fullsized":"2024-04-26T12:20:52.790048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_clean_scrub_stamp":"2024-04-26T12:20:52.790025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:37.405193+0000","scrub_duration":0.0021779400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682934+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:29.682934+0000","last_peered":"2024-04-26T12:20:29.682934+0000","last_clean":"2024-04-26T12:20:29.682934+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:29.682934+0000","last_undegraded":"2024-04-26T12:20:29.682934+0000","last_fullsized":"2024-04-26T12:20:29.682934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683555+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:29.683555+0000","last_peered":"2024-04-26T12:20:29.683555+0000","last_clean":"2024-04-26T12:20:29.683555+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:29.683555+0000","last_undegraded":"2024-04-26T12:20:29.683555+0000","last_fullsized":"2024-04-26T12:20:29.683555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683903+0000","last_change":"2024-04-26T12:20:25.666150+0000","last_active":"2024-04-26T12:20:29.683903+0000","last_peered":"2024-04-26T12:20:29.683903+0000","last_clean":"2024-04-26T12:20:29.683903+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:20:29.683903+0000","last_undegraded":"2024-04-26T12:20:29.683903+0000","last_fullsized":"2024-04-26T12:20:29.683903+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324395+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:30.324395+0000","last_peered":"2024-04-26T12:20:30.324395+0000","last_clean":"2024-04-26T12:20:30.324395+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:30.324395+0000","last_undegraded":"2024-04-26T12:20:30.324395+0000","last_fullsized":"2024-04-26T12:20:30.324395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682282+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:29.682282+0000","last_peered":"2024-04-26T12:20:29.682282+0000","last_clean":"2024-04-26T12:20:29.682282+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:29.682282+0000","last_undegraded":"2024-04-26T12:20:29.682282+0000","last_fullsized":"2024-04-26T12:20:29.682282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324077+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:30.324077+0000","last_peered":"2024-04-26T12:20:30.324077+0000","last_clean":"2024-04-26T12:20:30.324077+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:30.324077+0000","last_undegraded":"2024-04-26T12:20:30.324077+0000","last_fullsized":"2024-04-26T12:20:30.324077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325209+0000","last_change":"2024-04-26T12:20:25.659041+0000","last_active":"2024-04-26T12:20:30.325209+0000","last_peered":"2024-04-26T12:20:30.325209+0000","last_clean":"2024-04-26T12:20:30.325209+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:20:30.325209+0000","last_undegraded":"2024-04-26T12:20:30.325209+0000","last_fullsized":"2024-04-26T12:20:30.325209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683069+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:29.683069+0000","last_peered":"2024-04-26T12:20:29.683069+0000","last_clean":"2024-04-26T12:20:29.683069+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:29.683069+0000","last_undegraded":"2024-04-26T12:20:29.683069+0000","last_fullsized":"2024-04-26T12:20:29.683069+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683839+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:29.683839+0000","last_peered":"2024-04-26T12:20:29.683839+0000","last_clean":"2024-04-26T12:20:29.683839+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:29.683839+0000","last_undegraded":"2024-04-26T12:20:29.683839+0000","last_fullsized":"2024-04-26T12:20:29.683839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.808388+0000","last_change":"2024-04-26T12:20:59.808505+0000","last_active":"2024-04-26T12:20:59.808388+0000","last_peered":"2024-04-26T12:20:59.808388+0000","last_clean":"2024-04-26T12:20:59.808388+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:59.808388+0000","last_undegraded":"2024-04-26T12:20:59.808388+0000","last_fullsized":"2024-04-26T12:20:59.808388+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.808367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.929534+0000","scrub_duration":0.002171816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514007+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:34.514007+0000","last_peered":"2024-04-26T12:20:34.514007+0000","last_clean":"2024-04-26T12:20:34.514007+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:34.514007+0000","last_undegraded":"2024-04-26T12:20:34.514007+0000","last_fullsized":"2024-04-26T12:20:34.514007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354789+0000","last_change":"2024-04-26T12:20:25.658998+0000","last_active":"2024-04-26T12:20:35.354789+0000","last_peered":"2024-04-26T12:20:35.354789+0000","last_clean":"2024-04-26T12:20:35.354789+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:20:35.354789+0000","last_undegraded":"2024-04-26T12:20:35.354789+0000","last_fullsized":"2024-04-26T12:20:35.354789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514021+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:34.514021+0000","last_peered":"2024-04-26T12:20:34.514021+0000","last_clean":"2024-04-26T12:20:34.514021+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:34.514021+0000","last_undegraded":"2024-04-26T12:20:34.514021+0000","last_fullsized":"2024-04-26T12:20:34.514021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682826+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:29.682826+0000","last_peered":"2024-04-26T12:20:29.682826+0000","last_clean":"2024-04-26T12:20:29.682826+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:29.682826+0000","last_undegraded":"2024-04-26T12:20:29.682826+0000","last_fullsized":"2024-04-26T12:20:29.682826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:05.802987+0000","last_change":"2024-04-26T12:21:05.803095+0000","last_active":"2024-04-26T12:21:05.802987+0000","last_peered":"2024-04-26T12:21:05.802987+0000","last_clean":"2024-04-26T12:21:05.802987+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:21:05.802987+0000","last_undegraded":"2024-04-26T12:21:05.802987+0000","last_fullsized":"2024-04-26T12:21:05.802987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_clean_scrub_stamp":"2024-04-26T12:21:05.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:22.222434+0000","scrub_duration":0.0018232630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683200+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:29.683200+0000","last_peered":"2024-04-26T12:20:29.683200+0000","last_clean":"2024-04-26T12:20:29.683200+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:29.683200+0000","last_undegraded":"2024-04-26T12:20:29.683200+0000","last_fullsized":"2024-04-26T12:20:29.683200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.778498+0000","last_change":"2024-04-26T12:20:53.778599+0000","last_active":"2024-04-26T12:20:53.778498+0000","last_peered":"2024-04-26T12:20:53.778498+0000","last_clean":"2024-04-26T12:20:53.778498+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:53.778498+0000","last_undegraded":"2024-04-26T12:20:53.778498+0000","last_fullsized":"2024-04-26T12:20:53.778498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.778477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:08.585386+0000","scrub_duration":0.021558476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:47.161936+0000","last_change":"2024-04-26T12:20:47.162047+0000","last_active":"2024-04-26T12:20:47.161936+0000","last_peered":"2024-04-26T12:20:47.161936+0000","last_clean":"2024-04-26T12:20:47.161936+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:47.161936+0000","last_undegraded":"2024-04-26T12:20:47.161936+0000","last_fullsized":"2024-04-26T12:20:47.161936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_clean_scrub_stamp":"2024-04-26T12:20:47.161913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:03.581394+0000","scrub_duration":0.00169505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683285+0000","last_change":"2024-04-26T12:20:25.659428+0000","last_active":"2024-04-26T12:20:29.683285+0000","last_peered":"2024-04-26T12:20:29.683285+0000","last_clean":"2024-04-26T12:20:29.683285+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:20:29.683285+0000","last_undegraded":"2024-04-26T12:20:29.683285+0000","last_fullsized":"2024-04-26T12:20:29.683285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324314+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:30.324314+0000","last_peered":"2024-04-26T12:20:30.324314+0000","last_clean":"2024-04-26T12:20:30.324314+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:30.324314+0000","last_undegraded":"2024-04-26T12:20:30.324314+0000","last_fullsized":"2024-04-26T12:20:30.324314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683228+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:29.683228+0000","last_peered":"2024-04-26T12:20:29.683228+0000","last_clean":"2024-04-26T12:20:29.683228+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:29.683228+0000","last_undegraded":"2024-04-26T12:20:29.683228+0000","last_fullsized":"2024-04-26T12:20:29.683228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682823+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:29.682823+0000","last_peered":"2024-04-26T12:20:29.682823+0000","last_clean":"2024-04-26T12:20:29.682823+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:29.682823+0000","last_undegraded":"2024-04-26T12:20:29.682823+0000","last_fullsized":"2024-04-26T12:20:29.682823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683688+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:29.683688+0000","last_peered":"2024-04-26T12:20:29.683688+0000","last_clean":"2024-04-26T12:20:29.683688+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:29.683688+0000","last_undegraded":"2024-04-26T12:20:29.683688+0000","last_fullsized":"2024-04-26T12:20:29.683688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324087+0000","last_change":"2024-04-26T12:20:25.664716+0000","last_active":"2024-04-26T12:20:30.324087+0000","last_peered":"2024-04-26T12:20:30.324087+0000","last_clean":"2024-04-26T12:20:30.324087+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:20:30.324087+0000","last_undegraded":"2024-04-26T12:20:30.324087+0000","last_fullsized":"2024-04-26T12:20:30.324087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325057+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:30.325057+0000","last_peered":"2024-04-26T12:20:30.325057+0000","last_clean":"2024-04-26T12:20:30.325057+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:30.325057+0000","last_undegraded":"2024-04-26T12:20:30.325057+0000","last_fullsized":"2024-04-26T12:20:30.325057+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324162+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:30.324162+0000","last_peered":"2024-04-26T12:20:30.324162+0000","last_clean":"2024-04-26T12:20:30.324162+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:30.324162+0000","last_undegraded":"2024-04-26T12:20:30.324162+0000","last_fullsized":"2024-04-26T12:20:30.324162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683701+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:29.683701+0000","last_peered":"2024-04-26T12:20:29.683701+0000","last_clean":"2024-04-26T12:20:29.683701+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:29.683701+0000","last_undegraded":"2024-04-26T12:20:29.683701+0000","last_fullsized":"2024-04-26T12:20:29.683701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.239958+0000","last_change":"2024-04-26T12:20:51.240064+0000","last_active":"2024-04-26T12:20:51.239958+0000","last_peered":"2024-04-26T12:20:51.239958+0000","last_clean":"2024-04-26T12:20:51.239958+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:51.239958+0000","last_undegraded":"2024-04-26T12:20:51.239958+0000","last_fullsized":"2024-04-26T12:20:51.239958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.239936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:38.455956+0000","scrub_duration":0.0018569750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.195154+0000","last_change":"2024-04-26T12:20:45.195262+0000","last_active":"2024-04-26T12:20:45.195154+0000","last_peered":"2024-04-26T12:20:45.195154+0000","last_clean":"2024-04-26T12:20:45.195154+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:45.195154+0000","last_undegraded":"2024-04-26T12:20:45.195154+0000","last_fullsized":"2024-04-26T12:20:45.195154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.195132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:03.642870+0000","scrub_duration":0.001821214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:44.227904+0000","last_change":"2024-04-26T12:20:44.228054+0000","last_active":"2024-04-26T12:20:44.227904+0000","last_peered":"2024-04-26T12:20:44.227904+0000","last_clean":"2024-04-26T12:20:44.227904+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:44.227904+0000","last_undegraded":"2024-04-26T12:20:44.227904+0000","last_fullsized":"2024-04-26T12:20:44.227904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_clean_scrub_stamp":"2024-04-26T12:20:44.227884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:28.326058+0000","scrub_duration":0.037590602000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682890+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:29.682890+0000","last_peered":"2024-04-26T12:20:29.682890+0000","last_clean":"2024-04-26T12:20:29.682890+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:29.682890+0000","last_undegraded":"2024-04-26T12:20:29.682890+0000","last_fullsized":"2024-04-26T12:20:29.682890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683745+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:29.683745+0000","last_peered":"2024-04-26T12:20:29.683745+0000","last_clean":"2024-04-26T12:20:29.683745+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:29.683745+0000","last_undegraded":"2024-04-26T12:20:29.683745+0000","last_fullsized":"2024-04-26T12:20:29.683745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683120+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:29.683120+0000","last_peered":"2024-04-26T12:20:29.683120+0000","last_clean":"2024-04-26T12:20:29.683120+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:29.683120+0000","last_undegraded":"2024-04-26T12:20:29.683120+0000","last_fullsized":"2024-04-26T12:20:29.683120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.185645+0000","last_change":"2024-04-26T12:20:37.185781+0000","last_active":"2024-04-26T12:20:37.185645+0000","last_peered":"2024-04-26T12:20:37.185645+0000","last_clean":"2024-04-26T12:20:37.185645+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:37.185645+0000","last_undegraded":"2024-04-26T12:20:37.185645+0000","last_fullsized":"2024-04-26T12:20:37.185645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.185622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:13.134344+0000","scrub_duration":0.0022406729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324298+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:30.324298+0000","last_peered":"2024-04-26T12:20:30.324298+0000","last_clean":"2024-04-26T12:20:30.324298+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:30.324298+0000","last_undegraded":"2024-04-26T12:20:30.324298+0000","last_fullsized":"2024-04-26T12:20:30.324298+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683887+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:29.683887+0000","last_peered":"2024-04-26T12:20:29.683887+0000","last_clean":"2024-04-26T12:20:29.683887+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:29.683887+0000","last_undegraded":"2024-04-26T12:20:29.683887+0000","last_fullsized":"2024-04-26T12:20:29.683887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324210+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:30.324210+0000","last_peered":"2024-04-26T12:20:30.324210+0000","last_clean":"2024-04-26T12:20:30.324210+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:30.324210+0000","last_undegraded":"2024-04-26T12:20:30.324210+0000","last_fullsized":"2024-04-26T12:20:30.324210+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.243830+0000","last_change":"2024-04-26T12:20:46.243964+0000","last_active":"2024-04-26T12:20:46.243830+0000","last_peered":"2024-04-26T12:20:46.243830+0000","last_clean":"2024-04-26T12:20:46.243830+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:46.243830+0000","last_undegraded":"2024-04-26T12:20:46.243830+0000","last_fullsized":"2024-04-26T12:20:46.243830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_clean_scrub_stamp":"2024-04-26T12:20:46.243795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.992132+0000","scrub_duration":0.071910356999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682732+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:29.682732+0000","last_peered":"2024-04-26T12:20:29.682732+0000","last_clean":"2024-04-26T12:20:29.682732+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:29.682732+0000","last_undegraded":"2024-04-26T12:20:29.682732+0000","last_fullsized":"2024-04-26T12:20:29.682732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683211+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:29.683211+0000","last_peered":"2024-04-26T12:20:29.683211+0000","last_clean":"2024-04-26T12:20:29.683211+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:29.683211+0000","last_undegraded":"2024-04-26T12:20:29.683211+0000","last_fullsized":"2024-04-26T12:20:29.683211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513621+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:34.513621+0000","last_peered":"2024-04-26T12:20:34.513621+0000","last_clean":"2024-04-26T12:20:34.513621+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:34.513621+0000","last_undegraded":"2024-04-26T12:20:34.513621+0000","last_fullsized":"2024-04-26T12:20:34.513621+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683812+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:29.683812+0000","last_peered":"2024-04-26T12:20:29.683812+0000","last_clean":"2024-04-26T12:20:29.683812+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:29.683812+0000","last_undegraded":"2024-04-26T12:20:29.683812+0000","last_fullsized":"2024-04-26T12:20:29.683812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683010+0000","last_change":"2024-04-26T12:20:25.665158+0000","last_active":"2024-04-26T12:20:29.683010+0000","last_peered":"2024-04-26T12:20:29.683010+0000","last_clean":"2024-04-26T12:20:29.683010+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:20:29.683010+0000","last_undegraded":"2024-04-26T12:20:29.683010+0000","last_fullsized":"2024-04-26T12:20:29.683010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513621+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:34.513621+0000","last_peered":"2024-04-26T12:20:34.513621+0000","last_clean":"2024-04-26T12:20:34.513621+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:34.513621+0000","last_undegraded":"2024-04-26T12:20:34.513621+0000","last_fullsized":"2024-04-26T12:20:34.513621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324927+0000","last_change":"2024-04-26T12:14:42.870196+0000","last_active":"2024-04-26T12:20:30.324927+0000","last_peered":"2024-04-26T12:20:30.324927+0000","last_clean":"2024-04-26T12:20:30.324927+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:20:30.324927+0000","last_undegraded":"2024-04-26T12:20:30.324927+0000","last_fullsized":"2024-04-26T12:20:30.324927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513573+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:34.513573+0000","last_peered":"2024-04-26T12:20:34.513573+0000","last_clean":"2024-04-26T12:20:34.513573+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:34.513573+0000","last_undegraded":"2024-04-26T12:20:34.513573+0000","last_fullsized":"2024-04-26T12:20:34.513573+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354702+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:35.354702+0000","last_peered":"2024-04-26T12:20:35.354702+0000","last_clean":"2024-04-26T12:20:35.354702+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:35.354702+0000","last_undegraded":"2024-04-26T12:20:35.354702+0000","last_fullsized":"2024-04-26T12:20:35.354702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:40.233447+0000","last_change":"2024-04-26T12:20:40.233585+0000","last_active":"2024-04-26T12:20:40.233447+0000","last_peered":"2024-04-26T12:20:40.233447+0000","last_clean":"2024-04-26T12:20:40.233447+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:40.233447+0000","last_undegraded":"2024-04-26T12:20:40.233447+0000","last_fullsized":"2024-04-26T12:20:40.233447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_clean_scrub_stamp":"2024-04-26T12:20:40.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.531307+0000","scrub_duration":0.037253345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682902+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:29.682902+0000","last_peered":"2024-04-26T12:20:29.682902+0000","last_clean":"2024-04-26T12:20:29.682902+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:29.682902+0000","last_undegraded":"2024-04-26T12:20:29.682902+0000","last_fullsized":"2024-04-26T12:20:29.682902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683060+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:29.683060+0000","last_peered":"2024-04-26T12:20:29.683060+0000","last_clean":"2024-04-26T12:20:29.683060+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:29.683060+0000","last_undegraded":"2024-04-26T12:20:29.683060+0000","last_fullsized":"2024-04-26T12:20:29.683060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:38.217915+0000","last_change":"2024-04-26T12:20:38.217915+0000","last_active":"2024-04-26T12:20:38.217915+0000","last_peered":"2024-04-26T12:20:38.217915+0000","last_clean":"2024-04-26T12:20:38.217915+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:38.217915+0000","last_undegraded":"2024-04-26T12:20:38.217915+0000","last_fullsized":"2024-04-26T12:20:38.217915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_clean_scrub_stamp":"2024-04-26T12:20:38.217739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:53.024648+0000","scrub_duration":0.001837775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.345758+0000","last_change":"2024-04-26T12:21:02.345857+0000","last_active":"2024-04-26T12:21:02.345758+0000","last_peered":"2024-04-26T12:21:02.345758+0000","last_clean":"2024-04-26T12:21:02.345758+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:21:02.345758+0000","last_undegraded":"2024-04-26T12:21:02.345758+0000","last_fullsized":"2024-04-26T12:21:02.345758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.345738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:46.742649+0000","scrub_duration":0.0017828270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513573+0000","last_change":"2024-04-26T12:14:38.231203+0000","last_active":"2024-04-26T12:20:34.513573+0000","last_peered":"2024-04-26T12:20:34.513573+0000","last_clean":"2024-04-26T12:20:34.513573+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:20:34.513573+0000","last_undegraded":"2024-04-26T12:20:34.513573+0000","last_fullsized":"2024-04-26T12:20:34.513573+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.788962+0000","last_change":"2024-04-26T12:20:42.788962+0000","last_active":"2024-04-26T12:20:42.788962+0000","last_peered":"2024-04-26T12:20:42.788962+0000","last_clean":"2024-04-26T12:20:42.788962+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:42.788962+0000","last_undegraded":"2024-04-26T12:20:42.788962+0000","last_fullsized":"2024-04-26T12:20:42.788962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.788831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:48.051123+0000","scrub_duration":0.0018731360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:08.930400+0000","last_change":"2024-04-26T12:21:08.930526+0000","last_active":"2024-04-26T12:21:08.930400+0000","last_peered":"2024-04-26T12:21:08.930400+0000","last_clean":"2024-04-26T12:21:08.930400+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:21:08.930400+0000","last_undegraded":"2024-04-26T12:21:08.930400+0000","last_fullsized":"2024-04-26T12:21:08.930400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_clean_scrub_stamp":"2024-04-26T12:21:08.930381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:57.478621+0000","scrub_duration":0.0022001880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354504+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:35.354504+0000","last_peered":"2024-04-26T12:20:35.354504+0000","last_clean":"2024-04-26T12:20:35.354504+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:35.354504+0000","last_undegraded":"2024-04-26T12:20:35.354504+0000","last_fullsized":"2024-04-26T12:20:35.354504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.798092+0000","last_change":"2024-04-26T12:21:01.798203+0000","last_active":"2024-04-26T12:21:01.798092+0000","last_peered":"2024-04-26T12:21:01.798092+0000","last_clean":"2024-04-26T12:21:01.798092+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:21:01.798092+0000","last_undegraded":"2024-04-26T12:21:01.798092+0000","last_fullsized":"2024-04-26T12:21:01.798092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.798071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:26.107733+0000","scrub_duration":0.0017992150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683498+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:29.683498+0000","last_peered":"2024-04-26T12:20:29.683498+0000","last_clean":"2024-04-26T12:20:29.683498+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:29.683498+0000","last_undegraded":"2024-04-26T12:20:29.683498+0000","last_fullsized":"2024-04-26T12:20:29.683498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513576+0000","last_change":"2024-04-26T12:14:38.233637+0000","last_active":"2024-04-26T12:20:34.513576+0000","last_peered":"2024-04-26T12:20:34.513576+0000","last_clean":"2024-04-26T12:20:34.513576+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:20:34.513576+0000","last_undegraded":"2024-04-26T12:20:34.513576+0000","last_fullsized":"2024-04-26T12:20:34.513576+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:39.239308+0000","last_change":"2024-04-26T12:20:39.239308+0000","last_active":"2024-04-26T12:20:39.239308+0000","last_peered":"2024-04-26T12:20:39.239308+0000","last_clean":"2024-04-26T12:20:39.239308+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:39.239308+0000","last_undegraded":"2024-04-26T12:20:39.239308+0000","last_fullsized":"2024-04-26T12:20:39.239308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_clean_scrub_stamp":"2024-04-26T12:20:39.239159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:05.765227+0000","scrub_duration":0.001927977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683376+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:29.683376+0000","last_peered":"2024-04-26T12:20:29.683376+0000","last_clean":"2024-04-26T12:20:29.683376+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:29.683376+0000","last_undegraded":"2024-04-26T12:20:29.683376+0000","last_fullsized":"2024-04-26T12:20:29.683376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683615+0000","last_change":"2024-04-26T12:20:25.657366+0000","last_active":"2024-04-26T12:20:29.683615+0000","last_peered":"2024-04-26T12:20:29.683615+0000","last_clean":"2024-04-26T12:20:29.683615+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:20:29.683615+0000","last_undegraded":"2024-04-26T12:20:29.683615+0000","last_fullsized":"2024-04-26T12:20:29.683615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354684+0000","last_change":"2024-04-26T12:20:25.658852+0000","last_active":"2024-04-26T12:20:35.354684+0000","last_peered":"2024-04-26T12:20:35.354684+0000","last_clean":"2024-04-26T12:20:35.354684+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:20:35.354684+0000","last_undegraded":"2024-04-26T12:20:35.354684+0000","last_fullsized":"2024-04-26T12:20:35.354684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683612+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:29.683612+0000","last_peered":"2024-04-26T12:20:29.683612+0000","last_clean":"2024-04-26T12:20:29.683612+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:29.683612+0000","last_undegraded":"2024-04-26T12:20:29.683612+0000","last_fullsized":"2024-04-26T12:20:29.683612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683168+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:29.683168+0000","last_peered":"2024-04-26T12:20:29.683168+0000","last_clean":"2024-04-26T12:20:29.683168+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:29.683168+0000","last_undegraded":"2024-04-26T12:20:29.683168+0000","last_fullsized":"2024-04-26T12:20:29.683168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.046122+0000","last_change":"2024-04-26T12:21:02.046248+0000","last_active":"2024-04-26T12:21:02.046122+0000","last_peered":"2024-04-26T12:21:02.046122+0000","last_clean":"2024-04-26T12:21:02.046122+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:21:02.046122+0000","last_undegraded":"2024-04-26T12:21:02.046122+0000","last_fullsized":"2024-04-26T12:21:02.046122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.046099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:02.071804+0000","scrub_duration":0.0017987509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":107,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325030+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:30.325030+0000","last_peered":"2024-04-26T12:20:30.325030+0000","last_clean":"2024-04-26T12:20:30.325030+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:30.325030+0000","last_undegraded":"2024-04-26T12:20:30.325030+0000","last_fullsized":"2024-04-26T12:20:30.325030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683794+0000","last_change":"2024-04-26T12:20:25.659025+0000","last_active":"2024-04-26T12:20:29.683794+0000","last_peered":"2024-04-26T12:20:29.683794+0000","last_clean":"2024-04-26T12:20:29.683794+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:20:29.683794+0000","last_undegraded":"2024-04-26T12:20:29.683794+0000","last_fullsized":"2024-04-26T12:20:29.683794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.061976+0000","last_change":"2024-04-26T12:20:53.062080+0000","last_active":"2024-04-26T12:20:53.061976+0000","last_peered":"2024-04-26T12:20:53.061976+0000","last_clean":"2024-04-26T12:20:53.061976+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:53.061976+0000","last_undegraded":"2024-04-26T12:20:53.061976+0000","last_fullsized":"2024-04-26T12:20:53.061976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.061955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:36.090188+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.148566+0000","last_change":"2024-04-26T12:20:45.148696+0000","last_active":"2024-04-26T12:20:45.148566+0000","last_peered":"2024-04-26T12:20:45.148566+0000","last_clean":"2024-04-26T12:20:45.148566+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:45.148566+0000","last_undegraded":"2024-04-26T12:20:45.148566+0000","last_fullsized":"2024-04-26T12:20:45.148566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.148548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.383636+0000","scrub_duration":0.0018031029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:49.111826+0000","last_change":"2024-04-26T12:20:49.111929+0000","last_active":"2024-04-26T12:20:49.111826+0000","last_peered":"2024-04-26T12:20:49.111826+0000","last_clean":"2024-04-26T12:20:49.111826+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:49.111826+0000","last_undegraded":"2024-04-26T12:20:49.111826+0000","last_fullsized":"2024-04-26T12:20:49.111826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_clean_scrub_stamp":"2024-04-26T12:20:49.111806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:18.633109+0000","scrub_duration":0.0015728319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:55.873745+0000","last_change":"2024-04-26T12:20:55.873745+0000","last_active":"2024-04-26T12:20:55.873745+0000","last_peered":"2024-04-26T12:20:55.873745+0000","last_clean":"2024-04-26T12:20:55.873745+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:55.873745+0000","last_undegraded":"2024-04-26T12:20:55.873745+0000","last_fullsized":"2024-04-26T12:20:55.873745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_clean_scrub_stamp":"2024-04-26T12:20:55.873506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:35.165043+0000","scrub_duration":0.069253721000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682524+0000","last_change":"2024-04-26T12:14:42.527295+0000","last_active":"2024-04-26T12:20:29.682524+0000","last_peered":"2024-04-26T12:20:29.682524+0000","last_clean":"2024-04-26T12:20:29.682524+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:20:29.682524+0000","last_undegraded":"2024-04-26T12:20:29.682524+0000","last_fullsized":"2024-04-26T12:20:29.682524+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.267347+0000","last_change":"2024-04-26T12:20:37.267347+0000","last_active":"2024-04-26T12:20:37.267347+0000","last_peered":"2024-04-26T12:20:37.267347+0000","last_clean":"2024-04-26T12:20:37.267347+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:37.267347+0000","last_undegraded":"2024-04-26T12:20:37.267347+0000","last_fullsized":"2024-04-26T12:20:37.267347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.267215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:21.882383+0000","scrub_duration":0.0018490620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.009965+0000","last_change":"2024-04-26T12:21:01.010072+0000","last_active":"2024-04-26T12:21:01.009965+0000","last_peered":"2024-04-26T12:21:01.009965+0000","last_clean":"2024-04-26T12:21:01.009965+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:21:01.009965+0000","last_undegraded":"2024-04-26T12:21:01.009965+0000","last_fullsized":"2024-04-26T12:21:01.009965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.009933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:20.201451+0000","scrub_duration":0.0018985370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324790+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:30.324790+0000","last_peered":"2024-04-26T12:20:30.324790+0000","last_clean":"2024-04-26T12:20:30.324790+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:30.324790+0000","last_undegraded":"2024-04-26T12:20:30.324790+0000","last_fullsized":"2024-04-26T12:20:30.324790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324513+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:30.324513+0000","last_peered":"2024-04-26T12:20:30.324513+0000","last_clean":"2024-04-26T12:20:30.324513+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:30.324513+0000","last_undegraded":"2024-04-26T12:20:30.324513+0000","last_fullsized":"2024-04-26T12:20:30.324513+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324678+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:30.324678+0000","last_peered":"2024-04-26T12:20:30.324678+0000","last_clean":"2024-04-26T12:20:30.324678+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:30.324678+0000","last_undegraded":"2024-04-26T12:20:30.324678+0000","last_fullsized":"2024-04-26T12:20:30.324678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324594+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:30.324594+0000","last_peered":"2024-04-26T12:20:30.324594+0000","last_clean":"2024-04-26T12:20:30.324594+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:30.324594+0000","last_undegraded":"2024-04-26T12:20:30.324594+0000","last_fullsized":"2024-04-26T12:20:30.324594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683765+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:29.683765+0000","last_peered":"2024-04-26T12:20:29.683765+0000","last_clean":"2024-04-26T12:20:29.683765+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:29.683765+0000","last_undegraded":"2024-04-26T12:20:29.683765+0000","last_fullsized":"2024-04-26T12:20:29.683765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.306612+0000","last_change":"2024-04-26T12:21:01.306715+0000","last_active":"2024-04-26T12:21:01.306612+0000","last_peered":"2024-04-26T12:21:01.306612+0000","last_clean":"2024-04-26T12:21:01.306612+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:21:01.306612+0000","last_undegraded":"2024-04-26T12:21:01.306612+0000","last_fullsized":"2024-04-26T12:21:01.306612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.306592+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:51.007517+0000","scrub_duration":0.003604196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683212+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:29.683212+0000","last_peered":"2024-04-26T12:20:29.683212+0000","last_clean":"2024-04-26T12:20:29.683212+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:29.683212+0000","last_undegraded":"2024-04-26T12:20:29.683212+0000","last_fullsized":"2024-04-26T12:20:29.683212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324898+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:30.324898+0000","last_peered":"2024-04-26T12:20:30.324898+0000","last_clean":"2024-04-26T12:20:30.324898+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:30.324898+0000","last_undegraded":"2024-04-26T12:20:30.324898+0000","last_fullsized":"2024-04-26T12:20:30.324898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324457+0000","last_change":"2024-04-26T12:14:42.868205+0000","last_active":"2024-04-26T12:20:30.324457+0000","last_peered":"2024-04-26T12:20:30.324457+0000","last_clean":"2024-04-26T12:20:30.324457+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:20:30.324457+0000","last_undegraded":"2024-04-26T12:20:30.324457+0000","last_fullsized":"2024-04-26T12:20:30.324457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.113455+0000","last_change":"2024-04-26T12:20:51.113577+0000","last_active":"2024-04-26T12:20:51.113455+0000","last_peered":"2024-04-26T12:20:51.113455+0000","last_clean":"2024-04-26T12:20:51.113455+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:51.113455+0000","last_undegraded":"2024-04-26T12:20:51.113455+0000","last_fullsized":"2024-04-26T12:20:51.113455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.113432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:11.752649+0000","scrub_duration":0.0017589649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.269911+0000","last_change":"2024-04-26T12:20:59.270025+0000","last_active":"2024-04-26T12:20:59.269911+0000","last_peered":"2024-04-26T12:20:59.269911+0000","last_clean":"2024-04-26T12:20:59.269911+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:59.269911+0000","last_undegraded":"2024-04-26T12:20:59.269911+0000","last_fullsized":"2024-04-26T12:20:59.269911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.269890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:50.740249+0000","scrub_duration":0.0016247309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.241925+0000","last_change":"2024-04-26T12:20:42.241925+0000","last_active":"2024-04-26T12:20:42.241925+0000","last_peered":"2024-04-26T12:20:42.241925+0000","last_clean":"2024-04-26T12:20:42.241925+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:42.241925+0000","last_undegraded":"2024-04-26T12:20:42.241925+0000","last_fullsized":"2024-04-26T12:20:42.241925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.241764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:44.362930+0000","scrub_duration":0.0044497909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321308,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050532,"statfs":{"total":96636764160,"available":96307744768,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.39900000000000002},"min":{"1min":0.432,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.69499999999999995,"5min":0.871,"15min":0.871},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.42699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.66500000000000004,"5min":0.88400000000000001,"15min":0.92900000000000005},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579916,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483144,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888696,"statfs":{"total":96636764160,"available":96142024704,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42099999999999999,"15min":0.371},"min":{"1min":0.36699999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.65300000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.375,"5min":0.185,"15min":0.185},"max":{"1min":0.58499999999999996,"5min":0.879,"15min":0.879},"last":0.32800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:21:16.326 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.326 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.326 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.327 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.328 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.328 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.328 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.328 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.328 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.328 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.328 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.329 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.329 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.329 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.329 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.329 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.329 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.329 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.330 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.330 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.330 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.330 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.330 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.330 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.330 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.331 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.332 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.333 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.334 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.334 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.334 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.334 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.334 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.334 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.334 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:16.335 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:21:36.337 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:21:36.637 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:21:36.639 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:21:36.647 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-04-26T12:21:36.536990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834444,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281076,"statfs":{"total":289910292480,"available":289055821824,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003275"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.355056+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:35.355056+0000","last_peered":"2024-04-26T12:20:35.355056+0000","last_clean":"2024-04-26T12:20:35.355056+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:35.355056+0000","last_undegraded":"2024-04-26T12:20:35.355056+0000","last_fullsized":"2024-04-26T12:20:35.355056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.355031+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:35.355031+0000","last_peered":"2024-04-26T12:20:35.355031+0000","last_clean":"2024-04-26T12:20:35.355031+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:35.355031+0000","last_undegraded":"2024-04-26T12:20:35.355031+0000","last_fullsized":"2024-04-26T12:20:35.355031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683930+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:29.683930+0000","last_peered":"2024-04-26T12:20:29.683930+0000","last_clean":"2024-04-26T12:20:29.683930+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:29.683930+0000","last_undegraded":"2024-04-26T12:20:29.683930+0000","last_fullsized":"2024-04-26T12:20:29.683930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:57.265439+0000","last_change":"2024-04-26T12:20:57.265567+0000","last_active":"2024-04-26T12:20:57.265439+0000","last_peered":"2024-04-26T12:20:57.265439+0000","last_clean":"2024-04-26T12:20:57.265439+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:57.265439+0000","last_undegraded":"2024-04-26T12:20:57.265439+0000","last_fullsized":"2024-04-26T12:20:57.265439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_clean_scrub_stamp":"2024-04-26T12:20:57.265416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:34.758945+0000","scrub_duration":0.0019165709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:03.872257+0000","last_change":"2024-04-26T12:21:03.872380+0000","last_active":"2024-04-26T12:21:03.872257+0000","last_peered":"2024-04-26T12:21:03.872257+0000","last_clean":"2024-04-26T12:21:03.872257+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:21:03.872257+0000","last_undegraded":"2024-04-26T12:21:03.872257+0000","last_fullsized":"2024-04-26T12:21:03.872257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_clean_scrub_stamp":"2024-04-26T12:21:03.872236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.873602+0000","scrub_duration":0.021825418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683632+0000","last_change":"2024-04-26T12:20:25.664431+0000","last_active":"2024-04-26T12:20:29.683632+0000","last_peered":"2024-04-26T12:20:29.683632+0000","last_clean":"2024-04-26T12:20:29.683632+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:20:29.683632+0000","last_undegraded":"2024-04-26T12:20:29.683632+0000","last_fullsized":"2024-04-26T12:20:29.683632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683497+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:29.683497+0000","last_peered":"2024-04-26T12:20:29.683497+0000","last_clean":"2024-04-26T12:20:29.683497+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:29.683497+0000","last_undegraded":"2024-04-26T12:20:29.683497+0000","last_fullsized":"2024-04-26T12:20:29.683497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683060+0000","last_change":"2024-04-26T12:20:25.664426+0000","last_active":"2024-04-26T12:20:29.683060+0000","last_peered":"2024-04-26T12:20:29.683060+0000","last_clean":"2024-04-26T12:20:29.683060+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:20:29.683060+0000","last_undegraded":"2024-04-26T12:20:29.683060+0000","last_fullsized":"2024-04-26T12:20:29.683060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683161+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:29.683161+0000","last_peered":"2024-04-26T12:20:29.683161+0000","last_clean":"2024-04-26T12:20:29.683161+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:29.683161+0000","last_undegraded":"2024-04-26T12:20:29.683161+0000","last_fullsized":"2024-04-26T12:20:29.683161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.790532+0000","last_change":"2024-04-26T12:20:41.790658+0000","last_active":"2024-04-26T12:20:41.790532+0000","last_peered":"2024-04-26T12:20:41.790532+0000","last_clean":"2024-04-26T12:20:41.790532+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:41.790532+0000","last_undegraded":"2024-04-26T12:20:41.790532+0000","last_fullsized":"2024-04-26T12:20:41.790532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.790495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:52.175594+0000","scrub_duration":0.0019401209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.379089+0000","last_change":"2024-04-26T12:21:29.379199+0000","last_active":"2024-04-26T12:21:29.379089+0000","last_peered":"2024-04-26T12:21:29.379089+0000","last_clean":"2024-04-26T12:21:29.379089+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:21:29.379089+0000","last_undegraded":"2024-04-26T12:21:29.379089+0000","last_fullsized":"2024-04-26T12:21:29.379089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.379071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.183371+0000","scrub_duration":0.020900218000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324686+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:30.324686+0000","last_peered":"2024-04-26T12:20:30.324686+0000","last_clean":"2024-04-26T12:20:30.324686+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:30.324686+0000","last_undegraded":"2024-04-26T12:20:30.324686+0000","last_fullsized":"2024-04-26T12:20:30.324686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324442+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:30.324442+0000","last_peered":"2024-04-26T12:20:30.324442+0000","last_clean":"2024-04-26T12:20:30.324442+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:30.324442+0000","last_undegraded":"2024-04-26T12:20:30.324442+0000","last_fullsized":"2024-04-26T12:20:30.324442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:32.386134+0000","last_change":"2024-04-26T12:21:32.386234+0000","last_active":"2024-04-26T12:21:32.386134+0000","last_peered":"2024-04-26T12:21:32.386134+0000","last_clean":"2024-04-26T12:21:32.386134+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:21:32.386134+0000","last_undegraded":"2024-04-26T12:21:32.386134+0000","last_fullsized":"2024-04-26T12:21:32.386134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_clean_scrub_stamp":"2024-04-26T12:21:32.386115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:35.046547+0000","scrub_duration":0.0017283579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:04.377717+0000","last_change":"2024-04-26T12:21:04.377824+0000","last_active":"2024-04-26T12:21:04.377717+0000","last_peered":"2024-04-26T12:21:04.377717+0000","last_clean":"2024-04-26T12:21:04.377717+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:21:04.377717+0000","last_undegraded":"2024-04-26T12:21:04.377717+0000","last_fullsized":"2024-04-26T12:21:04.377717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_clean_scrub_stamp":"2024-04-26T12:21:04.377697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.199940+0000","scrub_duration":0.0019611149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.219944+0000","last_change":"2024-04-26T12:20:41.220047+0000","last_active":"2024-04-26T12:20:41.219944+0000","last_peered":"2024-04-26T12:20:41.219944+0000","last_clean":"2024-04-26T12:20:41.219944+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:41.219944+0000","last_undegraded":"2024-04-26T12:20:41.219944+0000","last_fullsized":"2024-04-26T12:20:41.219944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.219912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:44.836560+0000","scrub_duration":0.001961516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683472+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:29.683472+0000","last_peered":"2024-04-26T12:20:29.683472+0000","last_clean":"2024-04-26T12:20:29.683472+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:29.683472+0000","last_undegraded":"2024-04-26T12:20:29.683472+0000","last_fullsized":"2024-04-26T12:20:29.683472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:52.790048+0000","last_change":"2024-04-26T12:20:52.790151+0000","last_active":"2024-04-26T12:20:52.790048+0000","last_peered":"2024-04-26T12:20:52.790048+0000","last_clean":"2024-04-26T12:20:52.790048+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:52.790048+0000","last_undegraded":"2024-04-26T12:20:52.790048+0000","last_fullsized":"2024-04-26T12:20:52.790048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_clean_scrub_stamp":"2024-04-26T12:20:52.790025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:37.405193+0000","scrub_duration":0.0021779400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514029+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:34.514029+0000","last_peered":"2024-04-26T12:20:34.514029+0000","last_clean":"2024-04-26T12:20:34.514029+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:34.514029+0000","last_undegraded":"2024-04-26T12:20:34.514029+0000","last_fullsized":"2024-04-26T12:20:34.514029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683555+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:29.683555+0000","last_peered":"2024-04-26T12:20:29.683555+0000","last_clean":"2024-04-26T12:20:29.683555+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:29.683555+0000","last_undegraded":"2024-04-26T12:20:29.683555+0000","last_fullsized":"2024-04-26T12:20:29.683555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:17.676174+0000","last_change":"2024-04-26T12:21:17.676291+0000","last_active":"2024-04-26T12:21:17.676174+0000","last_peered":"2024-04-26T12:21:17.676174+0000","last_clean":"2024-04-26T12:21:17.676174+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:21:17.676174+0000","last_undegraded":"2024-04-26T12:21:17.676174+0000","last_fullsized":"2024-04-26T12:21:17.676174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_clean_scrub_stamp":"2024-04-26T12:21:17.676137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:03.477865+0000","scrub_duration":0.022895645999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354932+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:35.354932+0000","last_peered":"2024-04-26T12:20:35.354932+0000","last_clean":"2024-04-26T12:20:35.354932+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:35.354932+0000","last_undegraded":"2024-04-26T12:20:35.354932+0000","last_fullsized":"2024-04-26T12:20:35.354932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514081+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:34.514081+0000","last_peered":"2024-04-26T12:20:34.514081+0000","last_clean":"2024-04-26T12:20:34.514081+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:34.514081+0000","last_undegraded":"2024-04-26T12:20:34.514081+0000","last_fullsized":"2024-04-26T12:20:34.514081+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354916+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:35.354916+0000","last_peered":"2024-04-26T12:20:35.354916+0000","last_clean":"2024-04-26T12:20:35.354916+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:35.354916+0000","last_undegraded":"2024-04-26T12:20:35.354916+0000","last_fullsized":"2024-04-26T12:20:35.354916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.813170+0000","last_change":"2024-04-26T12:21:27.813304+0000","last_active":"2024-04-26T12:21:27.813170+0000","last_peered":"2024-04-26T12:21:27.813170+0000","last_clean":"2024-04-26T12:21:27.813170+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:21:27.813170+0000","last_undegraded":"2024-04-26T12:21:27.813170+0000","last_fullsized":"2024-04-26T12:21:27.813170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.813147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:16.361388+0000","scrub_duration":0.023876636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514018+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:34.514018+0000","last_peered":"2024-04-26T12:20:34.514018+0000","last_clean":"2024-04-26T12:20:34.514018+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:34.514018+0000","last_undegraded":"2024-04-26T12:20:34.514018+0000","last_fullsized":"2024-04-26T12:20:34.514018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683839+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:29.683839+0000","last_peered":"2024-04-26T12:20:29.683839+0000","last_clean":"2024-04-26T12:20:29.683839+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:29.683839+0000","last_undegraded":"2024-04-26T12:20:29.683839+0000","last_fullsized":"2024-04-26T12:20:29.683839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.808505+0000","last_change":"2024-04-26T12:20:59.808505+0000","last_active":"2024-04-26T12:20:59.808505+0000","last_peered":"2024-04-26T12:20:59.808505+0000","last_clean":"2024-04-26T12:20:59.808505+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:59.808505+0000","last_undegraded":"2024-04-26T12:20:59.808505+0000","last_fullsized":"2024-04-26T12:20:59.808505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.808367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.929534+0000","scrub_duration":0.002171816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514007+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:34.514007+0000","last_peered":"2024-04-26T12:20:34.514007+0000","last_clean":"2024-04-26T12:20:34.514007+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:34.514007+0000","last_undegraded":"2024-04-26T12:20:34.514007+0000","last_fullsized":"2024-04-26T12:20:34.514007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:13.806551+0000","last_change":"2024-04-26T12:21:13.806657+0000","last_active":"2024-04-26T12:21:13.806551+0000","last_peered":"2024-04-26T12:21:13.806551+0000","last_clean":"2024-04-26T12:21:13.806551+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:21:13.806551+0000","last_undegraded":"2024-04-26T12:21:13.806551+0000","last_fullsized":"2024-04-26T12:21:13.806551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_clean_scrub_stamp":"2024-04-26T12:21:13.806530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:56.319084+0000","scrub_duration":0.0017893570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514021+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:34.514021+0000","last_peered":"2024-04-26T12:20:34.514021+0000","last_clean":"2024-04-26T12:20:34.514021+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:34.514021+0000","last_undegraded":"2024-04-26T12:20:34.514021+0000","last_fullsized":"2024-04-26T12:20:34.514021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682826+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:29.682826+0000","last_peered":"2024-04-26T12:20:29.682826+0000","last_clean":"2024-04-26T12:20:29.682826+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:29.682826+0000","last_undegraded":"2024-04-26T12:20:29.682826+0000","last_fullsized":"2024-04-26T12:20:29.682826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:05.802987+0000","last_change":"2024-04-26T12:21:05.803095+0000","last_active":"2024-04-26T12:21:05.802987+0000","last_peered":"2024-04-26T12:21:05.802987+0000","last_clean":"2024-04-26T12:21:05.802987+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:21:05.802987+0000","last_undegraded":"2024-04-26T12:21:05.802987+0000","last_fullsized":"2024-04-26T12:21:05.802987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_clean_scrub_stamp":"2024-04-26T12:21:05.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:22.222434+0000","scrub_duration":0.0018232630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683200+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:29.683200+0000","last_peered":"2024-04-26T12:20:29.683200+0000","last_clean":"2024-04-26T12:20:29.683200+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:29.683200+0000","last_undegraded":"2024-04-26T12:20:29.683200+0000","last_fullsized":"2024-04-26T12:20:29.683200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.778498+0000","last_change":"2024-04-26T12:20:53.778599+0000","last_active":"2024-04-26T12:20:53.778498+0000","last_peered":"2024-04-26T12:20:53.778498+0000","last_clean":"2024-04-26T12:20:53.778498+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:53.778498+0000","last_undegraded":"2024-04-26T12:20:53.778498+0000","last_fullsized":"2024-04-26T12:20:53.778498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.778477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:08.585386+0000","scrub_duration":0.021558476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:47.161936+0000","last_change":"2024-04-26T12:20:47.162047+0000","last_active":"2024-04-26T12:20:47.161936+0000","last_peered":"2024-04-26T12:20:47.161936+0000","last_clean":"2024-04-26T12:20:47.161936+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:47.161936+0000","last_undegraded":"2024-04-26T12:20:47.161936+0000","last_fullsized":"2024-04-26T12:20:47.161936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_clean_scrub_stamp":"2024-04-26T12:20:47.161913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:03.581394+0000","scrub_duration":0.00169505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.982650+0000","last_change":"2024-04-26T12:21:19.982751+0000","last_active":"2024-04-26T12:21:19.982650+0000","last_peered":"2024-04-26T12:21:19.982650+0000","last_clean":"2024-04-26T12:21:19.982650+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:21:19.982650+0000","last_undegraded":"2024-04-26T12:21:19.982650+0000","last_fullsized":"2024-04-26T12:21:19.982650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.982628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:02.501013+0000","scrub_duration":0.001761875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324314+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:30.324314+0000","last_peered":"2024-04-26T12:20:30.324314+0000","last_clean":"2024-04-26T12:20:30.324314+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:30.324314+0000","last_undegraded":"2024-04-26T12:20:30.324314+0000","last_fullsized":"2024-04-26T12:20:30.324314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683228+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:29.683228+0000","last_peered":"2024-04-26T12:20:29.683228+0000","last_clean":"2024-04-26T12:20:29.683228+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:29.683228+0000","last_undegraded":"2024-04-26T12:20:29.683228+0000","last_fullsized":"2024-04-26T12:20:29.683228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682823+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:29.682823+0000","last_peered":"2024-04-26T12:20:29.682823+0000","last_clean":"2024-04-26T12:20:29.682823+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:29.682823+0000","last_undegraded":"2024-04-26T12:20:29.682823+0000","last_fullsized":"2024-04-26T12:20:29.682823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683688+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:29.683688+0000","last_peered":"2024-04-26T12:20:29.683688+0000","last_clean":"2024-04-26T12:20:29.683688+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:29.683688+0000","last_undegraded":"2024-04-26T12:20:29.683688+0000","last_fullsized":"2024-04-26T12:20:29.683688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:21.922061+0000","last_change":"2024-04-26T12:21:21.922165+0000","last_active":"2024-04-26T12:21:21.922061+0000","last_peered":"2024-04-26T12:21:21.922061+0000","last_clean":"2024-04-26T12:21:21.922061+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:21:21.922061+0000","last_undegraded":"2024-04-26T12:21:21.922061+0000","last_fullsized":"2024-04-26T12:21:21.922061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_clean_scrub_stamp":"2024-04-26T12:21:21.922041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:21.947746+0000","scrub_duration":0.0019268759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":107,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354516+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:35.354516+0000","last_peered":"2024-04-26T12:20:35.354516+0000","last_clean":"2024-04-26T12:20:35.354516+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:35.354516+0000","last_undegraded":"2024-04-26T12:20:35.354516+0000","last_fullsized":"2024-04-26T12:20:35.354516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354758+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:35.354758+0000","last_peered":"2024-04-26T12:20:35.354758+0000","last_clean":"2024-04-26T12:20:35.354758+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:35.354758+0000","last_undegraded":"2024-04-26T12:20:35.354758+0000","last_fullsized":"2024-04-26T12:20:35.354758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683701+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:29.683701+0000","last_peered":"2024-04-26T12:20:29.683701+0000","last_clean":"2024-04-26T12:20:29.683701+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:29.683701+0000","last_undegraded":"2024-04-26T12:20:29.683701+0000","last_fullsized":"2024-04-26T12:20:29.683701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.239958+0000","last_change":"2024-04-26T12:20:51.240064+0000","last_active":"2024-04-26T12:20:51.239958+0000","last_peered":"2024-04-26T12:20:51.239958+0000","last_clean":"2024-04-26T12:20:51.239958+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:51.239958+0000","last_undegraded":"2024-04-26T12:20:51.239958+0000","last_fullsized":"2024-04-26T12:20:51.239958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.239936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:38.455956+0000","scrub_duration":0.0018569750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.195154+0000","last_change":"2024-04-26T12:20:45.195262+0000","last_active":"2024-04-26T12:20:45.195154+0000","last_peered":"2024-04-26T12:20:45.195154+0000","last_clean":"2024-04-26T12:20:45.195154+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:45.195154+0000","last_undegraded":"2024-04-26T12:20:45.195154+0000","last_fullsized":"2024-04-26T12:20:45.195154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.195132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:03.642870+0000","scrub_duration":0.001821214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:44.228054+0000","last_change":"2024-04-26T12:20:44.228054+0000","last_active":"2024-04-26T12:20:44.228054+0000","last_peered":"2024-04-26T12:20:44.228054+0000","last_clean":"2024-04-26T12:20:44.228054+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:44.228054+0000","last_undegraded":"2024-04-26T12:20:44.228054+0000","last_fullsized":"2024-04-26T12:20:44.228054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_clean_scrub_stamp":"2024-04-26T12:20:44.227884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:28.326058+0000","scrub_duration":0.037590602000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513691+0000","last_change":"2024-04-26T12:20:25.657692+0000","last_active":"2024-04-26T12:20:34.513691+0000","last_peered":"2024-04-26T12:20:34.513691+0000","last_clean":"2024-04-26T12:20:34.513691+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:20:34.513691+0000","last_undegraded":"2024-04-26T12:20:34.513691+0000","last_fullsized":"2024-04-26T12:20:34.513691+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683745+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:29.683745+0000","last_peered":"2024-04-26T12:20:29.683745+0000","last_clean":"2024-04-26T12:20:29.683745+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:29.683745+0000","last_undegraded":"2024-04-26T12:20:29.683745+0000","last_fullsized":"2024-04-26T12:20:29.683745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683120+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:29.683120+0000","last_peered":"2024-04-26T12:20:29.683120+0000","last_clean":"2024-04-26T12:20:29.683120+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:29.683120+0000","last_undegraded":"2024-04-26T12:20:29.683120+0000","last_fullsized":"2024-04-26T12:20:29.683120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.185645+0000","last_change":"2024-04-26T12:20:37.185781+0000","last_active":"2024-04-26T12:20:37.185645+0000","last_peered":"2024-04-26T12:20:37.185645+0000","last_clean":"2024-04-26T12:20:37.185645+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:37.185645+0000","last_undegraded":"2024-04-26T12:20:37.185645+0000","last_fullsized":"2024-04-26T12:20:37.185645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.185622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:13.134344+0000","scrub_duration":0.0022406729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354504+0000","last_change":"2024-04-26T12:20:25.658581+0000","last_active":"2024-04-26T12:20:35.354504+0000","last_peered":"2024-04-26T12:20:35.354504+0000","last_clean":"2024-04-26T12:20:35.354504+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:35.354504+0000","last_undegraded":"2024-04-26T12:20:35.354504+0000","last_fullsized":"2024-04-26T12:20:35.354504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683887+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:29.683887+0000","last_peered":"2024-04-26T12:20:29.683887+0000","last_clean":"2024-04-26T12:20:29.683887+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:29.683887+0000","last_undegraded":"2024-04-26T12:20:29.683887+0000","last_fullsized":"2024-04-26T12:20:29.683887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354520+0000","last_change":"2024-04-26T12:14:42.528386+0000","last_active":"2024-04-26T12:20:35.354520+0000","last_peered":"2024-04-26T12:20:35.354520+0000","last_clean":"2024-04-26T12:20:35.354520+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:20:35.354520+0000","last_undegraded":"2024-04-26T12:20:35.354520+0000","last_fullsized":"2024-04-26T12:20:35.354520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.243964+0000","last_change":"2024-04-26T12:20:46.243964+0000","last_active":"2024-04-26T12:20:46.243964+0000","last_peered":"2024-04-26T12:20:46.243964+0000","last_clean":"2024-04-26T12:20:46.243964+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:46.243964+0000","last_undegraded":"2024-04-26T12:20:46.243964+0000","last_fullsized":"2024-04-26T12:20:46.243964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_clean_scrub_stamp":"2024-04-26T12:20:46.243795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.992132+0000","scrub_duration":0.071910356999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682732+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:29.682732+0000","last_peered":"2024-04-26T12:20:29.682732+0000","last_clean":"2024-04-26T12:20:29.682732+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:29.682732+0000","last_undegraded":"2024-04-26T12:20:29.682732+0000","last_fullsized":"2024-04-26T12:20:29.682732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683211+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:29.683211+0000","last_peered":"2024-04-26T12:20:29.683211+0000","last_clean":"2024-04-26T12:20:29.683211+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:29.683211+0000","last_undegraded":"2024-04-26T12:20:29.683211+0000","last_fullsized":"2024-04-26T12:20:29.683211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513621+0000","last_change":"2024-04-26T12:14:42.527133+0000","last_active":"2024-04-26T12:20:34.513621+0000","last_peered":"2024-04-26T12:20:34.513621+0000","last_clean":"2024-04-26T12:20:34.513621+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:20:34.513621+0000","last_undegraded":"2024-04-26T12:20:34.513621+0000","last_fullsized":"2024-04-26T12:20:34.513621+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683812+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:29.683812+0000","last_peered":"2024-04-26T12:20:29.683812+0000","last_clean":"2024-04-26T12:20:29.683812+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:29.683812+0000","last_undegraded":"2024-04-26T12:20:29.683812+0000","last_fullsized":"2024-04-26T12:20:29.683812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:28.389100+0000","last_change":"2024-04-26T12:21:28.389208+0000","last_active":"2024-04-26T12:21:28.389100+0000","last_peered":"2024-04-26T12:21:28.389100+0000","last_clean":"2024-04-26T12:21:28.389100+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:21:28.389100+0000","last_undegraded":"2024-04-26T12:21:28.389100+0000","last_fullsized":"2024-04-26T12:21:28.389100+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_clean_scrub_stamp":"2024-04-26T12:21:28.389079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:28.433507+0000","scrub_duration":0.0020847600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513621+0000","last_change":"2024-04-26T12:20:25.658563+0000","last_active":"2024-04-26T12:20:34.513621+0000","last_peered":"2024-04-26T12:20:34.513621+0000","last_clean":"2024-04-26T12:20:34.513621+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:20:34.513621+0000","last_undegraded":"2024-04-26T12:20:34.513621+0000","last_fullsized":"2024-04-26T12:20:34.513621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:15.845585+0000","last_change":"2024-04-26T12:21:15.845585+0000","last_active":"2024-04-26T12:21:15.845585+0000","last_peered":"2024-04-26T12:21:15.845585+0000","last_clean":"2024-04-26T12:21:15.845585+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:21:15.845585+0000","last_undegraded":"2024-04-26T12:21:15.845585+0000","last_fullsized":"2024-04-26T12:21:15.845585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_clean_scrub_stamp":"2024-04-26T12:21:15.845433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:43.633693+0000","scrub_duration":0.0020180860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513573+0000","last_change":"2024-04-26T12:14:38.231225+0000","last_active":"2024-04-26T12:20:34.513573+0000","last_peered":"2024-04-26T12:20:34.513573+0000","last_clean":"2024-04-26T12:20:34.513573+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:20:34.513573+0000","last_undegraded":"2024-04-26T12:20:34.513573+0000","last_fullsized":"2024-04-26T12:20:34.513573+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354702+0000","last_change":"2024-04-26T12:20:25.658595+0000","last_active":"2024-04-26T12:20:35.354702+0000","last_peered":"2024-04-26T12:20:35.354702+0000","last_clean":"2024-04-26T12:20:35.354702+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:20:35.354702+0000","last_undegraded":"2024-04-26T12:20:35.354702+0000","last_fullsized":"2024-04-26T12:20:35.354702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:40.233585+0000","last_change":"2024-04-26T12:20:40.233585+0000","last_active":"2024-04-26T12:20:40.233585+0000","last_peered":"2024-04-26T12:20:40.233585+0000","last_clean":"2024-04-26T12:20:40.233585+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:40.233585+0000","last_undegraded":"2024-04-26T12:20:40.233585+0000","last_fullsized":"2024-04-26T12:20:40.233585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_clean_scrub_stamp":"2024-04-26T12:20:40.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.531307+0000","scrub_duration":0.037253345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682902+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:29.682902+0000","last_peered":"2024-04-26T12:20:29.682902+0000","last_clean":"2024-04-26T12:20:29.682902+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:29.682902+0000","last_undegraded":"2024-04-26T12:20:29.682902+0000","last_fullsized":"2024-04-26T12:20:29.682902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683060+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:29.683060+0000","last_peered":"2024-04-26T12:20:29.683060+0000","last_clean":"2024-04-26T12:20:29.683060+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:29.683060+0000","last_undegraded":"2024-04-26T12:20:29.683060+0000","last_fullsized":"2024-04-26T12:20:29.683060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:38.217915+0000","last_change":"2024-04-26T12:20:38.217915+0000","last_active":"2024-04-26T12:20:38.217915+0000","last_peered":"2024-04-26T12:20:38.217915+0000","last_clean":"2024-04-26T12:20:38.217915+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:38.217915+0000","last_undegraded":"2024-04-26T12:20:38.217915+0000","last_fullsized":"2024-04-26T12:20:38.217915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_clean_scrub_stamp":"2024-04-26T12:20:38.217739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:53.024648+0000","scrub_duration":0.001837775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.345758+0000","last_change":"2024-04-26T12:21:02.345857+0000","last_active":"2024-04-26T12:21:02.345758+0000","last_peered":"2024-04-26T12:21:02.345758+0000","last_clean":"2024-04-26T12:21:02.345758+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:21:02.345758+0000","last_undegraded":"2024-04-26T12:21:02.345758+0000","last_fullsized":"2024-04-26T12:21:02.345758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.345738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:46.742649+0000","scrub_duration":0.0017828270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.947417+0000","last_change":"2024-04-26T12:21:27.947522+0000","last_active":"2024-04-26T12:21:27.947417+0000","last_peered":"2024-04-26T12:21:27.947417+0000","last_clean":"2024-04-26T12:21:27.947417+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:21:27.947417+0000","last_undegraded":"2024-04-26T12:21:27.947417+0000","last_fullsized":"2024-04-26T12:21:27.947417+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.947395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:02.048329+0000","scrub_duration":0.0020297980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.788962+0000","last_change":"2024-04-26T12:20:42.788962+0000","last_active":"2024-04-26T12:20:42.788962+0000","last_peered":"2024-04-26T12:20:42.788962+0000","last_clean":"2024-04-26T12:20:42.788962+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:42.788962+0000","last_undegraded":"2024-04-26T12:20:42.788962+0000","last_fullsized":"2024-04-26T12:20:42.788962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.788831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:48.051123+0000","scrub_duration":0.0018731360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:08.930400+0000","last_change":"2024-04-26T12:21:08.930526+0000","last_active":"2024-04-26T12:21:08.930400+0000","last_peered":"2024-04-26T12:21:08.930400+0000","last_clean":"2024-04-26T12:21:08.930400+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:21:08.930400+0000","last_undegraded":"2024-04-26T12:21:08.930400+0000","last_fullsized":"2024-04-26T12:21:08.930400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_clean_scrub_stamp":"2024-04-26T12:21:08.930381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:57.478621+0000","scrub_duration":0.0022001880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354504+0000","last_change":"2024-04-26T12:14:38.228931+0000","last_active":"2024-04-26T12:20:35.354504+0000","last_peered":"2024-04-26T12:20:35.354504+0000","last_clean":"2024-04-26T12:20:35.354504+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:20:35.354504+0000","last_undegraded":"2024-04-26T12:20:35.354504+0000","last_fullsized":"2024-04-26T12:20:35.354504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.798092+0000","last_change":"2024-04-26T12:21:01.798203+0000","last_active":"2024-04-26T12:21:01.798092+0000","last_peered":"2024-04-26T12:21:01.798092+0000","last_clean":"2024-04-26T12:21:01.798092+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:21:01.798092+0000","last_undegraded":"2024-04-26T12:21:01.798092+0000","last_fullsized":"2024-04-26T12:21:01.798092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.798071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:26.107733+0000","scrub_duration":0.0017992150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513689+0000","last_change":"2024-04-26T12:14:42.527290+0000","last_active":"2024-04-26T12:20:34.513689+0000","last_peered":"2024-04-26T12:20:34.513689+0000","last_clean":"2024-04-26T12:20:34.513689+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:20:34.513689+0000","last_undegraded":"2024-04-26T12:20:34.513689+0000","last_fullsized":"2024-04-26T12:20:34.513689+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.927249+0000","last_change":"2024-04-26T12:21:29.927349+0000","last_active":"2024-04-26T12:21:29.927249+0000","last_peered":"2024-04-26T12:21:29.927249+0000","last_clean":"2024-04-26T12:21:29.927249+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:21:29.927249+0000","last_undegraded":"2024-04-26T12:21:29.927249+0000","last_fullsized":"2024-04-26T12:21:29.927249+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.927228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:13.697104+0000","scrub_duration":0.001694173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:39.239308+0000","last_change":"2024-04-26T12:20:39.239308+0000","last_active":"2024-04-26T12:20:39.239308+0000","last_peered":"2024-04-26T12:20:39.239308+0000","last_clean":"2024-04-26T12:20:39.239308+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:39.239308+0000","last_undegraded":"2024-04-26T12:20:39.239308+0000","last_fullsized":"2024-04-26T12:20:39.239308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_clean_scrub_stamp":"2024-04-26T12:20:39.239159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:05.765227+0000","scrub_duration":0.001927977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.513639+0000","last_change":"2024-04-26T12:20:25.659274+0000","last_active":"2024-04-26T12:20:34.513639+0000","last_peered":"2024-04-26T12:20:34.513639+0000","last_clean":"2024-04-26T12:20:34.513639+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:20:34.513639+0000","last_undegraded":"2024-04-26T12:20:34.513639+0000","last_fullsized":"2024-04-26T12:20:34.513639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.628293+0000","last_change":"2024-04-26T12:21:20.628397+0000","last_active":"2024-04-26T12:21:20.628293+0000","last_peered":"2024-04-26T12:21:20.628293+0000","last_clean":"2024-04-26T12:21:20.628293+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:21:20.628293+0000","last_undegraded":"2024-04-26T12:21:20.628293+0000","last_fullsized":"2024-04-26T12:21:20.628293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.628273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:36.645398+0000","scrub_duration":0.001806247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.938858+0000","last_change":"2024-04-26T12:21:20.938983+0000","last_active":"2024-04-26T12:21:20.938858+0000","last_peered":"2024-04-26T12:21:20.938858+0000","last_clean":"2024-04-26T12:21:20.938858+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:21:20.938858+0000","last_undegraded":"2024-04-26T12:21:20.938858+0000","last_fullsized":"2024-04-26T12:21:20.938858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.938837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:40.130354+0000","scrub_duration":0.001772615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683612+0000","last_change":"2024-04-26T12:20:25.665299+0000","last_active":"2024-04-26T12:20:29.683612+0000","last_peered":"2024-04-26T12:20:29.683612+0000","last_clean":"2024-04-26T12:20:29.683612+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:20:29.683612+0000","last_undegraded":"2024-04-26T12:20:29.683612+0000","last_fullsized":"2024-04-26T12:20:29.683612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683168+0000","last_change":"2024-04-26T12:20:25.658303+0000","last_active":"2024-04-26T12:20:29.683168+0000","last_peered":"2024-04-26T12:20:29.683168+0000","last_clean":"2024-04-26T12:20:29.683168+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:20:29.683168+0000","last_undegraded":"2024-04-26T12:20:29.683168+0000","last_fullsized":"2024-04-26T12:20:29.683168+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.046122+0000","last_change":"2024-04-26T12:21:02.046248+0000","last_active":"2024-04-26T12:21:02.046122+0000","last_peered":"2024-04-26T12:21:02.046122+0000","last_clean":"2024-04-26T12:21:02.046122+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:21:02.046122+0000","last_undegraded":"2024-04-26T12:21:02.046122+0000","last_fullsized":"2024-04-26T12:21:02.046122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.046099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:02.071804+0000","scrub_duration":0.0017987509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":107,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.325030+0000","last_change":"2024-04-26T12:20:25.667368+0000","last_active":"2024-04-26T12:20:30.325030+0000","last_peered":"2024-04-26T12:20:30.325030+0000","last_clean":"2024-04-26T12:20:30.325030+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:20:30.325030+0000","last_undegraded":"2024-04-26T12:20:30.325030+0000","last_fullsized":"2024-04-26T12:20:30.325030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:14.537563+0000","last_change":"2024-04-26T12:21:14.537700+0000","last_active":"2024-04-26T12:21:14.537563+0000","last_peered":"2024-04-26T12:21:14.537563+0000","last_clean":"2024-04-26T12:21:14.537563+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:21:14.537563+0000","last_undegraded":"2024-04-26T12:21:14.537563+0000","last_fullsized":"2024-04-26T12:21:14.537563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_clean_scrub_stamp":"2024-04-26T12:21:14.537541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:35.164328+0000","scrub_duration":0.001714157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.061976+0000","last_change":"2024-04-26T12:20:53.062080+0000","last_active":"2024-04-26T12:20:53.061976+0000","last_peered":"2024-04-26T12:20:53.061976+0000","last_clean":"2024-04-26T12:20:53.061976+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:53.061976+0000","last_undegraded":"2024-04-26T12:20:53.061976+0000","last_fullsized":"2024-04-26T12:20:53.061976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.061955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:36.090188+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.148566+0000","last_change":"2024-04-26T12:20:45.148696+0000","last_active":"2024-04-26T12:20:45.148566+0000","last_peered":"2024-04-26T12:20:45.148566+0000","last_clean":"2024-04-26T12:20:45.148566+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:45.148566+0000","last_undegraded":"2024-04-26T12:20:45.148566+0000","last_fullsized":"2024-04-26T12:20:45.148566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.148548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.383636+0000","scrub_duration":0.0018031029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:49.111826+0000","last_change":"2024-04-26T12:20:49.111929+0000","last_active":"2024-04-26T12:20:49.111826+0000","last_peered":"2024-04-26T12:20:49.111826+0000","last_clean":"2024-04-26T12:20:49.111826+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:49.111826+0000","last_undegraded":"2024-04-26T12:20:49.111826+0000","last_fullsized":"2024-04-26T12:20:49.111826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_clean_scrub_stamp":"2024-04-26T12:20:49.111806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:18.633109+0000","scrub_duration":0.0015728319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:55.873745+0000","last_change":"2024-04-26T12:20:55.873745+0000","last_active":"2024-04-26T12:20:55.873745+0000","last_peered":"2024-04-26T12:20:55.873745+0000","last_clean":"2024-04-26T12:20:55.873745+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:55.873745+0000","last_undegraded":"2024-04-26T12:20:55.873745+0000","last_fullsized":"2024-04-26T12:20:55.873745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_clean_scrub_stamp":"2024-04-26T12:20:55.873506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:35.165043+0000","scrub_duration":0.069253721000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:23.973479+0000","last_change":"2024-04-26T12:21:23.973578+0000","last_active":"2024-04-26T12:21:23.973479+0000","last_peered":"2024-04-26T12:21:23.973479+0000","last_clean":"2024-04-26T12:21:23.973479+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:21:23.973479+0000","last_undegraded":"2024-04-26T12:21:23.973479+0000","last_fullsized":"2024-04-26T12:21:23.973479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_clean_scrub_stamp":"2024-04-26T12:21:23.973458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:16.098425+0000","scrub_duration":0.001902541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.267347+0000","last_change":"2024-04-26T12:20:37.267347+0000","last_active":"2024-04-26T12:20:37.267347+0000","last_peered":"2024-04-26T12:20:37.267347+0000","last_clean":"2024-04-26T12:20:37.267347+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:37.267347+0000","last_undegraded":"2024-04-26T12:20:37.267347+0000","last_fullsized":"2024-04-26T12:20:37.267347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.267215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:21.882383+0000","scrub_duration":0.0018490620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.009965+0000","last_change":"2024-04-26T12:21:01.010072+0000","last_active":"2024-04-26T12:21:01.009965+0000","last_peered":"2024-04-26T12:21:01.009965+0000","last_clean":"2024-04-26T12:21:01.009965+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:21:01.009965+0000","last_undegraded":"2024-04-26T12:21:01.009965+0000","last_fullsized":"2024-04-26T12:21:01.009965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.009933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:20.201451+0000","scrub_duration":0.0018985370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324790+0000","last_change":"2024-04-26T12:20:25.659920+0000","last_active":"2024-04-26T12:20:30.324790+0000","last_peered":"2024-04-26T12:20:30.324790+0000","last_clean":"2024-04-26T12:20:30.324790+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:20:30.324790+0000","last_undegraded":"2024-04-26T12:20:30.324790+0000","last_fullsized":"2024-04-26T12:20:30.324790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324513+0000","last_change":"2024-04-26T12:14:42.528286+0000","last_active":"2024-04-26T12:20:30.324513+0000","last_peered":"2024-04-26T12:20:30.324513+0000","last_clean":"2024-04-26T12:20:30.324513+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:20:30.324513+0000","last_undegraded":"2024-04-26T12:20:30.324513+0000","last_fullsized":"2024-04-26T12:20:30.324513+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324678+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:30.324678+0000","last_peered":"2024-04-26T12:20:30.324678+0000","last_clean":"2024-04-26T12:20:30.324678+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:30.324678+0000","last_undegraded":"2024-04-26T12:20:30.324678+0000","last_fullsized":"2024-04-26T12:20:30.324678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324594+0000","last_change":"2024-04-26T12:20:25.667314+0000","last_active":"2024-04-26T12:20:30.324594+0000","last_peered":"2024-04-26T12:20:30.324594+0000","last_clean":"2024-04-26T12:20:30.324594+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:20:30.324594+0000","last_undegraded":"2024-04-26T12:20:30.324594+0000","last_fullsized":"2024-04-26T12:20:30.324594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683765+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:29.683765+0000","last_peered":"2024-04-26T12:20:29.683765+0000","last_clean":"2024-04-26T12:20:29.683765+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:29.683765+0000","last_undegraded":"2024-04-26T12:20:29.683765+0000","last_fullsized":"2024-04-26T12:20:29.683765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.306612+0000","last_change":"2024-04-26T12:21:01.306715+0000","last_active":"2024-04-26T12:21:01.306612+0000","last_peered":"2024-04-26T12:21:01.306612+0000","last_clean":"2024-04-26T12:21:01.306612+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:21:01.306612+0000","last_undegraded":"2024-04-26T12:21:01.306612+0000","last_fullsized":"2024-04-26T12:21:01.306612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.306592+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:51.007517+0000","scrub_duration":0.003604196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683212+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:29.683212+0000","last_peered":"2024-04-26T12:20:29.683212+0000","last_clean":"2024-04-26T12:20:29.683212+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:29.683212+0000","last_undegraded":"2024-04-26T12:20:29.683212+0000","last_fullsized":"2024-04-26T12:20:29.683212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324898+0000","last_change":"2024-04-26T12:20:25.658960+0000","last_active":"2024-04-26T12:20:30.324898+0000","last_peered":"2024-04-26T12:20:30.324898+0000","last_clean":"2024-04-26T12:20:30.324898+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:20:30.324898+0000","last_undegraded":"2024-04-26T12:20:30.324898+0000","last_fullsized":"2024-04-26T12:20:30.324898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.921948+0000","last_change":"2024-04-26T12:21:19.922084+0000","last_active":"2024-04-26T12:21:19.921948+0000","last_peered":"2024-04-26T12:21:19.921948+0000","last_clean":"2024-04-26T12:21:19.921948+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:21:19.921948+0000","last_undegraded":"2024-04-26T12:21:19.921948+0000","last_fullsized":"2024-04-26T12:21:19.921948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.921926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:07.112057+0000","scrub_duration":0.020713793000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.113455+0000","last_change":"2024-04-26T12:20:51.113577+0000","last_active":"2024-04-26T12:20:51.113455+0000","last_peered":"2024-04-26T12:20:51.113455+0000","last_clean":"2024-04-26T12:20:51.113455+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:51.113455+0000","last_undegraded":"2024-04-26T12:20:51.113455+0000","last_fullsized":"2024-04-26T12:20:51.113455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.113432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:11.752649+0000","scrub_duration":0.0017589649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.269911+0000","last_change":"2024-04-26T12:20:59.270025+0000","last_active":"2024-04-26T12:20:59.269911+0000","last_peered":"2024-04-26T12:20:59.269911+0000","last_clean":"2024-04-26T12:20:59.269911+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:59.269911+0000","last_undegraded":"2024-04-26T12:20:59.269911+0000","last_fullsized":"2024-04-26T12:20:59.269911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.269890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:50.740249+0000","scrub_duration":0.0016247309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.241925+0000","last_change":"2024-04-26T12:20:42.241925+0000","last_active":"2024-04-26T12:20:42.241925+0000","last_peered":"2024-04-26T12:20:42.241925+0000","last_clean":"2024-04-26T12:20:42.241925+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:42.241925+0000","last_undegraded":"2024-04-26T12:20:42.241925+0000","last_fullsized":"2024-04-26T12:20:42.241925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.241764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:44.362930+0000","scrub_duration":0.0044497909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738455,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321308,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050532,"statfs":{"total":96636764160,"available":96307744768,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.39900000000000002},"min":{"1min":0.432,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.69499999999999995,"5min":0.871,"15min":0.871},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.42699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.66500000000000004,"5min":0.88400000000000001,"15min":0.92900000000000005},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:21:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.36099999999999999}]}]},{"osd":1,"up_from":74,"seq":317827579920,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:21:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Apr 26 12:21:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.53000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483144,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888696,"statfs":{"total":96636764160,"available":96142024704,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:21:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.437}]},{"osd":2,"last update":"Fri Apr 26 12:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42099999999999999,"15min":0.371},"min":{"1min":0.36699999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.65300000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.375,"5min":0.185,"15min":0.185},"max":{"1min":0.58499999999999996,"5min":0.879,"15min":0.879},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:21:36.653 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.653 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.653 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.654 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.655 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.656 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.657 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.658 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.658 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.658 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.658 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.658 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.658 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.658 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.659 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.660 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.660 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.660 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.660 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:36.660 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:21:56.661 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:21:56.963 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:21:56.966 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:21:56.971 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-04-26T12:21:56.542585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834444,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281076,"statfs":{"total":289910292480,"available":289055821824,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003426"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.355056+0000","last_change":"2024-04-26T12:14:42.869327+0000","last_active":"2024-04-26T12:20:35.355056+0000","last_peered":"2024-04-26T12:20:35.355056+0000","last_clean":"2024-04-26T12:20:35.355056+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:20:35.355056+0000","last_undegraded":"2024-04-26T12:20:35.355056+0000","last_fullsized":"2024-04-26T12:20:35.355056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.355031+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:35.355031+0000","last_peered":"2024-04-26T12:20:35.355031+0000","last_clean":"2024-04-26T12:20:35.355031+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:35.355031+0000","last_undegraded":"2024-04-26T12:20:35.355031+0000","last_fullsized":"2024-04-26T12:20:35.355031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683930+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:29.683930+0000","last_peered":"2024-04-26T12:20:29.683930+0000","last_clean":"2024-04-26T12:20:29.683930+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:29.683930+0000","last_undegraded":"2024-04-26T12:20:29.683930+0000","last_fullsized":"2024-04-26T12:20:29.683930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:57.265439+0000","last_change":"2024-04-26T12:20:57.265567+0000","last_active":"2024-04-26T12:20:57.265439+0000","last_peered":"2024-04-26T12:20:57.265439+0000","last_clean":"2024-04-26T12:20:57.265439+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:57.265439+0000","last_undegraded":"2024-04-26T12:20:57.265439+0000","last_fullsized":"2024-04-26T12:20:57.265439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_clean_scrub_stamp":"2024-04-26T12:20:57.265416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:34.758945+0000","scrub_duration":0.0019165709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:03.872257+0000","last_change":"2024-04-26T12:21:03.872380+0000","last_active":"2024-04-26T12:21:03.872257+0000","last_peered":"2024-04-26T12:21:03.872257+0000","last_clean":"2024-04-26T12:21:03.872257+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:21:03.872257+0000","last_undegraded":"2024-04-26T12:21:03.872257+0000","last_fullsized":"2024-04-26T12:21:03.872257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_clean_scrub_stamp":"2024-04-26T12:21:03.872236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.873602+0000","scrub_duration":0.021825418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:39.279812+0000","last_change":"2024-04-26T12:21:39.279942+0000","last_active":"2024-04-26T12:21:39.279812+0000","last_peered":"2024-04-26T12:21:39.279812+0000","last_clean":"2024-04-26T12:21:39.279812+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:21:39.279812+0000","last_undegraded":"2024-04-26T12:21:39.279812+0000","last_fullsized":"2024-04-26T12:21:39.279812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_clean_scrub_stamp":"2024-04-26T12:21:39.279789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:40.481707+0000","scrub_duration":0.0020338550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683497+0000","last_change":"2024-04-26T12:20:25.659391+0000","last_active":"2024-04-26T12:20:29.683497+0000","last_peered":"2024-04-26T12:20:29.683497+0000","last_clean":"2024-04-26T12:20:29.683497+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:20:29.683497+0000","last_undegraded":"2024-04-26T12:20:29.683497+0000","last_fullsized":"2024-04-26T12:20:29.683497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:53.219550+0000","last_change":"2024-04-26T12:21:53.219691+0000","last_active":"2024-04-26T12:21:53.219550+0000","last_peered":"2024-04-26T12:21:53.219550+0000","last_clean":"2024-04-26T12:21:53.219550+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:21:53.219550+0000","last_undegraded":"2024-04-26T12:21:53.219550+0000","last_fullsized":"2024-04-26T12:21:53.219550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_clean_scrub_stamp":"2024-04-26T12:21:53.219526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:11.285479+0000","scrub_duration":0.001588772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683161+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:29.683161+0000","last_peered":"2024-04-26T12:20:29.683161+0000","last_clean":"2024-04-26T12:20:29.683161+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:29.683161+0000","last_undegraded":"2024-04-26T12:20:29.683161+0000","last_fullsized":"2024-04-26T12:20:29.683161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.790532+0000","last_change":"2024-04-26T12:20:41.790658+0000","last_active":"2024-04-26T12:20:41.790532+0000","last_peered":"2024-04-26T12:20:41.790532+0000","last_clean":"2024-04-26T12:20:41.790532+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:41.790532+0000","last_undegraded":"2024-04-26T12:20:41.790532+0000","last_fullsized":"2024-04-26T12:20:41.790532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.790495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:52.175594+0000","scrub_duration":0.0019401209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.379089+0000","last_change":"2024-04-26T12:21:29.379199+0000","last_active":"2024-04-26T12:21:29.379089+0000","last_peered":"2024-04-26T12:21:29.379089+0000","last_clean":"2024-04-26T12:21:29.379089+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:21:29.379089+0000","last_undegraded":"2024-04-26T12:21:29.379089+0000","last_fullsized":"2024-04-26T12:21:29.379089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.379071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.183371+0000","scrub_duration":0.020900218000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324686+0000","last_change":"2024-04-26T12:20:25.659878+0000","last_active":"2024-04-26T12:20:30.324686+0000","last_peered":"2024-04-26T12:20:30.324686+0000","last_clean":"2024-04-26T12:20:30.324686+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:20:30.324686+0000","last_undegraded":"2024-04-26T12:20:30.324686+0000","last_fullsized":"2024-04-26T12:20:30.324686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324442+0000","last_change":"2024-04-26T12:14:42.869623+0000","last_active":"2024-04-26T12:20:30.324442+0000","last_peered":"2024-04-26T12:20:30.324442+0000","last_clean":"2024-04-26T12:20:30.324442+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:20:30.324442+0000","last_undegraded":"2024-04-26T12:20:30.324442+0000","last_fullsized":"2024-04-26T12:20:30.324442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:32.386134+0000","last_change":"2024-04-26T12:21:32.386234+0000","last_active":"2024-04-26T12:21:32.386134+0000","last_peered":"2024-04-26T12:21:32.386134+0000","last_clean":"2024-04-26T12:21:32.386134+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:21:32.386134+0000","last_undegraded":"2024-04-26T12:21:32.386134+0000","last_fullsized":"2024-04-26T12:21:32.386134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_clean_scrub_stamp":"2024-04-26T12:21:32.386115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:35.046547+0000","scrub_duration":0.0017283579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:04.377717+0000","last_change":"2024-04-26T12:21:04.377824+0000","last_active":"2024-04-26T12:21:04.377717+0000","last_peered":"2024-04-26T12:21:04.377717+0000","last_clean":"2024-04-26T12:21:04.377717+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:21:04.377717+0000","last_undegraded":"2024-04-26T12:21:04.377717+0000","last_fullsized":"2024-04-26T12:21:04.377717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_clean_scrub_stamp":"2024-04-26T12:21:04.377697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.199940+0000","scrub_duration":0.0019611149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.219944+0000","last_change":"2024-04-26T12:20:41.220047+0000","last_active":"2024-04-26T12:20:41.219944+0000","last_peered":"2024-04-26T12:20:41.219944+0000","last_clean":"2024-04-26T12:20:41.219944+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:41.219944+0000","last_undegraded":"2024-04-26T12:20:41.219944+0000","last_fullsized":"2024-04-26T12:20:41.219944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.219912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:44.836560+0000","scrub_duration":0.001961516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514064+0000","last_change":"2024-04-26T12:14:42.872169+0000","last_active":"2024-04-26T12:20:34.514064+0000","last_peered":"2024-04-26T12:20:34.514064+0000","last_clean":"2024-04-26T12:20:34.514064+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:34.514064+0000","last_undegraded":"2024-04-26T12:20:34.514064+0000","last_fullsized":"2024-04-26T12:20:34.514064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:52.790151+0000","last_change":"2024-04-26T12:20:52.790151+0000","last_active":"2024-04-26T12:20:52.790151+0000","last_peered":"2024-04-26T12:20:52.790151+0000","last_clean":"2024-04-26T12:20:52.790151+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:52.790151+0000","last_undegraded":"2024-04-26T12:20:52.790151+0000","last_fullsized":"2024-04-26T12:20:52.790151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_clean_scrub_stamp":"2024-04-26T12:20:52.790025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:37.405193+0000","scrub_duration":0.0021779400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514029+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:34.514029+0000","last_peered":"2024-04-26T12:20:34.514029+0000","last_clean":"2024-04-26T12:20:34.514029+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:34.514029+0000","last_undegraded":"2024-04-26T12:20:34.514029+0000","last_fullsized":"2024-04-26T12:20:34.514029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683555+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:29.683555+0000","last_peered":"2024-04-26T12:20:29.683555+0000","last_clean":"2024-04-26T12:20:29.683555+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:29.683555+0000","last_undegraded":"2024-04-26T12:20:29.683555+0000","last_fullsized":"2024-04-26T12:20:29.683555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:17.676174+0000","last_change":"2024-04-26T12:21:17.676291+0000","last_active":"2024-04-26T12:21:17.676174+0000","last_peered":"2024-04-26T12:21:17.676174+0000","last_clean":"2024-04-26T12:21:17.676174+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:21:17.676174+0000","last_undegraded":"2024-04-26T12:21:17.676174+0000","last_fullsized":"2024-04-26T12:21:17.676174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_clean_scrub_stamp":"2024-04-26T12:21:17.676137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:03.477865+0000","scrub_duration":0.022895645999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":104,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354932+0000","last_change":"2024-04-26T12:20:25.664597+0000","last_active":"2024-04-26T12:20:35.354932+0000","last_peered":"2024-04-26T12:20:35.354932+0000","last_clean":"2024-04-26T12:20:35.354932+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:20:35.354932+0000","last_undegraded":"2024-04-26T12:20:35.354932+0000","last_fullsized":"2024-04-26T12:20:35.354932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514081+0000","last_change":"2024-04-26T12:20:25.658023+0000","last_active":"2024-04-26T12:20:34.514081+0000","last_peered":"2024-04-26T12:20:34.514081+0000","last_clean":"2024-04-26T12:20:34.514081+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:20:34.514081+0000","last_undegraded":"2024-04-26T12:20:34.514081+0000","last_fullsized":"2024-04-26T12:20:34.514081+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354916+0000","last_change":"2024-04-26T12:14:42.863540+0000","last_active":"2024-04-26T12:20:35.354916+0000","last_peered":"2024-04-26T12:20:35.354916+0000","last_clean":"2024-04-26T12:20:35.354916+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:20:35.354916+0000","last_undegraded":"2024-04-26T12:20:35.354916+0000","last_fullsized":"2024-04-26T12:20:35.354916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.813170+0000","last_change":"2024-04-26T12:21:27.813304+0000","last_active":"2024-04-26T12:21:27.813170+0000","last_peered":"2024-04-26T12:21:27.813170+0000","last_clean":"2024-04-26T12:21:27.813170+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:21:27.813170+0000","last_undegraded":"2024-04-26T12:21:27.813170+0000","last_fullsized":"2024-04-26T12:21:27.813170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.813147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:16.361388+0000","scrub_duration":0.023876636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514018+0000","last_change":"2024-04-26T12:20:25.658995+0000","last_active":"2024-04-26T12:20:34.514018+0000","last_peered":"2024-04-26T12:20:34.514018+0000","last_clean":"2024-04-26T12:20:34.514018+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:20:34.514018+0000","last_undegraded":"2024-04-26T12:20:34.514018+0000","last_fullsized":"2024-04-26T12:20:34.514018+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683839+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:29.683839+0000","last_peered":"2024-04-26T12:20:29.683839+0000","last_clean":"2024-04-26T12:20:29.683839+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:29.683839+0000","last_undegraded":"2024-04-26T12:20:29.683839+0000","last_fullsized":"2024-04-26T12:20:29.683839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.808505+0000","last_change":"2024-04-26T12:20:59.808505+0000","last_active":"2024-04-26T12:20:59.808505+0000","last_peered":"2024-04-26T12:20:59.808505+0000","last_clean":"2024-04-26T12:20:59.808505+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:59.808505+0000","last_undegraded":"2024-04-26T12:20:59.808505+0000","last_fullsized":"2024-04-26T12:20:59.808505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.808367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.929534+0000","scrub_duration":0.002171816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514007+0000","last_change":"2024-04-26T12:14:42.865902+0000","last_active":"2024-04-26T12:20:34.514007+0000","last_peered":"2024-04-26T12:20:34.514007+0000","last_clean":"2024-04-26T12:20:34.514007+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:20:34.514007+0000","last_undegraded":"2024-04-26T12:20:34.514007+0000","last_fullsized":"2024-04-26T12:20:34.514007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:13.806551+0000","last_change":"2024-04-26T12:21:13.806657+0000","last_active":"2024-04-26T12:21:13.806551+0000","last_peered":"2024-04-26T12:21:13.806551+0000","last_clean":"2024-04-26T12:21:13.806551+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:21:13.806551+0000","last_undegraded":"2024-04-26T12:21:13.806551+0000","last_fullsized":"2024-04-26T12:21:13.806551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_clean_scrub_stamp":"2024-04-26T12:21:13.806530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:56.319084+0000","scrub_duration":0.0017893570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514021+0000","last_change":"2024-04-26T12:14:42.867658+0000","last_active":"2024-04-26T12:20:34.514021+0000","last_peered":"2024-04-26T12:20:34.514021+0000","last_clean":"2024-04-26T12:20:34.514021+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:20:34.514021+0000","last_undegraded":"2024-04-26T12:20:34.514021+0000","last_fullsized":"2024-04-26T12:20:34.514021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682826+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:29.682826+0000","last_peered":"2024-04-26T12:20:29.682826+0000","last_clean":"2024-04-26T12:20:29.682826+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:29.682826+0000","last_undegraded":"2024-04-26T12:20:29.682826+0000","last_fullsized":"2024-04-26T12:20:29.682826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:05.803095+0000","last_change":"2024-04-26T12:21:05.803095+0000","last_active":"2024-04-26T12:21:05.803095+0000","last_peered":"2024-04-26T12:21:05.803095+0000","last_clean":"2024-04-26T12:21:05.803095+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:21:05.803095+0000","last_undegraded":"2024-04-26T12:21:05.803095+0000","last_fullsized":"2024-04-26T12:21:05.803095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_clean_scrub_stamp":"2024-04-26T12:21:05.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:22.222434+0000","scrub_duration":0.0018232630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683200+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:29.683200+0000","last_peered":"2024-04-26T12:20:29.683200+0000","last_clean":"2024-04-26T12:20:29.683200+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:29.683200+0000","last_undegraded":"2024-04-26T12:20:29.683200+0000","last_fullsized":"2024-04-26T12:20:29.683200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.778498+0000","last_change":"2024-04-26T12:20:53.778599+0000","last_active":"2024-04-26T12:20:53.778498+0000","last_peered":"2024-04-26T12:20:53.778498+0000","last_clean":"2024-04-26T12:20:53.778498+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:53.778498+0000","last_undegraded":"2024-04-26T12:20:53.778498+0000","last_fullsized":"2024-04-26T12:20:53.778498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.778477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:08.585386+0000","scrub_duration":0.021558476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:47.162047+0000","last_change":"2024-04-26T12:20:47.162047+0000","last_active":"2024-04-26T12:20:47.162047+0000","last_peered":"2024-04-26T12:20:47.162047+0000","last_clean":"2024-04-26T12:20:47.162047+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:47.162047+0000","last_undegraded":"2024-04-26T12:20:47.162047+0000","last_fullsized":"2024-04-26T12:20:47.162047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_clean_scrub_stamp":"2024-04-26T12:20:47.161913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:03.581394+0000","scrub_duration":0.00169505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.982650+0000","last_change":"2024-04-26T12:21:19.982751+0000","last_active":"2024-04-26T12:21:19.982650+0000","last_peered":"2024-04-26T12:21:19.982650+0000","last_clean":"2024-04-26T12:21:19.982650+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:21:19.982650+0000","last_undegraded":"2024-04-26T12:21:19.982650+0000","last_fullsized":"2024-04-26T12:21:19.982650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.982628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:02.501013+0000","scrub_duration":0.001761875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354853+0000","last_change":"2024-04-26T12:20:25.658840+0000","last_active":"2024-04-26T12:20:35.354853+0000","last_peered":"2024-04-26T12:20:35.354853+0000","last_clean":"2024-04-26T12:20:35.354853+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:20:35.354853+0000","last_undegraded":"2024-04-26T12:20:35.354853+0000","last_fullsized":"2024-04-26T12:20:35.354853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":102,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683228+0000","last_change":"2024-04-26T12:20:25.658812+0000","last_active":"2024-04-26T12:20:29.683228+0000","last_peered":"2024-04-26T12:20:29.683228+0000","last_clean":"2024-04-26T12:20:29.683228+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:20:29.683228+0000","last_undegraded":"2024-04-26T12:20:29.683228+0000","last_fullsized":"2024-04-26T12:20:29.683228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682823+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:29.682823+0000","last_peered":"2024-04-26T12:20:29.682823+0000","last_clean":"2024-04-26T12:20:29.682823+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:29.682823+0000","last_undegraded":"2024-04-26T12:20:29.682823+0000","last_fullsized":"2024-04-26T12:20:29.682823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683688+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:29.683688+0000","last_peered":"2024-04-26T12:20:29.683688+0000","last_clean":"2024-04-26T12:20:29.683688+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:29.683688+0000","last_undegraded":"2024-04-26T12:20:29.683688+0000","last_fullsized":"2024-04-26T12:20:29.683688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:21.922061+0000","last_change":"2024-04-26T12:21:21.922165+0000","last_active":"2024-04-26T12:21:21.922061+0000","last_peered":"2024-04-26T12:21:21.922061+0000","last_clean":"2024-04-26T12:21:21.922061+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:21:21.922061+0000","last_undegraded":"2024-04-26T12:21:21.922061+0000","last_fullsized":"2024-04-26T12:21:21.922061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_clean_scrub_stamp":"2024-04-26T12:21:21.922041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:21.947746+0000","scrub_duration":0.0019268759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":107,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354516+0000","last_change":"2024-04-26T12:20:25.659353+0000","last_active":"2024-04-26T12:20:35.354516+0000","last_peered":"2024-04-26T12:20:35.354516+0000","last_clean":"2024-04-26T12:20:35.354516+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:20:35.354516+0000","last_undegraded":"2024-04-26T12:20:35.354516+0000","last_fullsized":"2024-04-26T12:20:35.354516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.354758+0000","last_change":"2024-04-26T12:14:42.868410+0000","last_active":"2024-04-26T12:20:35.354758+0000","last_peered":"2024-04-26T12:20:35.354758+0000","last_clean":"2024-04-26T12:20:35.354758+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:20:35.354758+0000","last_undegraded":"2024-04-26T12:20:35.354758+0000","last_fullsized":"2024-04-26T12:20:35.354758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683701+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:29.683701+0000","last_peered":"2024-04-26T12:20:29.683701+0000","last_clean":"2024-04-26T12:20:29.683701+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:29.683701+0000","last_undegraded":"2024-04-26T12:20:29.683701+0000","last_fullsized":"2024-04-26T12:20:29.683701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.239958+0000","last_change":"2024-04-26T12:20:51.240064+0000","last_active":"2024-04-26T12:20:51.239958+0000","last_peered":"2024-04-26T12:20:51.239958+0000","last_clean":"2024-04-26T12:20:51.239958+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:51.239958+0000","last_undegraded":"2024-04-26T12:20:51.239958+0000","last_fullsized":"2024-04-26T12:20:51.239958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.239936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:38.455956+0000","scrub_duration":0.0018569750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.195154+0000","last_change":"2024-04-26T12:20:45.195262+0000","last_active":"2024-04-26T12:20:45.195154+0000","last_peered":"2024-04-26T12:20:45.195154+0000","last_clean":"2024-04-26T12:20:45.195154+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:45.195154+0000","last_undegraded":"2024-04-26T12:20:45.195154+0000","last_fullsized":"2024-04-26T12:20:45.195154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.195132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:03.642870+0000","scrub_duration":0.001821214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:44.228054+0000","last_change":"2024-04-26T12:20:44.228054+0000","last_active":"2024-04-26T12:20:44.228054+0000","last_peered":"2024-04-26T12:20:44.228054+0000","last_clean":"2024-04-26T12:20:44.228054+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:44.228054+0000","last_undegraded":"2024-04-26T12:20:44.228054+0000","last_fullsized":"2024-04-26T12:20:44.228054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_clean_scrub_stamp":"2024-04-26T12:20:44.227884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:28.326058+0000","scrub_duration":0.037590602000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.054265+0000","last_change":"2024-04-26T12:21:45.054404+0000","last_active":"2024-04-26T12:21:45.054265+0000","last_peered":"2024-04-26T12:21:45.054265+0000","last_clean":"2024-04-26T12:21:45.054265+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:21:45.054265+0000","last_undegraded":"2024-04-26T12:21:45.054265+0000","last_fullsized":"2024-04-26T12:21:45.054265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.054243+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:10.556480+0000","scrub_duration":0.003031026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683745+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:29.683745+0000","last_peered":"2024-04-26T12:20:29.683745+0000","last_clean":"2024-04-26T12:20:29.683745+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:29.683745+0000","last_undegraded":"2024-04-26T12:20:29.683745+0000","last_fullsized":"2024-04-26T12:20:29.683745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683120+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:29.683120+0000","last_peered":"2024-04-26T12:20:29.683120+0000","last_clean":"2024-04-26T12:20:29.683120+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:29.683120+0000","last_undegraded":"2024-04-26T12:20:29.683120+0000","last_fullsized":"2024-04-26T12:20:29.683120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.185645+0000","last_change":"2024-04-26T12:20:37.185781+0000","last_active":"2024-04-26T12:20:37.185645+0000","last_peered":"2024-04-26T12:20:37.185645+0000","last_clean":"2024-04-26T12:20:37.185645+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:37.185645+0000","last_undegraded":"2024-04-26T12:20:37.185645+0000","last_fullsized":"2024-04-26T12:20:37.185645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.185622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:13.134344+0000","scrub_duration":0.0022406729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.736459+0000","last_change":"2024-04-26T12:21:42.736574+0000","last_active":"2024-04-26T12:21:42.736459+0000","last_peered":"2024-04-26T12:21:42.736459+0000","last_clean":"2024-04-26T12:21:42.736459+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:42.736459+0000","last_undegraded":"2024-04-26T12:21:42.736459+0000","last_fullsized":"2024-04-26T12:21:42.736459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.736439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:28.494771+0000","scrub_duration":0.001884997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683887+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:29.683887+0000","last_peered":"2024-04-26T12:20:29.683887+0000","last_clean":"2024-04-26T12:20:29.683887+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:29.683887+0000","last_undegraded":"2024-04-26T12:20:29.683887+0000","last_fullsized":"2024-04-26T12:20:29.683887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.724802+0000","last_change":"2024-04-26T12:21:36.724938+0000","last_active":"2024-04-26T12:21:36.724802+0000","last_peered":"2024-04-26T12:21:36.724802+0000","last_clean":"2024-04-26T12:21:36.724802+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:21:36.724802+0000","last_undegraded":"2024-04-26T12:21:36.724802+0000","last_fullsized":"2024-04-26T12:21:36.724802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.724781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:21.696248+0000","scrub_duration":0.001563694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.243964+0000","last_change":"2024-04-26T12:20:46.243964+0000","last_active":"2024-04-26T12:20:46.243964+0000","last_peered":"2024-04-26T12:20:46.243964+0000","last_clean":"2024-04-26T12:20:46.243964+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:46.243964+0000","last_undegraded":"2024-04-26T12:20:46.243964+0000","last_fullsized":"2024-04-26T12:20:46.243964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_clean_scrub_stamp":"2024-04-26T12:20:46.243795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.992132+0000","scrub_duration":0.071910356999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682732+0000","last_change":"2024-04-26T12:20:25.658065+0000","last_active":"2024-04-26T12:20:29.682732+0000","last_peered":"2024-04-26T12:20:29.682732+0000","last_clean":"2024-04-26T12:20:29.682732+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:20:29.682732+0000","last_undegraded":"2024-04-26T12:20:29.682732+0000","last_fullsized":"2024-04-26T12:20:29.682732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683211+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:29.683211+0000","last_peered":"2024-04-26T12:20:29.683211+0000","last_clean":"2024-04-26T12:20:29.683211+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:29.683211+0000","last_undegraded":"2024-04-26T12:20:29.683211+0000","last_fullsized":"2024-04-26T12:20:29.683211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:50.996724+0000","last_change":"2024-04-26T12:21:50.996837+0000","last_active":"2024-04-26T12:21:50.996724+0000","last_peered":"2024-04-26T12:21:50.996724+0000","last_clean":"2024-04-26T12:21:50.996724+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:21:50.996724+0000","last_undegraded":"2024-04-26T12:21:50.996724+0000","last_fullsized":"2024-04-26T12:21:50.996724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_clean_scrub_stamp":"2024-04-26T12:21:50.996704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:37.430031+0000","scrub_duration":0.001618841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683812+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:29.683812+0000","last_peered":"2024-04-26T12:20:29.683812+0000","last_clean":"2024-04-26T12:20:29.683812+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:29.683812+0000","last_undegraded":"2024-04-26T12:20:29.683812+0000","last_fullsized":"2024-04-26T12:20:29.683812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:28.389100+0000","last_change":"2024-04-26T12:21:28.389208+0000","last_active":"2024-04-26T12:21:28.389100+0000","last_peered":"2024-04-26T12:21:28.389100+0000","last_clean":"2024-04-26T12:21:28.389100+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:21:28.389100+0000","last_undegraded":"2024-04-26T12:21:28.389100+0000","last_fullsized":"2024-04-26T12:21:28.389100+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_clean_scrub_stamp":"2024-04-26T12:21:28.389079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:28.433507+0000","scrub_duration":0.0020847600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.985544+0000","last_change":"2024-04-26T12:21:42.985671+0000","last_active":"2024-04-26T12:21:42.985544+0000","last_peered":"2024-04-26T12:21:42.985544+0000","last_clean":"2024-04-26T12:21:42.985544+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:21:42.985544+0000","last_undegraded":"2024-04-26T12:21:42.985544+0000","last_fullsized":"2024-04-26T12:21:42.985544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.985508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:34.923523+0000","scrub_duration":0.0018060699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:15.845585+0000","last_change":"2024-04-26T12:21:15.845585+0000","last_active":"2024-04-26T12:21:15.845585+0000","last_peered":"2024-04-26T12:21:15.845585+0000","last_clean":"2024-04-26T12:21:15.845585+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:21:15.845585+0000","last_undegraded":"2024-04-26T12:21:15.845585+0000","last_fullsized":"2024-04-26T12:21:15.845585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_clean_scrub_stamp":"2024-04-26T12:21:15.845433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:43.633693+0000","scrub_duration":0.0020180860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:31.960816+0000","last_change":"2024-04-26T12:21:31.960941+0000","last_active":"2024-04-26T12:21:31.960816+0000","last_peered":"2024-04-26T12:21:31.960816+0000","last_clean":"2024-04-26T12:21:31.960816+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:21:31.960816+0000","last_undegraded":"2024-04-26T12:21:31.960816+0000","last_fullsized":"2024-04-26T12:21:31.960816+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:31.960781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:56.778609+0000","scrub_duration":0.001606894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.804328+0000","last_change":"2024-04-26T12:21:44.804441+0000","last_active":"2024-04-26T12:21:44.804328+0000","last_peered":"2024-04-26T12:21:44.804328+0000","last_clean":"2024-04-26T12:21:44.804328+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:44.804328+0000","last_undegraded":"2024-04-26T12:21:44.804328+0000","last_fullsized":"2024-04-26T12:21:44.804328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.804307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:13.373258+0000","scrub_duration":0.001678099,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:40.233585+0000","last_change":"2024-04-26T12:20:40.233585+0000","last_active":"2024-04-26T12:20:40.233585+0000","last_peered":"2024-04-26T12:20:40.233585+0000","last_clean":"2024-04-26T12:20:40.233585+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:40.233585+0000","last_undegraded":"2024-04-26T12:20:40.233585+0000","last_fullsized":"2024-04-26T12:20:40.233585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_clean_scrub_stamp":"2024-04-26T12:20:40.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.531307+0000","scrub_duration":0.037253345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682902+0000","last_change":"2024-04-26T12:20:25.660191+0000","last_active":"2024-04-26T12:20:29.682902+0000","last_peered":"2024-04-26T12:20:29.682902+0000","last_clean":"2024-04-26T12:20:29.682902+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:20:29.682902+0000","last_undegraded":"2024-04-26T12:20:29.682902+0000","last_fullsized":"2024-04-26T12:20:29.682902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683060+0000","last_change":"2024-04-26T12:20:25.664961+0000","last_active":"2024-04-26T12:20:29.683060+0000","last_peered":"2024-04-26T12:20:29.683060+0000","last_clean":"2024-04-26T12:20:29.683060+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:20:29.683060+0000","last_undegraded":"2024-04-26T12:20:29.683060+0000","last_fullsized":"2024-04-26T12:20:29.683060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:38.217915+0000","last_change":"2024-04-26T12:20:38.217915+0000","last_active":"2024-04-26T12:20:38.217915+0000","last_peered":"2024-04-26T12:20:38.217915+0000","last_clean":"2024-04-26T12:20:38.217915+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:38.217915+0000","last_undegraded":"2024-04-26T12:20:38.217915+0000","last_fullsized":"2024-04-26T12:20:38.217915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_clean_scrub_stamp":"2024-04-26T12:20:38.217739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:53.024648+0000","scrub_duration":0.001837775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.345758+0000","last_change":"2024-04-26T12:21:02.345857+0000","last_active":"2024-04-26T12:21:02.345758+0000","last_peered":"2024-04-26T12:21:02.345758+0000","last_clean":"2024-04-26T12:21:02.345758+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:21:02.345758+0000","last_undegraded":"2024-04-26T12:21:02.345758+0000","last_fullsized":"2024-04-26T12:21:02.345758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.345738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:46.742649+0000","scrub_duration":0.0017828270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.947417+0000","last_change":"2024-04-26T12:21:27.947522+0000","last_active":"2024-04-26T12:21:27.947417+0000","last_peered":"2024-04-26T12:21:27.947417+0000","last_clean":"2024-04-26T12:21:27.947417+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:21:27.947417+0000","last_undegraded":"2024-04-26T12:21:27.947417+0000","last_fullsized":"2024-04-26T12:21:27.947417+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.947395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:02.048329+0000","scrub_duration":0.0020297980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.788962+0000","last_change":"2024-04-26T12:20:42.788962+0000","last_active":"2024-04-26T12:20:42.788962+0000","last_peered":"2024-04-26T12:20:42.788962+0000","last_clean":"2024-04-26T12:20:42.788962+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:42.788962+0000","last_undegraded":"2024-04-26T12:20:42.788962+0000","last_fullsized":"2024-04-26T12:20:42.788962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.788831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:48.051123+0000","scrub_duration":0.0018731360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:08.930400+0000","last_change":"2024-04-26T12:21:08.930526+0000","last_active":"2024-04-26T12:21:08.930400+0000","last_peered":"2024-04-26T12:21:08.930400+0000","last_clean":"2024-04-26T12:21:08.930400+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:21:08.930400+0000","last_undegraded":"2024-04-26T12:21:08.930400+0000","last_fullsized":"2024-04-26T12:21:08.930400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_clean_scrub_stamp":"2024-04-26T12:21:08.930381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:57.478621+0000","scrub_duration":0.0022001880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:40.742763+0000","last_change":"2024-04-26T12:21:40.742884+0000","last_active":"2024-04-26T12:21:40.742763+0000","last_peered":"2024-04-26T12:21:40.742763+0000","last_clean":"2024-04-26T12:21:40.742763+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:21:40.742763+0000","last_undegraded":"2024-04-26T12:21:40.742763+0000","last_fullsized":"2024-04-26T12:21:40.742763+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_clean_scrub_stamp":"2024-04-26T12:21:40.742726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:25.864637+0000","scrub_duration":0.001946726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.798092+0000","last_change":"2024-04-26T12:21:01.798203+0000","last_active":"2024-04-26T12:21:01.798092+0000","last_peered":"2024-04-26T12:21:01.798092+0000","last_clean":"2024-04-26T12:21:01.798092+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:21:01.798092+0000","last_undegraded":"2024-04-26T12:21:01.798092+0000","last_fullsized":"2024-04-26T12:21:01.798092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.798071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:26.107733+0000","scrub_duration":0.0017992150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.980665+0000","last_change":"2024-04-26T12:21:49.980795+0000","last_active":"2024-04-26T12:21:49.980665+0000","last_peered":"2024-04-26T12:21:49.980665+0000","last_clean":"2024-04-26T12:21:49.980665+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:21:49.980665+0000","last_undegraded":"2024-04-26T12:21:49.980665+0000","last_fullsized":"2024-04-26T12:21:49.980665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.980626+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:48.325677+0000","scrub_duration":0.0034005770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.927249+0000","last_change":"2024-04-26T12:21:29.927349+0000","last_active":"2024-04-26T12:21:29.927249+0000","last_peered":"2024-04-26T12:21:29.927249+0000","last_clean":"2024-04-26T12:21:29.927249+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:21:29.927249+0000","last_undegraded":"2024-04-26T12:21:29.927249+0000","last_fullsized":"2024-04-26T12:21:29.927249+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.927228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:13.697104+0000","scrub_duration":0.001694173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:39.239308+0000","last_change":"2024-04-26T12:20:39.239308+0000","last_active":"2024-04-26T12:20:39.239308+0000","last_peered":"2024-04-26T12:20:39.239308+0000","last_clean":"2024-04-26T12:20:39.239308+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:39.239308+0000","last_undegraded":"2024-04-26T12:20:39.239308+0000","last_fullsized":"2024-04-26T12:20:39.239308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_clean_scrub_stamp":"2024-04-26T12:20:39.239159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:05.765227+0000","scrub_duration":0.001927977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.019184+0000","last_change":"2024-04-26T12:21:49.019288+0000","last_active":"2024-04-26T12:21:49.019184+0000","last_peered":"2024-04-26T12:21:49.019184+0000","last_clean":"2024-04-26T12:21:49.019184+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:21:49.019184+0000","last_undegraded":"2024-04-26T12:21:49.019184+0000","last_fullsized":"2024-04-26T12:21:49.019184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.019162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:32.716076+0000","scrub_duration":0.0032590919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.628293+0000","last_change":"2024-04-26T12:21:20.628397+0000","last_active":"2024-04-26T12:21:20.628293+0000","last_peered":"2024-04-26T12:21:20.628293+0000","last_clean":"2024-04-26T12:21:20.628293+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:21:20.628293+0000","last_undegraded":"2024-04-26T12:21:20.628293+0000","last_fullsized":"2024-04-26T12:21:20.628293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.628273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:36.645398+0000","scrub_duration":0.001806247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.938858+0000","last_change":"2024-04-26T12:21:20.938983+0000","last_active":"2024-04-26T12:21:20.938858+0000","last_peered":"2024-04-26T12:21:20.938858+0000","last_clean":"2024-04-26T12:21:20.938858+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:21:20.938858+0000","last_undegraded":"2024-04-26T12:21:20.938858+0000","last_fullsized":"2024-04-26T12:21:20.938858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.938837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:40.130354+0000","scrub_duration":0.001772615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.298753+0000","last_change":"2024-04-26T12:21:36.298863+0000","last_active":"2024-04-26T12:21:36.298753+0000","last_peered":"2024-04-26T12:21:36.298753+0000","last_clean":"2024-04-26T12:21:36.298753+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:21:36.298753+0000","last_undegraded":"2024-04-26T12:21:36.298753+0000","last_fullsized":"2024-04-26T12:21:36.298753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.298732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:04.694417+0000","scrub_duration":0.0016097329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.286787+0000","last_change":"2024-04-26T12:21:44.286929+0000","last_active":"2024-04-26T12:21:44.286787+0000","last_peered":"2024-04-26T12:21:44.286787+0000","last_clean":"2024-04-26T12:21:44.286787+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:21:44.286787+0000","last_undegraded":"2024-04-26T12:21:44.286787+0000","last_fullsized":"2024-04-26T12:21:44.286787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.286751+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:41.216976+0000","scrub_duration":0.0052196680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.046248+0000","last_change":"2024-04-26T12:21:02.046248+0000","last_active":"2024-04-26T12:21:02.046248+0000","last_peered":"2024-04-26T12:21:02.046248+0000","last_clean":"2024-04-26T12:21:02.046248+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:21:02.046248+0000","last_undegraded":"2024-04-26T12:21:02.046248+0000","last_fullsized":"2024-04-26T12:21:02.046248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.046099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:02.071804+0000","scrub_duration":0.0017987509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:43.763205+0000","last_change":"2024-04-26T12:21:43.763333+0000","last_active":"2024-04-26T12:21:43.763205+0000","last_peered":"2024-04-26T12:21:43.763205+0000","last_clean":"2024-04-26T12:21:43.763205+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:21:43.763205+0000","last_undegraded":"2024-04-26T12:21:43.763205+0000","last_fullsized":"2024-04-26T12:21:43.763205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_clean_scrub_stamp":"2024-04-26T12:21:43.763181+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:50.040543+0000","scrub_duration":0.0039017230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:14.537563+0000","last_change":"2024-04-26T12:21:14.537700+0000","last_active":"2024-04-26T12:21:14.537563+0000","last_peered":"2024-04-26T12:21:14.537563+0000","last_clean":"2024-04-26T12:21:14.537563+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:21:14.537563+0000","last_undegraded":"2024-04-26T12:21:14.537563+0000","last_fullsized":"2024-04-26T12:21:14.537563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_clean_scrub_stamp":"2024-04-26T12:21:14.537541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:35.164328+0000","scrub_duration":0.001714157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.062080+0000","last_change":"2024-04-26T12:20:53.062080+0000","last_active":"2024-04-26T12:20:53.062080+0000","last_peered":"2024-04-26T12:20:53.062080+0000","last_clean":"2024-04-26T12:20:53.062080+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:53.062080+0000","last_undegraded":"2024-04-26T12:20:53.062080+0000","last_fullsized":"2024-04-26T12:20:53.062080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.061955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:36.090188+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.148566+0000","last_change":"2024-04-26T12:20:45.148696+0000","last_active":"2024-04-26T12:20:45.148566+0000","last_peered":"2024-04-26T12:20:45.148566+0000","last_clean":"2024-04-26T12:20:45.148566+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:45.148566+0000","last_undegraded":"2024-04-26T12:20:45.148566+0000","last_fullsized":"2024-04-26T12:20:45.148566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.148548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.383636+0000","scrub_duration":0.0018031029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:49.111929+0000","last_change":"2024-04-26T12:20:49.111929+0000","last_active":"2024-04-26T12:20:49.111929+0000","last_peered":"2024-04-26T12:20:49.111929+0000","last_clean":"2024-04-26T12:20:49.111929+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:49.111929+0000","last_undegraded":"2024-04-26T12:20:49.111929+0000","last_fullsized":"2024-04-26T12:20:49.111929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_clean_scrub_stamp":"2024-04-26T12:20:49.111806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:18.633109+0000","scrub_duration":0.0015728319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:55.873745+0000","last_change":"2024-04-26T12:20:55.873745+0000","last_active":"2024-04-26T12:20:55.873745+0000","last_peered":"2024-04-26T12:20:55.873745+0000","last_clean":"2024-04-26T12:20:55.873745+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:55.873745+0000","last_undegraded":"2024-04-26T12:20:55.873745+0000","last_fullsized":"2024-04-26T12:20:55.873745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_clean_scrub_stamp":"2024-04-26T12:20:55.873506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:35.165043+0000","scrub_duration":0.069253721000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:23.973479+0000","last_change":"2024-04-26T12:21:23.973578+0000","last_active":"2024-04-26T12:21:23.973479+0000","last_peered":"2024-04-26T12:21:23.973479+0000","last_clean":"2024-04-26T12:21:23.973479+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:21:23.973479+0000","last_undegraded":"2024-04-26T12:21:23.973479+0000","last_fullsized":"2024-04-26T12:21:23.973479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_clean_scrub_stamp":"2024-04-26T12:21:23.973458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:16.098425+0000","scrub_duration":0.001902541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.267347+0000","last_change":"2024-04-26T12:20:37.267347+0000","last_active":"2024-04-26T12:20:37.267347+0000","last_peered":"2024-04-26T12:20:37.267347+0000","last_clean":"2024-04-26T12:20:37.267347+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:37.267347+0000","last_undegraded":"2024-04-26T12:20:37.267347+0000","last_fullsized":"2024-04-26T12:20:37.267347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.267215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:21.882383+0000","scrub_duration":0.0018490620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.009965+0000","last_change":"2024-04-26T12:21:01.010072+0000","last_active":"2024-04-26T12:21:01.009965+0000","last_peered":"2024-04-26T12:21:01.009965+0000","last_clean":"2024-04-26T12:21:01.009965+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:21:01.009965+0000","last_undegraded":"2024-04-26T12:21:01.009965+0000","last_fullsized":"2024-04-26T12:21:01.009965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.009933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:20.201451+0000","scrub_duration":0.0018985370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:35.734593+0000","last_change":"2024-04-26T12:21:35.734685+0000","last_active":"2024-04-26T12:21:35.734593+0000","last_peered":"2024-04-26T12:21:35.734593+0000","last_clean":"2024-04-26T12:21:35.734593+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:21:35.734593+0000","last_undegraded":"2024-04-26T12:21:35.734593+0000","last_fullsized":"2024-04-26T12:21:35.734593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_clean_scrub_stamp":"2024-04-26T12:21:35.734571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:20.757460+0000","scrub_duration":0.0018119519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:41.754548+0000","last_change":"2024-04-26T12:21:41.754671+0000","last_active":"2024-04-26T12:21:41.754548+0000","last_peered":"2024-04-26T12:21:41.754548+0000","last_clean":"2024-04-26T12:21:41.754548+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:21:41.754548+0000","last_undegraded":"2024-04-26T12:21:41.754548+0000","last_fullsized":"2024-04-26T12:21:41.754548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_clean_scrub_stamp":"2024-04-26T12:21:41.754524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:50.022019+0000","scrub_duration":0.0017813410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:30.324678+0000","last_change":"2024-04-26T12:14:42.863512+0000","last_active":"2024-04-26T12:20:30.324678+0000","last_peered":"2024-04-26T12:20:30.324678+0000","last_clean":"2024-04-26T12:20:30.324678+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:20:30.324678+0000","last_undegraded":"2024-04-26T12:20:30.324678+0000","last_fullsized":"2024-04-26T12:20:30.324678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.781463+0000","last_change":"2024-04-26T12:21:45.781607+0000","last_active":"2024-04-26T12:21:45.781463+0000","last_peered":"2024-04-26T12:21:45.781463+0000","last_clean":"2024-04-26T12:21:45.781463+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:21:45.781463+0000","last_undegraded":"2024-04-26T12:21:45.781463+0000","last_fullsized":"2024-04-26T12:21:45.781463+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.781441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:10.599270+0000","scrub_duration":0.0018896659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683765+0000","last_change":"2024-04-26T12:20:25.666015+0000","last_active":"2024-04-26T12:20:29.683765+0000","last_peered":"2024-04-26T12:20:29.683765+0000","last_clean":"2024-04-26T12:20:29.683765+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:20:29.683765+0000","last_undegraded":"2024-04-26T12:20:29.683765+0000","last_fullsized":"2024-04-26T12:20:29.683765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.306612+0000","last_change":"2024-04-26T12:21:01.306715+0000","last_active":"2024-04-26T12:21:01.306612+0000","last_peered":"2024-04-26T12:21:01.306612+0000","last_clean":"2024-04-26T12:21:01.306612+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:21:01.306612+0000","last_undegraded":"2024-04-26T12:21:01.306612+0000","last_fullsized":"2024-04-26T12:21:01.306612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.306592+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:51.007517+0000","scrub_duration":0.003604196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683212+0000","last_change":"2024-04-26T12:20:25.659485+0000","last_active":"2024-04-26T12:20:29.683212+0000","last_peered":"2024-04-26T12:20:29.683212+0000","last_clean":"2024-04-26T12:20:29.683212+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:20:29.683212+0000","last_undegraded":"2024-04-26T12:20:29.683212+0000","last_fullsized":"2024-04-26T12:20:29.683212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:34.783656+0000","last_change":"2024-04-26T12:21:34.783753+0000","last_active":"2024-04-26T12:21:34.783656+0000","last_peered":"2024-04-26T12:21:34.783656+0000","last_clean":"2024-04-26T12:21:34.783656+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:21:34.783656+0000","last_undegraded":"2024-04-26T12:21:34.783656+0000","last_fullsized":"2024-04-26T12:21:34.783656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_clean_scrub_stamp":"2024-04-26T12:21:34.783633+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:31.032530+0000","scrub_duration":0.0033859229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.921948+0000","last_change":"2024-04-26T12:21:19.922084+0000","last_active":"2024-04-26T12:21:19.921948+0000","last_peered":"2024-04-26T12:21:19.921948+0000","last_clean":"2024-04-26T12:21:19.921948+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:21:19.921948+0000","last_undegraded":"2024-04-26T12:21:19.921948+0000","last_fullsized":"2024-04-26T12:21:19.921948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.921926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:07.112057+0000","scrub_duration":0.020713793000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.113455+0000","last_change":"2024-04-26T12:20:51.113577+0000","last_active":"2024-04-26T12:20:51.113455+0000","last_peered":"2024-04-26T12:20:51.113455+0000","last_clean":"2024-04-26T12:20:51.113455+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:51.113455+0000","last_undegraded":"2024-04-26T12:20:51.113455+0000","last_fullsized":"2024-04-26T12:20:51.113455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.113432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:11.752649+0000","scrub_duration":0.0017589649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.269911+0000","last_change":"2024-04-26T12:20:59.270025+0000","last_active":"2024-04-26T12:20:59.269911+0000","last_peered":"2024-04-26T12:20:59.269911+0000","last_clean":"2024-04-26T12:20:59.269911+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:59.269911+0000","last_undegraded":"2024-04-26T12:20:59.269911+0000","last_fullsized":"2024-04-26T12:20:59.269911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.269890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:50.740249+0000","scrub_duration":0.0016247309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.241925+0000","last_change":"2024-04-26T12:20:42.241925+0000","last_active":"2024-04-26T12:20:42.241925+0000","last_peered":"2024-04-26T12:20:42.241925+0000","last_clean":"2024-04-26T12:20:42.241925+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:42.241925+0000","last_undegraded":"2024-04-26T12:20:42.241925+0000","last_fullsized":"2024-04-26T12:20:42.241925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.241764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:44.362930+0000","scrub_duration":0.0044497909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738459,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321308,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050532,"statfs":{"total":96636764160,"available":96307744768,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:20:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.39900000000000002},"min":{"1min":0.432,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.69499999999999995,"5min":0.871,"15min":0.871},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.42699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.66500000000000004,"5min":0.88400000000000001,"15min":0.92900000000000005},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:21:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.55900000000000005}]}]},{"osd":1,"up_from":74,"seq":317827579924,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:21:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:21:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.45100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483144,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888696,"statfs":{"total":96636764160,"available":96142024704,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:21:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:20:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42099999999999999,"15min":0.371},"min":{"1min":0.36699999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.65300000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.442},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.375,"5min":0.185,"15min":0.185},"max":{"1min":0.58499999999999996,"5min":0.879,"15min":0.879},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:21:56.979 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.980 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.980 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.980 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.980 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.981 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.981 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.981 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.982 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.982 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.983 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.983 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.983 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.983 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.984 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.984 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.984 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.984 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.985 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.985 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.985 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.986 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.986 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.986 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.986 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.987 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.987 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.987 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.988 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.988 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.988 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.988 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.989 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.989 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.990 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.991 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.991 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:21:56.991 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:22:16.993 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:22:17.290 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:22:17.291 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:22:17.300 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-04-26T12:22:16.548312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834444,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281076,"statfs":{"total":289910292480,"available":289055821824,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003188"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.028568+0000","last_change":"2024-04-26T12:22:07.028769+0000","last_active":"2024-04-26T12:22:07.028568+0000","last_peered":"2024-04-26T12:22:07.028568+0000","last_clean":"2024-04-26T12:22:07.028568+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:22:07.028568+0000","last_undegraded":"2024-04-26T12:22:07.028568+0000","last_fullsized":"2024-04-26T12:22:07.028568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.028533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.028533+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.028533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:03.368476+0000","scrub_duration":0.093946051000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:35.355031+0000","last_change":"2024-04-26T12:14:42.868214+0000","last_active":"2024-04-26T12:20:35.355031+0000","last_peered":"2024-04-26T12:20:35.355031+0000","last_clean":"2024-04-26T12:20:35.355031+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:20:35.355031+0000","last_undegraded":"2024-04-26T12:20:35.355031+0000","last_fullsized":"2024-04-26T12:20:35.355031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683930+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:29.683930+0000","last_peered":"2024-04-26T12:20:29.683930+0000","last_clean":"2024-04-26T12:20:29.683930+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:29.683930+0000","last_undegraded":"2024-04-26T12:20:29.683930+0000","last_fullsized":"2024-04-26T12:20:29.683930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:57.265439+0000","last_change":"2024-04-26T12:20:57.265567+0000","last_active":"2024-04-26T12:20:57.265439+0000","last_peered":"2024-04-26T12:20:57.265439+0000","last_clean":"2024-04-26T12:20:57.265439+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:57.265439+0000","last_undegraded":"2024-04-26T12:20:57.265439+0000","last_fullsized":"2024-04-26T12:20:57.265439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_clean_scrub_stamp":"2024-04-26T12:20:57.265416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:34.758945+0000","scrub_duration":0.0019165709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:03.872257+0000","last_change":"2024-04-26T12:21:03.872380+0000","last_active":"2024-04-26T12:21:03.872257+0000","last_peered":"2024-04-26T12:21:03.872257+0000","last_clean":"2024-04-26T12:21:03.872257+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:21:03.872257+0000","last_undegraded":"2024-04-26T12:21:03.872257+0000","last_fullsized":"2024-04-26T12:21:03.872257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_clean_scrub_stamp":"2024-04-26T12:21:03.872236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.873602+0000","scrub_duration":0.021825418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:39.279812+0000","last_change":"2024-04-26T12:21:39.279942+0000","last_active":"2024-04-26T12:21:39.279812+0000","last_peered":"2024-04-26T12:21:39.279812+0000","last_clean":"2024-04-26T12:21:39.279812+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:21:39.279812+0000","last_undegraded":"2024-04-26T12:21:39.279812+0000","last_fullsized":"2024-04-26T12:21:39.279812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_clean_scrub_stamp":"2024-04-26T12:21:39.279789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:40.481707+0000","scrub_duration":0.0020338550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.205087+0000","last_change":"2024-04-26T12:21:56.205187+0000","last_active":"2024-04-26T12:21:56.205087+0000","last_peered":"2024-04-26T12:21:56.205087+0000","last_clean":"2024-04-26T12:21:56.205087+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:21:56.205087+0000","last_undegraded":"2024-04-26T12:21:56.205087+0000","last_fullsized":"2024-04-26T12:21:56.205087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.205068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.205068+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.205068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:58.755685+0000","scrub_duration":0.020726391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:53.219550+0000","last_change":"2024-04-26T12:21:53.219691+0000","last_active":"2024-04-26T12:21:53.219550+0000","last_peered":"2024-04-26T12:21:53.219550+0000","last_clean":"2024-04-26T12:21:53.219550+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:21:53.219550+0000","last_undegraded":"2024-04-26T12:21:53.219550+0000","last_fullsized":"2024-04-26T12:21:53.219550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_clean_scrub_stamp":"2024-04-26T12:21:53.219526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:11.285479+0000","scrub_duration":0.001588772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514084+0000","last_change":"2024-04-26T12:14:42.867830+0000","last_active":"2024-04-26T12:20:34.514084+0000","last_peered":"2024-04-26T12:20:34.514084+0000","last_clean":"2024-04-26T12:20:34.514084+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:20:34.514084+0000","last_undegraded":"2024-04-26T12:20:34.514084+0000","last_fullsized":"2024-04-26T12:20:34.514084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.790658+0000","last_change":"2024-04-26T12:20:41.790658+0000","last_active":"2024-04-26T12:20:41.790658+0000","last_peered":"2024-04-26T12:20:41.790658+0000","last_clean":"2024-04-26T12:20:41.790658+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:41.790658+0000","last_undegraded":"2024-04-26T12:20:41.790658+0000","last_fullsized":"2024-04-26T12:20:41.790658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.790495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:52.175594+0000","scrub_duration":0.0019401209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.379089+0000","last_change":"2024-04-26T12:21:29.379199+0000","last_active":"2024-04-26T12:21:29.379089+0000","last_peered":"2024-04-26T12:21:29.379089+0000","last_clean":"2024-04-26T12:21:29.379089+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:21:29.379089+0000","last_undegraded":"2024-04-26T12:21:29.379089+0000","last_fullsized":"2024-04-26T12:21:29.379089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.379071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.183371+0000","scrub_duration":0.020900218000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:10.988729+0000","last_change":"2024-04-26T12:22:10.988834+0000","last_active":"2024-04-26T12:22:10.988729+0000","last_peered":"2024-04-26T12:22:10.988729+0000","last_clean":"2024-04-26T12:22:10.988729+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:22:10.988729+0000","last_undegraded":"2024-04-26T12:22:10.988729+0000","last_fullsized":"2024-04-26T12:22:10.988729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:10.988705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:10.988705+0000","last_clean_scrub_stamp":"2024-04-26T12:22:10.988705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:53.867995+0000","scrub_duration":0.0018000850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:02.969436+0000","last_change":"2024-04-26T12:22:02.969548+0000","last_active":"2024-04-26T12:22:02.969436+0000","last_peered":"2024-04-26T12:22:02.969436+0000","last_clean":"2024-04-26T12:22:02.969436+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:22:02.969436+0000","last_undegraded":"2024-04-26T12:22:02.969436+0000","last_fullsized":"2024-04-26T12:22:02.969436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:02.969417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:02.969417+0000","last_clean_scrub_stamp":"2024-04-26T12:22:02.969417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:21.464136+0000","scrub_duration":0.0209908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:32.386134+0000","last_change":"2024-04-26T12:21:32.386234+0000","last_active":"2024-04-26T12:21:32.386134+0000","last_peered":"2024-04-26T12:21:32.386134+0000","last_clean":"2024-04-26T12:21:32.386134+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:21:32.386134+0000","last_undegraded":"2024-04-26T12:21:32.386134+0000","last_fullsized":"2024-04-26T12:21:32.386134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_clean_scrub_stamp":"2024-04-26T12:21:32.386115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:35.046547+0000","scrub_duration":0.0017283579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:04.377717+0000","last_change":"2024-04-26T12:21:04.377824+0000","last_active":"2024-04-26T12:21:04.377717+0000","last_peered":"2024-04-26T12:21:04.377717+0000","last_clean":"2024-04-26T12:21:04.377717+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:21:04.377717+0000","last_undegraded":"2024-04-26T12:21:04.377717+0000","last_fullsized":"2024-04-26T12:21:04.377717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_clean_scrub_stamp":"2024-04-26T12:21:04.377697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.199940+0000","scrub_duration":0.0019611149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.219944+0000","last_change":"2024-04-26T12:20:41.220047+0000","last_active":"2024-04-26T12:20:41.219944+0000","last_peered":"2024-04-26T12:20:41.219944+0000","last_clean":"2024-04-26T12:20:41.219944+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:41.219944+0000","last_undegraded":"2024-04-26T12:20:41.219944+0000","last_fullsized":"2024-04-26T12:20:41.219944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.219912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:44.836560+0000","scrub_duration":0.001961516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:10.912751+0000","last_change":"2024-04-26T12:22:10.912859+0000","last_active":"2024-04-26T12:22:10.912751+0000","last_peered":"2024-04-26T12:22:10.912751+0000","last_clean":"2024-04-26T12:22:10.912751+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:22:10.912751+0000","last_undegraded":"2024-04-26T12:22:10.912751+0000","last_fullsized":"2024-04-26T12:22:10.912751+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:10.912731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:10.912731+0000","last_clean_scrub_stamp":"2024-04-26T12:22:10.912731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:00.102782+0000","scrub_duration":0.10408954600000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:52.790151+0000","last_change":"2024-04-26T12:20:52.790151+0000","last_active":"2024-04-26T12:20:52.790151+0000","last_peered":"2024-04-26T12:20:52.790151+0000","last_clean":"2024-04-26T12:20:52.790151+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:52.790151+0000","last_undegraded":"2024-04-26T12:20:52.790151+0000","last_fullsized":"2024-04-26T12:20:52.790151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_clean_scrub_stamp":"2024-04-26T12:20:52.790025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:37.405193+0000","scrub_duration":0.0021779400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.514029+0000","last_change":"2024-04-26T12:14:42.867301+0000","last_active":"2024-04-26T12:20:34.514029+0000","last_peered":"2024-04-26T12:20:34.514029+0000","last_clean":"2024-04-26T12:20:34.514029+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:20:34.514029+0000","last_undegraded":"2024-04-26T12:20:34.514029+0000","last_fullsized":"2024-04-26T12:20:34.514029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683555+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:29.683555+0000","last_peered":"2024-04-26T12:20:29.683555+0000","last_clean":"2024-04-26T12:20:29.683555+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:29.683555+0000","last_undegraded":"2024-04-26T12:20:29.683555+0000","last_fullsized":"2024-04-26T12:20:29.683555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:17.676174+0000","last_change":"2024-04-26T12:21:17.676291+0000","last_active":"2024-04-26T12:21:17.676174+0000","last_peered":"2024-04-26T12:21:17.676174+0000","last_clean":"2024-04-26T12:21:17.676174+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:21:17.676174+0000","last_undegraded":"2024-04-26T12:21:17.676174+0000","last_fullsized":"2024-04-26T12:21:17.676174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_clean_scrub_stamp":"2024-04-26T12:21:17.676137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:03.477865+0000","scrub_duration":0.022895645999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.955655+0000","last_change":"2024-04-26T12:22:07.955819+0000","last_active":"2024-04-26T12:22:07.955655+0000","last_peered":"2024-04-26T12:22:07.955655+0000","last_clean":"2024-04-26T12:22:07.955655+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:22:07.955655+0000","last_undegraded":"2024-04-26T12:22:07.955655+0000","last_fullsized":"2024-04-26T12:22:07.955655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.955633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.955633+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.955633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:04.665590+0000","scrub_duration":0.0021521180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:08.819222+0000","last_change":"2024-04-26T12:22:08.819318+0000","last_active":"2024-04-26T12:22:08.819222+0000","last_peered":"2024-04-26T12:22:08.819222+0000","last_clean":"2024-04-26T12:22:08.819222+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:22:08.819222+0000","last_undegraded":"2024-04-26T12:22:08.819222+0000","last_fullsized":"2024-04-26T12:22:08.819222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:08.819198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:08.819198+0000","last_clean_scrub_stamp":"2024-04-26T12:22:08.819198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:24.196455+0000","scrub_duration":0.001676493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.930881+0000","last_change":"2024-04-26T12:21:56.930998+0000","last_active":"2024-04-26T12:21:56.930881+0000","last_peered":"2024-04-26T12:21:56.930881+0000","last_clean":"2024-04-26T12:21:56.930881+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:21:56.930881+0000","last_undegraded":"2024-04-26T12:21:56.930881+0000","last_fullsized":"2024-04-26T12:21:56.930881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.930860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.930860+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.930860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:22.433096+0000","scrub_duration":0.0016250489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.813170+0000","last_change":"2024-04-26T12:21:27.813304+0000","last_active":"2024-04-26T12:21:27.813170+0000","last_peered":"2024-04-26T12:21:27.813170+0000","last_clean":"2024-04-26T12:21:27.813170+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:21:27.813170+0000","last_undegraded":"2024-04-26T12:21:27.813170+0000","last_fullsized":"2024-04-26T12:21:27.813170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.813147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:16.361388+0000","scrub_duration":0.023876636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.835199+0000","last_change":"2024-04-26T12:22:07.835305+0000","last_active":"2024-04-26T12:22:07.835199+0000","last_peered":"2024-04-26T12:22:07.835199+0000","last_clean":"2024-04-26T12:22:07.835199+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:22:07.835199+0000","last_undegraded":"2024-04-26T12:22:07.835199+0000","last_fullsized":"2024-04-26T12:22:07.835199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.835177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.835177+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.835177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:03.745069+0000","scrub_duration":0.002013754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683839+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:29.683839+0000","last_peered":"2024-04-26T12:20:29.683839+0000","last_clean":"2024-04-26T12:20:29.683839+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:29.683839+0000","last_undegraded":"2024-04-26T12:20:29.683839+0000","last_fullsized":"2024-04-26T12:20:29.683839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.808505+0000","last_change":"2024-04-26T12:20:59.808505+0000","last_active":"2024-04-26T12:20:59.808505+0000","last_peered":"2024-04-26T12:20:59.808505+0000","last_clean":"2024-04-26T12:20:59.808505+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:59.808505+0000","last_undegraded":"2024-04-26T12:20:59.808505+0000","last_fullsized":"2024-04-26T12:20:59.808505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.808367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.929534+0000","scrub_duration":0.002171816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:59.966971+0000","last_change":"2024-04-26T12:21:59.967089+0000","last_active":"2024-04-26T12:21:59.966971+0000","last_peered":"2024-04-26T12:21:59.966971+0000","last_clean":"2024-04-26T12:21:59.966971+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:21:59.966971+0000","last_undegraded":"2024-04-26T12:21:59.966971+0000","last_fullsized":"2024-04-26T12:21:59.966971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:59.966927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:59.966927+0000","last_clean_scrub_stamp":"2024-04-26T12:21:59.966927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:42.846217+0000","scrub_duration":0.038480333999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:13.806551+0000","last_change":"2024-04-26T12:21:13.806657+0000","last_active":"2024-04-26T12:21:13.806551+0000","last_peered":"2024-04-26T12:21:13.806551+0000","last_clean":"2024-04-26T12:21:13.806551+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:21:13.806551+0000","last_undegraded":"2024-04-26T12:21:13.806551+0000","last_fullsized":"2024-04-26T12:21:13.806551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_clean_scrub_stamp":"2024-04-26T12:21:13.806530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:56.319084+0000","scrub_duration":0.0017893570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.003640+0000","last_change":"2024-04-26T12:21:56.003766+0000","last_active":"2024-04-26T12:21:56.003640+0000","last_peered":"2024-04-26T12:21:56.003640+0000","last_clean":"2024-04-26T12:21:56.003640+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:21:56.003640+0000","last_undegraded":"2024-04-26T12:21:56.003640+0000","last_fullsized":"2024-04-26T12:21:56.003640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.003619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.003619+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.003619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:58.633567+0000","scrub_duration":0.001618424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682826+0000","last_change":"2024-04-26T12:20:25.658918+0000","last_active":"2024-04-26T12:20:29.682826+0000","last_peered":"2024-04-26T12:20:29.682826+0000","last_clean":"2024-04-26T12:20:29.682826+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:20:29.682826+0000","last_undegraded":"2024-04-26T12:20:29.682826+0000","last_fullsized":"2024-04-26T12:20:29.682826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:05.803095+0000","last_change":"2024-04-26T12:21:05.803095+0000","last_active":"2024-04-26T12:21:05.803095+0000","last_peered":"2024-04-26T12:21:05.803095+0000","last_clean":"2024-04-26T12:21:05.803095+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:21:05.803095+0000","last_undegraded":"2024-04-26T12:21:05.803095+0000","last_fullsized":"2024-04-26T12:21:05.803095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_clean_scrub_stamp":"2024-04-26T12:21:05.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:22.222434+0000","scrub_duration":0.0018232630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683200+0000","last_change":"2024-04-26T12:20:25.665895+0000","last_active":"2024-04-26T12:20:29.683200+0000","last_peered":"2024-04-26T12:20:29.683200+0000","last_clean":"2024-04-26T12:20:29.683200+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:20:29.683200+0000","last_undegraded":"2024-04-26T12:20:29.683200+0000","last_fullsized":"2024-04-26T12:20:29.683200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.778599+0000","last_change":"2024-04-26T12:20:53.778599+0000","last_active":"2024-04-26T12:20:53.778599+0000","last_peered":"2024-04-26T12:20:53.778599+0000","last_clean":"2024-04-26T12:20:53.778599+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:53.778599+0000","last_undegraded":"2024-04-26T12:20:53.778599+0000","last_fullsized":"2024-04-26T12:20:53.778599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.778477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:08.585386+0000","scrub_duration":0.021558476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:47.162047+0000","last_change":"2024-04-26T12:20:47.162047+0000","last_active":"2024-04-26T12:20:47.162047+0000","last_peered":"2024-04-26T12:20:47.162047+0000","last_clean":"2024-04-26T12:20:47.162047+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:47.162047+0000","last_undegraded":"2024-04-26T12:20:47.162047+0000","last_fullsized":"2024-04-26T12:20:47.162047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_clean_scrub_stamp":"2024-04-26T12:20:47.161913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:03.581394+0000","scrub_duration":0.00169505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.982751+0000","last_change":"2024-04-26T12:21:19.982751+0000","last_active":"2024-04-26T12:21:19.982751+0000","last_peered":"2024-04-26T12:21:19.982751+0000","last_clean":"2024-04-26T12:21:19.982751+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:21:19.982751+0000","last_undegraded":"2024-04-26T12:21:19.982751+0000","last_fullsized":"2024-04-26T12:21:19.982751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.982628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:02.501013+0000","scrub_duration":0.001761875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:53.911367+0000","last_change":"2024-04-26T12:21:53.911462+0000","last_active":"2024-04-26T12:21:53.911367+0000","last_peered":"2024-04-26T12:21:53.911367+0000","last_clean":"2024-04-26T12:21:53.911367+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:21:53.911367+0000","last_undegraded":"2024-04-26T12:21:53.911367+0000","last_fullsized":"2024-04-26T12:21:53.911367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:53.911345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:53.911345+0000","last_clean_scrub_stamp":"2024-04-26T12:21:53.911345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:45.849360+0000","scrub_duration":0.0017856079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:52.053906+0000","last_change":"2024-04-26T12:21:52.053906+0000","last_active":"2024-04-26T12:21:52.053906+0000","last_peered":"2024-04-26T12:21:52.053906+0000","last_clean":"2024-04-26T12:21:52.053906+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:21:52.053906+0000","last_undegraded":"2024-04-26T12:21:52.053906+0000","last_fullsized":"2024-04-26T12:21:52.053906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:52.053743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:52.053743+0000","last_clean_scrub_stamp":"2024-04-26T12:21:52.053743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:11.521087+0000","scrub_duration":0.037699734999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.682823+0000","last_change":"2024-04-26T12:20:25.658316+0000","last_active":"2024-04-26T12:20:29.682823+0000","last_peered":"2024-04-26T12:20:29.682823+0000","last_clean":"2024-04-26T12:20:29.682823+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:20:29.682823+0000","last_undegraded":"2024-04-26T12:20:29.682823+0000","last_fullsized":"2024-04-26T12:20:29.682823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683688+0000","last_change":"2024-04-26T12:20:25.660612+0000","last_active":"2024-04-26T12:20:29.683688+0000","last_peered":"2024-04-26T12:20:29.683688+0000","last_clean":"2024-04-26T12:20:29.683688+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:20:29.683688+0000","last_undegraded":"2024-04-26T12:20:29.683688+0000","last_fullsized":"2024-04-26T12:20:29.683688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:21.922061+0000","last_change":"2024-04-26T12:21:21.922165+0000","last_active":"2024-04-26T12:21:21.922061+0000","last_peered":"2024-04-26T12:21:21.922061+0000","last_clean":"2024-04-26T12:21:21.922061+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:21:21.922061+0000","last_undegraded":"2024-04-26T12:21:21.922061+0000","last_fullsized":"2024-04-26T12:21:21.922061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_clean_scrub_stamp":"2024-04-26T12:21:21.922041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:21.947746+0000","scrub_duration":0.0019268759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"79'3","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:52.869663+0000","last_change":"2024-04-26T12:21:52.869775+0000","last_active":"2024-04-26T12:21:52.869663+0000","last_peered":"2024-04-26T12:21:52.869663+0000","last_clean":"2024-04-26T12:21:52.869663+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:21:52.869663+0000","last_undegraded":"2024-04-26T12:21:52.869663+0000","last_fullsized":"2024-04-26T12:21:52.869663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:52.869641+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:52.869641+0000","last_clean_scrub_stamp":"2024-04-26T12:21:52.869641+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:59.685725+0000","scrub_duration":0.0034181530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:01.967451+0000","last_change":"2024-04-26T12:22:01.967556+0000","last_active":"2024-04-26T12:22:01.967451+0000","last_peered":"2024-04-26T12:22:01.967451+0000","last_clean":"2024-04-26T12:22:01.967451+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:22:01.967451+0000","last_undegraded":"2024-04-26T12:22:01.967451+0000","last_fullsized":"2024-04-26T12:22:01.967451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:01.967417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:01.967417+0000","last_clean_scrub_stamp":"2024-04-26T12:22:01.967417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:56.957901+0000","scrub_duration":0.001588613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683701+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:29.683701+0000","last_peered":"2024-04-26T12:20:29.683701+0000","last_clean":"2024-04-26T12:20:29.683701+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:29.683701+0000","last_undegraded":"2024-04-26T12:20:29.683701+0000","last_fullsized":"2024-04-26T12:20:29.683701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.239958+0000","last_change":"2024-04-26T12:20:51.240064+0000","last_active":"2024-04-26T12:20:51.239958+0000","last_peered":"2024-04-26T12:20:51.239958+0000","last_clean":"2024-04-26T12:20:51.239958+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:51.239958+0000","last_undegraded":"2024-04-26T12:20:51.239958+0000","last_fullsized":"2024-04-26T12:20:51.239958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.239936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:38.455956+0000","scrub_duration":0.0018569750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.195154+0000","last_change":"2024-04-26T12:20:45.195262+0000","last_active":"2024-04-26T12:20:45.195154+0000","last_peered":"2024-04-26T12:20:45.195154+0000","last_clean":"2024-04-26T12:20:45.195154+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:45.195154+0000","last_undegraded":"2024-04-26T12:20:45.195154+0000","last_fullsized":"2024-04-26T12:20:45.195154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.195132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:03.642870+0000","scrub_duration":0.001821214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:44.228054+0000","last_change":"2024-04-26T12:20:44.228054+0000","last_active":"2024-04-26T12:20:44.228054+0000","last_peered":"2024-04-26T12:20:44.228054+0000","last_clean":"2024-04-26T12:20:44.228054+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:44.228054+0000","last_undegraded":"2024-04-26T12:20:44.228054+0000","last_fullsized":"2024-04-26T12:20:44.228054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_clean_scrub_stamp":"2024-04-26T12:20:44.227884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:28.326058+0000","scrub_duration":0.037590602000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.054265+0000","last_change":"2024-04-26T12:21:45.054404+0000","last_active":"2024-04-26T12:21:45.054265+0000","last_peered":"2024-04-26T12:21:45.054265+0000","last_clean":"2024-04-26T12:21:45.054265+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:21:45.054265+0000","last_undegraded":"2024-04-26T12:21:45.054265+0000","last_fullsized":"2024-04-26T12:21:45.054265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.054243+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:10.556480+0000","scrub_duration":0.003031026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683745+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:29.683745+0000","last_peered":"2024-04-26T12:20:29.683745+0000","last_clean":"2024-04-26T12:20:29.683745+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:29.683745+0000","last_undegraded":"2024-04-26T12:20:29.683745+0000","last_fullsized":"2024-04-26T12:20:29.683745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683120+0000","last_change":"2024-04-26T12:20:25.659500+0000","last_active":"2024-04-26T12:20:29.683120+0000","last_peered":"2024-04-26T12:20:29.683120+0000","last_clean":"2024-04-26T12:20:29.683120+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:20:29.683120+0000","last_undegraded":"2024-04-26T12:20:29.683120+0000","last_fullsized":"2024-04-26T12:20:29.683120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.185645+0000","last_change":"2024-04-26T12:20:37.185781+0000","last_active":"2024-04-26T12:20:37.185645+0000","last_peered":"2024-04-26T12:20:37.185645+0000","last_clean":"2024-04-26T12:20:37.185645+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:37.185645+0000","last_undegraded":"2024-04-26T12:20:37.185645+0000","last_fullsized":"2024-04-26T12:20:37.185645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.185622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:13.134344+0000","scrub_duration":0.0022406729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.736459+0000","last_change":"2024-04-26T12:21:42.736574+0000","last_active":"2024-04-26T12:21:42.736459+0000","last_peered":"2024-04-26T12:21:42.736459+0000","last_clean":"2024-04-26T12:21:42.736459+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:42.736459+0000","last_undegraded":"2024-04-26T12:21:42.736459+0000","last_fullsized":"2024-04-26T12:21:42.736459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.736439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:28.494771+0000","scrub_duration":0.001884997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683887+0000","last_change":"2024-04-26T12:20:25.662038+0000","last_active":"2024-04-26T12:20:29.683887+0000","last_peered":"2024-04-26T12:20:29.683887+0000","last_clean":"2024-04-26T12:20:29.683887+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:20:29.683887+0000","last_undegraded":"2024-04-26T12:20:29.683887+0000","last_fullsized":"2024-04-26T12:20:29.683887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.724802+0000","last_change":"2024-04-26T12:21:36.724938+0000","last_active":"2024-04-26T12:21:36.724802+0000","last_peered":"2024-04-26T12:21:36.724802+0000","last_clean":"2024-04-26T12:21:36.724802+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:21:36.724802+0000","last_undegraded":"2024-04-26T12:21:36.724802+0000","last_fullsized":"2024-04-26T12:21:36.724802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.724781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:21.696248+0000","scrub_duration":0.001563694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.243964+0000","last_change":"2024-04-26T12:20:46.243964+0000","last_active":"2024-04-26T12:20:46.243964+0000","last_peered":"2024-04-26T12:20:46.243964+0000","last_clean":"2024-04-26T12:20:46.243964+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:46.243964+0000","last_undegraded":"2024-04-26T12:20:46.243964+0000","last_fullsized":"2024-04-26T12:20:46.243964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_clean_scrub_stamp":"2024-04-26T12:20:46.243795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.992132+0000","scrub_duration":0.071910356999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":245,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.182672+0000","last_change":"2024-04-26T12:22:07.182801+0000","last_active":"2024-04-26T12:22:07.182672+0000","last_peered":"2024-04-26T12:22:07.182672+0000","last_clean":"2024-04-26T12:22:07.182672+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:22:07.182672+0000","last_undegraded":"2024-04-26T12:22:07.182672+0000","last_fullsized":"2024-04-26T12:22:07.182672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-26T12:22:07.182648+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-26T12:22:07.182648+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.182648+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:45.009503+0000","scrub_duration":0.0079940380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683211+0000","last_change":"2024-04-26T12:20:25.658261+0000","last_active":"2024-04-26T12:20:29.683211+0000","last_peered":"2024-04-26T12:20:29.683211+0000","last_clean":"2024-04-26T12:20:29.683211+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:20:29.683211+0000","last_undegraded":"2024-04-26T12:20:29.683211+0000","last_fullsized":"2024-04-26T12:20:29.683211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:37.212784+0000","last_clean_scrub_stamp":"2024-04-26T12:14:37.212784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:50.996724+0000","last_change":"2024-04-26T12:21:50.996837+0000","last_active":"2024-04-26T12:21:50.996724+0000","last_peered":"2024-04-26T12:21:50.996724+0000","last_clean":"2024-04-26T12:21:50.996724+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:21:50.996724+0000","last_undegraded":"2024-04-26T12:21:50.996724+0000","last_fullsized":"2024-04-26T12:21:50.996724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_clean_scrub_stamp":"2024-04-26T12:21:50.996704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:37.430031+0000","scrub_duration":0.001618841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683812+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:29.683812+0000","last_peered":"2024-04-26T12:20:29.683812+0000","last_clean":"2024-04-26T12:20:29.683812+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:29.683812+0000","last_undegraded":"2024-04-26T12:20:29.683812+0000","last_fullsized":"2024-04-26T12:20:29.683812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:28.389100+0000","last_change":"2024-04-26T12:21:28.389208+0000","last_active":"2024-04-26T12:21:28.389100+0000","last_peered":"2024-04-26T12:21:28.389100+0000","last_clean":"2024-04-26T12:21:28.389100+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:21:28.389100+0000","last_undegraded":"2024-04-26T12:21:28.389100+0000","last_fullsized":"2024-04-26T12:21:28.389100+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_clean_scrub_stamp":"2024-04-26T12:21:28.389079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:28.433507+0000","scrub_duration":0.0020847600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.985544+0000","last_change":"2024-04-26T12:21:42.985671+0000","last_active":"2024-04-26T12:21:42.985544+0000","last_peered":"2024-04-26T12:21:42.985544+0000","last_clean":"2024-04-26T12:21:42.985544+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:21:42.985544+0000","last_undegraded":"2024-04-26T12:21:42.985544+0000","last_fullsized":"2024-04-26T12:21:42.985544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.985508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:34.923523+0000","scrub_duration":0.0018060699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:15.845585+0000","last_change":"2024-04-26T12:21:15.845585+0000","last_active":"2024-04-26T12:21:15.845585+0000","last_peered":"2024-04-26T12:21:15.845585+0000","last_clean":"2024-04-26T12:21:15.845585+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:21:15.845585+0000","last_undegraded":"2024-04-26T12:21:15.845585+0000","last_fullsized":"2024-04-26T12:21:15.845585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_clean_scrub_stamp":"2024-04-26T12:21:15.845433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:43.633693+0000","scrub_duration":0.0020180860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:31.960816+0000","last_change":"2024-04-26T12:21:31.960941+0000","last_active":"2024-04-26T12:21:31.960816+0000","last_peered":"2024-04-26T12:21:31.960816+0000","last_clean":"2024-04-26T12:21:31.960816+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:21:31.960816+0000","last_undegraded":"2024-04-26T12:21:31.960816+0000","last_fullsized":"2024-04-26T12:21:31.960816+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:31.960781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:56.778609+0000","scrub_duration":0.001606894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.804328+0000","last_change":"2024-04-26T12:21:44.804441+0000","last_active":"2024-04-26T12:21:44.804328+0000","last_peered":"2024-04-26T12:21:44.804328+0000","last_clean":"2024-04-26T12:21:44.804328+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:44.804328+0000","last_undegraded":"2024-04-26T12:21:44.804328+0000","last_fullsized":"2024-04-26T12:21:44.804328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.804307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:13.373258+0000","scrub_duration":0.001678099,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:40.233585+0000","last_change":"2024-04-26T12:20:40.233585+0000","last_active":"2024-04-26T12:20:40.233585+0000","last_peered":"2024-04-26T12:20:40.233585+0000","last_clean":"2024-04-26T12:20:40.233585+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:40.233585+0000","last_undegraded":"2024-04-26T12:20:40.233585+0000","last_fullsized":"2024-04-26T12:20:40.233585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_clean_scrub_stamp":"2024-04-26T12:20:40.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.531307+0000","scrub_duration":0.037253345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:11.112510+0000","last_change":"2024-04-26T12:22:11.112610+0000","last_active":"2024-04-26T12:22:11.112510+0000","last_peered":"2024-04-26T12:22:11.112510+0000","last_clean":"2024-04-26T12:22:11.112510+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:22:11.112510+0000","last_undegraded":"2024-04-26T12:22:11.112510+0000","last_fullsized":"2024-04-26T12:22:11.112510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:11.112489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:11.112489+0000","last_clean_scrub_stamp":"2024-04-26T12:22:11.112489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:54.929523+0000","scrub_duration":0.001642983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:13.167454+0000","last_change":"2024-04-26T12:22:13.167567+0000","last_active":"2024-04-26T12:22:13.167454+0000","last_peered":"2024-04-26T12:22:13.167454+0000","last_clean":"2024-04-26T12:22:13.167454+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:22:13.167454+0000","last_undegraded":"2024-04-26T12:22:13.167454+0000","last_fullsized":"2024-04-26T12:22:13.167454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:13.167431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:13.167431+0000","last_clean_scrub_stamp":"2024-04-26T12:22:13.167431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:49.168000+0000","scrub_duration":0.001889948,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:38.217915+0000","last_change":"2024-04-26T12:20:38.217915+0000","last_active":"2024-04-26T12:20:38.217915+0000","last_peered":"2024-04-26T12:20:38.217915+0000","last_clean":"2024-04-26T12:20:38.217915+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:38.217915+0000","last_undegraded":"2024-04-26T12:20:38.217915+0000","last_fullsized":"2024-04-26T12:20:38.217915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_clean_scrub_stamp":"2024-04-26T12:20:38.217739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:53.024648+0000","scrub_duration":0.001837775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.345758+0000","last_change":"2024-04-26T12:21:02.345857+0000","last_active":"2024-04-26T12:21:02.345758+0000","last_peered":"2024-04-26T12:21:02.345758+0000","last_clean":"2024-04-26T12:21:02.345758+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:21:02.345758+0000","last_undegraded":"2024-04-26T12:21:02.345758+0000","last_fullsized":"2024-04-26T12:21:02.345758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.345738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:46.742649+0000","scrub_duration":0.0017828270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.947417+0000","last_change":"2024-04-26T12:21:27.947522+0000","last_active":"2024-04-26T12:21:27.947417+0000","last_peered":"2024-04-26T12:21:27.947417+0000","last_clean":"2024-04-26T12:21:27.947417+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:21:27.947417+0000","last_undegraded":"2024-04-26T12:21:27.947417+0000","last_fullsized":"2024-04-26T12:21:27.947417+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.947395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:02.048329+0000","scrub_duration":0.0020297980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.788962+0000","last_change":"2024-04-26T12:20:42.788962+0000","last_active":"2024-04-26T12:20:42.788962+0000","last_peered":"2024-04-26T12:20:42.788962+0000","last_clean":"2024-04-26T12:20:42.788962+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:42.788962+0000","last_undegraded":"2024-04-26T12:20:42.788962+0000","last_fullsized":"2024-04-26T12:20:42.788962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.788831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:48.051123+0000","scrub_duration":0.0018731360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:08.930400+0000","last_change":"2024-04-26T12:21:08.930526+0000","last_active":"2024-04-26T12:21:08.930400+0000","last_peered":"2024-04-26T12:21:08.930400+0000","last_clean":"2024-04-26T12:21:08.930400+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:21:08.930400+0000","last_undegraded":"2024-04-26T12:21:08.930400+0000","last_fullsized":"2024-04-26T12:21:08.930400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_clean_scrub_stamp":"2024-04-26T12:21:08.930381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:57.478621+0000","scrub_duration":0.0022001880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:40.742763+0000","last_change":"2024-04-26T12:21:40.742884+0000","last_active":"2024-04-26T12:21:40.742763+0000","last_peered":"2024-04-26T12:21:40.742763+0000","last_clean":"2024-04-26T12:21:40.742763+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:21:40.742763+0000","last_undegraded":"2024-04-26T12:21:40.742763+0000","last_fullsized":"2024-04-26T12:21:40.742763+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_clean_scrub_stamp":"2024-04-26T12:21:40.742726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:25.864637+0000","scrub_duration":0.001946726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.798092+0000","last_change":"2024-04-26T12:21:01.798203+0000","last_active":"2024-04-26T12:21:01.798092+0000","last_peered":"2024-04-26T12:21:01.798092+0000","last_clean":"2024-04-26T12:21:01.798092+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:21:01.798092+0000","last_undegraded":"2024-04-26T12:21:01.798092+0000","last_fullsized":"2024-04-26T12:21:01.798092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.798071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:26.107733+0000","scrub_duration":0.0017992150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.980665+0000","last_change":"2024-04-26T12:21:49.980795+0000","last_active":"2024-04-26T12:21:49.980665+0000","last_peered":"2024-04-26T12:21:49.980665+0000","last_clean":"2024-04-26T12:21:49.980665+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:21:49.980665+0000","last_undegraded":"2024-04-26T12:21:49.980665+0000","last_fullsized":"2024-04-26T12:21:49.980665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.980626+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:48.325677+0000","scrub_duration":0.0034005770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.927249+0000","last_change":"2024-04-26T12:21:29.927349+0000","last_active":"2024-04-26T12:21:29.927249+0000","last_peered":"2024-04-26T12:21:29.927249+0000","last_clean":"2024-04-26T12:21:29.927249+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:21:29.927249+0000","last_undegraded":"2024-04-26T12:21:29.927249+0000","last_fullsized":"2024-04-26T12:21:29.927249+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.927228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:13.697104+0000","scrub_duration":0.001694173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:39.239308+0000","last_change":"2024-04-26T12:20:39.239308+0000","last_active":"2024-04-26T12:20:39.239308+0000","last_peered":"2024-04-26T12:20:39.239308+0000","last_clean":"2024-04-26T12:20:39.239308+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:39.239308+0000","last_undegraded":"2024-04-26T12:20:39.239308+0000","last_fullsized":"2024-04-26T12:20:39.239308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_clean_scrub_stamp":"2024-04-26T12:20:39.239159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:05.765227+0000","scrub_duration":0.001927977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.019184+0000","last_change":"2024-04-26T12:21:49.019288+0000","last_active":"2024-04-26T12:21:49.019184+0000","last_peered":"2024-04-26T12:21:49.019184+0000","last_clean":"2024-04-26T12:21:49.019184+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:21:49.019184+0000","last_undegraded":"2024-04-26T12:21:49.019184+0000","last_fullsized":"2024-04-26T12:21:49.019184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.019162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:32.716076+0000","scrub_duration":0.0032590919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.628293+0000","last_change":"2024-04-26T12:21:20.628397+0000","last_active":"2024-04-26T12:21:20.628293+0000","last_peered":"2024-04-26T12:21:20.628293+0000","last_clean":"2024-04-26T12:21:20.628293+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:21:20.628293+0000","last_undegraded":"2024-04-26T12:21:20.628293+0000","last_fullsized":"2024-04-26T12:21:20.628293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.628273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:36.645398+0000","scrub_duration":0.001806247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.938858+0000","last_change":"2024-04-26T12:21:20.938983+0000","last_active":"2024-04-26T12:21:20.938858+0000","last_peered":"2024-04-26T12:21:20.938858+0000","last_clean":"2024-04-26T12:21:20.938858+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:21:20.938858+0000","last_undegraded":"2024-04-26T12:21:20.938858+0000","last_fullsized":"2024-04-26T12:21:20.938858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.938837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:40.130354+0000","scrub_duration":0.001772615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.298753+0000","last_change":"2024-04-26T12:21:36.298863+0000","last_active":"2024-04-26T12:21:36.298753+0000","last_peered":"2024-04-26T12:21:36.298753+0000","last_clean":"2024-04-26T12:21:36.298753+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:21:36.298753+0000","last_undegraded":"2024-04-26T12:21:36.298753+0000","last_fullsized":"2024-04-26T12:21:36.298753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.298732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:04.694417+0000","scrub_duration":0.0016097329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.286787+0000","last_change":"2024-04-26T12:21:44.286929+0000","last_active":"2024-04-26T12:21:44.286787+0000","last_peered":"2024-04-26T12:21:44.286787+0000","last_clean":"2024-04-26T12:21:44.286787+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:21:44.286787+0000","last_undegraded":"2024-04-26T12:21:44.286787+0000","last_fullsized":"2024-04-26T12:21:44.286787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.286751+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:41.216976+0000","scrub_duration":0.0052196680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.046248+0000","last_change":"2024-04-26T12:21:02.046248+0000","last_active":"2024-04-26T12:21:02.046248+0000","last_peered":"2024-04-26T12:21:02.046248+0000","last_clean":"2024-04-26T12:21:02.046248+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:21:02.046248+0000","last_undegraded":"2024-04-26T12:21:02.046248+0000","last_fullsized":"2024-04-26T12:21:02.046248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.046099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:02.071804+0000","scrub_duration":0.0017987509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:43.763333+0000","last_change":"2024-04-26T12:21:43.763333+0000","last_active":"2024-04-26T12:21:43.763333+0000","last_peered":"2024-04-26T12:21:43.763333+0000","last_clean":"2024-04-26T12:21:43.763333+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:21:43.763333+0000","last_undegraded":"2024-04-26T12:21:43.763333+0000","last_fullsized":"2024-04-26T12:21:43.763333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_clean_scrub_stamp":"2024-04-26T12:21:43.763181+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:50.040543+0000","scrub_duration":0.0039017230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:14.537563+0000","last_change":"2024-04-26T12:21:14.537700+0000","last_active":"2024-04-26T12:21:14.537563+0000","last_peered":"2024-04-26T12:21:14.537563+0000","last_clean":"2024-04-26T12:21:14.537563+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:21:14.537563+0000","last_undegraded":"2024-04-26T12:21:14.537563+0000","last_fullsized":"2024-04-26T12:21:14.537563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_clean_scrub_stamp":"2024-04-26T12:21:14.537541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:35.164328+0000","scrub_duration":0.001714157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.062080+0000","last_change":"2024-04-26T12:20:53.062080+0000","last_active":"2024-04-26T12:20:53.062080+0000","last_peered":"2024-04-26T12:20:53.062080+0000","last_clean":"2024-04-26T12:20:53.062080+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:53.062080+0000","last_undegraded":"2024-04-26T12:20:53.062080+0000","last_fullsized":"2024-04-26T12:20:53.062080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.061955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:36.090188+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.148696+0000","last_change":"2024-04-26T12:20:45.148696+0000","last_active":"2024-04-26T12:20:45.148696+0000","last_peered":"2024-04-26T12:20:45.148696+0000","last_clean":"2024-04-26T12:20:45.148696+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:45.148696+0000","last_undegraded":"2024-04-26T12:20:45.148696+0000","last_fullsized":"2024-04-26T12:20:45.148696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.148548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.383636+0000","scrub_duration":0.0018031029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:49.111929+0000","last_change":"2024-04-26T12:20:49.111929+0000","last_active":"2024-04-26T12:20:49.111929+0000","last_peered":"2024-04-26T12:20:49.111929+0000","last_clean":"2024-04-26T12:20:49.111929+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:49.111929+0000","last_undegraded":"2024-04-26T12:20:49.111929+0000","last_fullsized":"2024-04-26T12:20:49.111929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_clean_scrub_stamp":"2024-04-26T12:20:49.111806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:18.633109+0000","scrub_duration":0.0015728319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:55.873745+0000","last_change":"2024-04-26T12:20:55.873745+0000","last_active":"2024-04-26T12:20:55.873745+0000","last_peered":"2024-04-26T12:20:55.873745+0000","last_clean":"2024-04-26T12:20:55.873745+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:55.873745+0000","last_undegraded":"2024-04-26T12:20:55.873745+0000","last_fullsized":"2024-04-26T12:20:55.873745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_clean_scrub_stamp":"2024-04-26T12:20:55.873506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:35.165043+0000","scrub_duration":0.069253721000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:23.973578+0000","last_change":"2024-04-26T12:21:23.973578+0000","last_active":"2024-04-26T12:21:23.973578+0000","last_peered":"2024-04-26T12:21:23.973578+0000","last_clean":"2024-04-26T12:21:23.973578+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:21:23.973578+0000","last_undegraded":"2024-04-26T12:21:23.973578+0000","last_fullsized":"2024-04-26T12:21:23.973578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_clean_scrub_stamp":"2024-04-26T12:21:23.973458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:16.098425+0000","scrub_duration":0.001902541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.267347+0000","last_change":"2024-04-26T12:20:37.267347+0000","last_active":"2024-04-26T12:20:37.267347+0000","last_peered":"2024-04-26T12:20:37.267347+0000","last_clean":"2024-04-26T12:20:37.267347+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:37.267347+0000","last_undegraded":"2024-04-26T12:20:37.267347+0000","last_fullsized":"2024-04-26T12:20:37.267347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.267215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:21.882383+0000","scrub_duration":0.0018490620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.010072+0000","last_change":"2024-04-26T12:21:01.010072+0000","last_active":"2024-04-26T12:21:01.010072+0000","last_peered":"2024-04-26T12:21:01.010072+0000","last_clean":"2024-04-26T12:21:01.010072+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:21:01.010072+0000","last_undegraded":"2024-04-26T12:21:01.010072+0000","last_fullsized":"2024-04-26T12:21:01.010072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.009933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:20.201451+0000","scrub_duration":0.0018985370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:35.734593+0000","last_change":"2024-04-26T12:21:35.734685+0000","last_active":"2024-04-26T12:21:35.734593+0000","last_peered":"2024-04-26T12:21:35.734593+0000","last_clean":"2024-04-26T12:21:35.734593+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:21:35.734593+0000","last_undegraded":"2024-04-26T12:21:35.734593+0000","last_fullsized":"2024-04-26T12:21:35.734593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_clean_scrub_stamp":"2024-04-26T12:21:35.734571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:20.757460+0000","scrub_duration":0.0018119519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:41.754548+0000","last_change":"2024-04-26T12:21:41.754671+0000","last_active":"2024-04-26T12:21:41.754548+0000","last_peered":"2024-04-26T12:21:41.754548+0000","last_clean":"2024-04-26T12:21:41.754548+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:21:41.754548+0000","last_undegraded":"2024-04-26T12:21:41.754548+0000","last_fullsized":"2024-04-26T12:21:41.754548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_clean_scrub_stamp":"2024-04-26T12:21:41.754524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:50.022019+0000","scrub_duration":0.0017813410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:00.945802+0000","last_change":"2024-04-26T12:22:00.945941+0000","last_active":"2024-04-26T12:22:00.945802+0000","last_peered":"2024-04-26T12:22:00.945802+0000","last_clean":"2024-04-26T12:22:00.945802+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:22:00.945802+0000","last_undegraded":"2024-04-26T12:22:00.945802+0000","last_fullsized":"2024-04-26T12:22:00.945802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:00.945758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:00.945758+0000","last_clean_scrub_stamp":"2024-04-26T12:22:00.945758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:31.118414+0000","scrub_duration":0.0016528490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.781463+0000","last_change":"2024-04-26T12:21:45.781607+0000","last_active":"2024-04-26T12:21:45.781463+0000","last_peered":"2024-04-26T12:21:45.781463+0000","last_clean":"2024-04-26T12:21:45.781463+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:21:45.781463+0000","last_undegraded":"2024-04-26T12:21:45.781463+0000","last_fullsized":"2024-04-26T12:21:45.781463+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.781441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:10.599270+0000","scrub_duration":0.0018896659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:55.235575+0000","last_change":"2024-04-26T12:21:55.235679+0000","last_active":"2024-04-26T12:21:55.235575+0000","last_peered":"2024-04-26T12:21:55.235575+0000","last_clean":"2024-04-26T12:21:55.235575+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:21:55.235575+0000","last_undegraded":"2024-04-26T12:21:55.235575+0000","last_fullsized":"2024-04-26T12:21:55.235575+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:55.235555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:55.235555+0000","last_clean_scrub_stamp":"2024-04-26T12:21:55.235555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:56.584254+0000","scrub_duration":0.022038149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.306612+0000","last_change":"2024-04-26T12:21:01.306715+0000","last_active":"2024-04-26T12:21:01.306612+0000","last_peered":"2024-04-26T12:21:01.306612+0000","last_clean":"2024-04-26T12:21:01.306612+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:21:01.306612+0000","last_undegraded":"2024-04-26T12:21:01.306612+0000","last_fullsized":"2024-04-26T12:21:01.306612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.306592+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:51.007517+0000","scrub_duration":0.003604196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:01.085593+0000","last_change":"2024-04-26T12:22:01.085691+0000","last_active":"2024-04-26T12:22:01.085593+0000","last_peered":"2024-04-26T12:22:01.085593+0000","last_clean":"2024-04-26T12:22:01.085593+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:22:01.085593+0000","last_undegraded":"2024-04-26T12:22:01.085593+0000","last_fullsized":"2024-04-26T12:22:01.085593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:01.085572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:01.085572+0000","last_clean_scrub_stamp":"2024-04-26T12:22:01.085572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:17.660371+0000","scrub_duration":0.002072618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:34.783656+0000","last_change":"2024-04-26T12:21:34.783753+0000","last_active":"2024-04-26T12:21:34.783656+0000","last_peered":"2024-04-26T12:21:34.783656+0000","last_clean":"2024-04-26T12:21:34.783656+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:21:34.783656+0000","last_undegraded":"2024-04-26T12:21:34.783656+0000","last_fullsized":"2024-04-26T12:21:34.783656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_clean_scrub_stamp":"2024-04-26T12:21:34.783633+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:31.032530+0000","scrub_duration":0.0033859229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.922084+0000","last_change":"2024-04-26T12:21:19.922084+0000","last_active":"2024-04-26T12:21:19.922084+0000","last_peered":"2024-04-26T12:21:19.922084+0000","last_clean":"2024-04-26T12:21:19.922084+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:21:19.922084+0000","last_undegraded":"2024-04-26T12:21:19.922084+0000","last_fullsized":"2024-04-26T12:21:19.922084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.921926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:07.112057+0000","scrub_duration":0.020713793000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.113455+0000","last_change":"2024-04-26T12:20:51.113577+0000","last_active":"2024-04-26T12:20:51.113455+0000","last_peered":"2024-04-26T12:20:51.113455+0000","last_clean":"2024-04-26T12:20:51.113455+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:51.113455+0000","last_undegraded":"2024-04-26T12:20:51.113455+0000","last_fullsized":"2024-04-26T12:20:51.113455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.113432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:11.752649+0000","scrub_duration":0.0017589649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.269911+0000","last_change":"2024-04-26T12:20:59.270025+0000","last_active":"2024-04-26T12:20:59.269911+0000","last_peered":"2024-04-26T12:20:59.269911+0000","last_clean":"2024-04-26T12:20:59.269911+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:59.269911+0000","last_undegraded":"2024-04-26T12:20:59.269911+0000","last_fullsized":"2024-04-26T12:20:59.269911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.269890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:50.740249+0000","scrub_duration":0.0016247309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.241925+0000","last_change":"2024-04-26T12:20:42.241925+0000","last_active":"2024-04-26T12:20:42.241925+0000","last_peered":"2024-04-26T12:20:42.241925+0000","last_clean":"2024-04-26T12:20:42.241925+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:42.241925+0000","last_undegraded":"2024-04-26T12:20:42.241925+0000","last_fullsized":"2024-04-26T12:20:42.241925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.241764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:44.362930+0000","scrub_duration":0.0044497909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738463,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321308,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050532,"statfs":{"total":96636764160,"available":96307744768,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:21:58 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47999999999999998,"15min":0.40400000000000003},"min":{"1min":0.28000000000000003,"5min":0.19,"15min":0.17899999999999999},"max":{"1min":0.626,"5min":0.871,"15min":0.871},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46700000000000003,"15min":0.42999999999999999},"min":{"1min":0.30199999999999999,"5min":0.19800000000000001,"15min":0.192},"max":{"1min":0.53600000000000003,"5min":0.88400000000000001,"15min":0.92900000000000005},"last":0.44}]},{"osd":1,"last update":"Fri Apr 26 12:21:25 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.45600000000000002}]}]},{"osd":1,"up_from":74,"seq":317827579928,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:21:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Apr 26 12:21:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.59399999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483144,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888696,"statfs":{"total":96636764160,"available":96142024704,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:21:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:21:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45900000000000002,"15min":0.377},"min":{"1min":0.34799999999999998,"5min":0.191,"15min":0.161},"max":{"1min":0.59899999999999998,"5min":0.65300000000000002,"15min":0.92200000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.185},"max":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.879},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:22:17.305 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.305 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.306 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.306 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.306 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.306 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.307 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.307 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.307 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.307 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.307 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.307 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.307 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.308 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.308 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:14:37.212784+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.308 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:17.308 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:22:37.309 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:22:37.604 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:22:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:22:37.614 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-04-26T12:22:36.553432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834444,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281076,"statfs":{"total":289910292480,"available":289055821824,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.028568+0000","last_change":"2024-04-26T12:22:07.028769+0000","last_active":"2024-04-26T12:22:07.028568+0000","last_peered":"2024-04-26T12:22:07.028568+0000","last_clean":"2024-04-26T12:22:07.028568+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:22:07.028568+0000","last_undegraded":"2024-04-26T12:22:07.028568+0000","last_fullsized":"2024-04-26T12:22:07.028568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.028533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.028533+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.028533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:03.368476+0000","scrub_duration":0.093946051000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:19.008249+0000","last_change":"2024-04-26T12:22:19.008387+0000","last_active":"2024-04-26T12:22:19.008249+0000","last_peered":"2024-04-26T12:22:19.008249+0000","last_clean":"2024-04-26T12:22:19.008249+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:22:19.008249+0000","last_undegraded":"2024-04-26T12:22:19.008249+0000","last_fullsized":"2024-04-26T12:22:19.008249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:19.008196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:19.008196+0000","last_clean_scrub_stamp":"2024-04-26T12:22:19.008196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:14.918088+0000","scrub_duration":0.0016858260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.935203+0000","last_change":"2024-04-26T12:20:25.666779+0000","last_active":"2024-04-26T12:20:34.935203+0000","last_peered":"2024-04-26T12:20:34.935203+0000","last_clean":"2024-04-26T12:20:34.935203+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:20:34.935203+0000","last_undegraded":"2024-04-26T12:20:34.935203+0000","last_fullsized":"2024-04-26T12:20:34.935203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:57.265567+0000","last_change":"2024-04-26T12:20:57.265567+0000","last_active":"2024-04-26T12:20:57.265567+0000","last_peered":"2024-04-26T12:20:57.265567+0000","last_clean":"2024-04-26T12:20:57.265567+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:57.265567+0000","last_undegraded":"2024-04-26T12:20:57.265567+0000","last_fullsized":"2024-04-26T12:20:57.265567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_clean_scrub_stamp":"2024-04-26T12:20:57.265416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:34.758945+0000","scrub_duration":0.0019165709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:03.872380+0000","last_change":"2024-04-26T12:21:03.872380+0000","last_active":"2024-04-26T12:21:03.872380+0000","last_peered":"2024-04-26T12:21:03.872380+0000","last_clean":"2024-04-26T12:21:03.872380+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:21:03.872380+0000","last_undegraded":"2024-04-26T12:21:03.872380+0000","last_fullsized":"2024-04-26T12:21:03.872380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_clean_scrub_stamp":"2024-04-26T12:21:03.872236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.873602+0000","scrub_duration":0.021825418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:39.279812+0000","last_change":"2024-04-26T12:21:39.279942+0000","last_active":"2024-04-26T12:21:39.279812+0000","last_peered":"2024-04-26T12:21:39.279812+0000","last_clean":"2024-04-26T12:21:39.279812+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:21:39.279812+0000","last_undegraded":"2024-04-26T12:21:39.279812+0000","last_fullsized":"2024-04-26T12:21:39.279812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_clean_scrub_stamp":"2024-04-26T12:21:39.279789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:40.481707+0000","scrub_duration":0.0020338550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.205087+0000","last_change":"2024-04-26T12:21:56.205187+0000","last_active":"2024-04-26T12:21:56.205087+0000","last_peered":"2024-04-26T12:21:56.205087+0000","last_clean":"2024-04-26T12:21:56.205087+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:21:56.205087+0000","last_undegraded":"2024-04-26T12:21:56.205087+0000","last_fullsized":"2024-04-26T12:21:56.205087+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.205068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.205068+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.205068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:58.755685+0000","scrub_duration":0.020726391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:53.219550+0000","last_change":"2024-04-26T12:21:53.219691+0000","last_active":"2024-04-26T12:21:53.219550+0000","last_peered":"2024-04-26T12:21:53.219550+0000","last_clean":"2024-04-26T12:21:53.219550+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:21:53.219550+0000","last_undegraded":"2024-04-26T12:21:53.219550+0000","last_fullsized":"2024-04-26T12:21:53.219550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_clean_scrub_stamp":"2024-04-26T12:21:53.219526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:11.285479+0000","scrub_duration":0.001588772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:13.867897+0000","last_change":"2024-04-26T12:22:13.868058+0000","last_active":"2024-04-26T12:22:13.867897+0000","last_peered":"2024-04-26T12:22:13.867897+0000","last_clean":"2024-04-26T12:22:13.867897+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:22:13.867897+0000","last_undegraded":"2024-04-26T12:22:13.867897+0000","last_fullsized":"2024-04-26T12:22:13.867897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:13.867877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:13.867877+0000","last_clean_scrub_stamp":"2024-04-26T12:22:13.867877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.011584+0000","scrub_duration":0.036397444000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.790658+0000","last_change":"2024-04-26T12:20:41.790658+0000","last_active":"2024-04-26T12:20:41.790658+0000","last_peered":"2024-04-26T12:20:41.790658+0000","last_clean":"2024-04-26T12:20:41.790658+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:41.790658+0000","last_undegraded":"2024-04-26T12:20:41.790658+0000","last_fullsized":"2024-04-26T12:20:41.790658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.790495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:52.175594+0000","scrub_duration":0.0019401209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.379089+0000","last_change":"2024-04-26T12:21:29.379199+0000","last_active":"2024-04-26T12:21:29.379089+0000","last_peered":"2024-04-26T12:21:29.379089+0000","last_clean":"2024-04-26T12:21:29.379089+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:21:29.379089+0000","last_undegraded":"2024-04-26T12:21:29.379089+0000","last_fullsized":"2024-04-26T12:21:29.379089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.379071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.183371+0000","scrub_duration":0.020900218000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:10.988729+0000","last_change":"2024-04-26T12:22:10.988834+0000","last_active":"2024-04-26T12:22:10.988729+0000","last_peered":"2024-04-26T12:22:10.988729+0000","last_clean":"2024-04-26T12:22:10.988729+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:22:10.988729+0000","last_undegraded":"2024-04-26T12:22:10.988729+0000","last_fullsized":"2024-04-26T12:22:10.988729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:10.988705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:10.988705+0000","last_clean_scrub_stamp":"2024-04-26T12:22:10.988705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:53.867995+0000","scrub_duration":0.0018000850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:02.969436+0000","last_change":"2024-04-26T12:22:02.969548+0000","last_active":"2024-04-26T12:22:02.969436+0000","last_peered":"2024-04-26T12:22:02.969436+0000","last_clean":"2024-04-26T12:22:02.969436+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:22:02.969436+0000","last_undegraded":"2024-04-26T12:22:02.969436+0000","last_fullsized":"2024-04-26T12:22:02.969436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:02.969417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:02.969417+0000","last_clean_scrub_stamp":"2024-04-26T12:22:02.969417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:21.464136+0000","scrub_duration":0.0209908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:32.386134+0000","last_change":"2024-04-26T12:21:32.386234+0000","last_active":"2024-04-26T12:21:32.386134+0000","last_peered":"2024-04-26T12:21:32.386134+0000","last_clean":"2024-04-26T12:21:32.386134+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:21:32.386134+0000","last_undegraded":"2024-04-26T12:21:32.386134+0000","last_fullsized":"2024-04-26T12:21:32.386134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_clean_scrub_stamp":"2024-04-26T12:21:32.386115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:35.046547+0000","scrub_duration":0.0017283579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:04.377717+0000","last_change":"2024-04-26T12:21:04.377824+0000","last_active":"2024-04-26T12:21:04.377717+0000","last_peered":"2024-04-26T12:21:04.377717+0000","last_clean":"2024-04-26T12:21:04.377717+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:21:04.377717+0000","last_undegraded":"2024-04-26T12:21:04.377717+0000","last_fullsized":"2024-04-26T12:21:04.377717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_clean_scrub_stamp":"2024-04-26T12:21:04.377697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.199940+0000","scrub_duration":0.0019611149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.219944+0000","last_change":"2024-04-26T12:20:41.220047+0000","last_active":"2024-04-26T12:20:41.219944+0000","last_peered":"2024-04-26T12:20:41.219944+0000","last_clean":"2024-04-26T12:20:41.219944+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:41.219944+0000","last_undegraded":"2024-04-26T12:20:41.219944+0000","last_fullsized":"2024-04-26T12:20:41.219944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.219912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:44.836560+0000","scrub_duration":0.001961516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:10.912751+0000","last_change":"2024-04-26T12:22:10.912859+0000","last_active":"2024-04-26T12:22:10.912751+0000","last_peered":"2024-04-26T12:22:10.912751+0000","last_clean":"2024-04-26T12:22:10.912751+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:22:10.912751+0000","last_undegraded":"2024-04-26T12:22:10.912751+0000","last_fullsized":"2024-04-26T12:22:10.912751+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:10.912731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:10.912731+0000","last_clean_scrub_stamp":"2024-04-26T12:22:10.912731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:00.102782+0000","scrub_duration":0.10408954600000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:52.790151+0000","last_change":"2024-04-26T12:20:52.790151+0000","last_active":"2024-04-26T12:20:52.790151+0000","last_peered":"2024-04-26T12:20:52.790151+0000","last_clean":"2024-04-26T12:20:52.790151+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:52.790151+0000","last_undegraded":"2024-04-26T12:20:52.790151+0000","last_fullsized":"2024-04-26T12:20:52.790151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_clean_scrub_stamp":"2024-04-26T12:20:52.790025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:37.405193+0000","scrub_duration":0.0021779400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:11.869992+0000","last_change":"2024-04-26T12:22:11.870118+0000","last_active":"2024-04-26T12:22:11.869992+0000","last_peered":"2024-04-26T12:22:11.869992+0000","last_clean":"2024-04-26T12:22:11.869992+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:22:11.869992+0000","last_undegraded":"2024-04-26T12:22:11.869992+0000","last_fullsized":"2024-04-26T12:22:11.869992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:11.869969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:11.869969+0000","last_clean_scrub_stamp":"2024-04-26T12:22:11.869969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:34.740124+0000","scrub_duration":0.038021049000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683555+0000","last_change":"2024-04-26T12:20:25.664430+0000","last_active":"2024-04-26T12:20:29.683555+0000","last_peered":"2024-04-26T12:20:29.683555+0000","last_clean":"2024-04-26T12:20:29.683555+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:20:29.683555+0000","last_undegraded":"2024-04-26T12:20:29.683555+0000","last_fullsized":"2024-04-26T12:20:29.683555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:17.676174+0000","last_change":"2024-04-26T12:21:17.676291+0000","last_active":"2024-04-26T12:21:17.676174+0000","last_peered":"2024-04-26T12:21:17.676174+0000","last_clean":"2024-04-26T12:21:17.676174+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:21:17.676174+0000","last_undegraded":"2024-04-26T12:21:17.676174+0000","last_fullsized":"2024-04-26T12:21:17.676174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_clean_scrub_stamp":"2024-04-26T12:21:17.676137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:03.477865+0000","scrub_duration":0.022895645999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.955655+0000","last_change":"2024-04-26T12:22:07.955819+0000","last_active":"2024-04-26T12:22:07.955655+0000","last_peered":"2024-04-26T12:22:07.955655+0000","last_clean":"2024-04-26T12:22:07.955655+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:22:07.955655+0000","last_undegraded":"2024-04-26T12:22:07.955655+0000","last_fullsized":"2024-04-26T12:22:07.955655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.955633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.955633+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.955633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:04.665590+0000","scrub_duration":0.0021521180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:08.819222+0000","last_change":"2024-04-26T12:22:08.819318+0000","last_active":"2024-04-26T12:22:08.819222+0000","last_peered":"2024-04-26T12:22:08.819222+0000","last_clean":"2024-04-26T12:22:08.819222+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:22:08.819222+0000","last_undegraded":"2024-04-26T12:22:08.819222+0000","last_fullsized":"2024-04-26T12:22:08.819222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:08.819198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:08.819198+0000","last_clean_scrub_stamp":"2024-04-26T12:22:08.819198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:24.196455+0000","scrub_duration":0.001676493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.930881+0000","last_change":"2024-04-26T12:21:56.930998+0000","last_active":"2024-04-26T12:21:56.930881+0000","last_peered":"2024-04-26T12:21:56.930881+0000","last_clean":"2024-04-26T12:21:56.930881+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:21:56.930881+0000","last_undegraded":"2024-04-26T12:21:56.930881+0000","last_fullsized":"2024-04-26T12:21:56.930881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.930860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.930860+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.930860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:22.433096+0000","scrub_duration":0.0016250489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.813170+0000","last_change":"2024-04-26T12:21:27.813304+0000","last_active":"2024-04-26T12:21:27.813170+0000","last_peered":"2024-04-26T12:21:27.813170+0000","last_clean":"2024-04-26T12:21:27.813170+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:21:27.813170+0000","last_undegraded":"2024-04-26T12:21:27.813170+0000","last_fullsized":"2024-04-26T12:21:27.813170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.813147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:16.361388+0000","scrub_duration":0.023876636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.835199+0000","last_change":"2024-04-26T12:22:07.835305+0000","last_active":"2024-04-26T12:22:07.835199+0000","last_peered":"2024-04-26T12:22:07.835199+0000","last_clean":"2024-04-26T12:22:07.835199+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:22:07.835199+0000","last_undegraded":"2024-04-26T12:22:07.835199+0000","last_fullsized":"2024-04-26T12:22:07.835199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.835177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.835177+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.835177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:03.745069+0000","scrub_duration":0.002013754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.935064+0000","last_change":"2024-04-26T12:20:25.666320+0000","last_active":"2024-04-26T12:20:34.935064+0000","last_peered":"2024-04-26T12:20:34.935064+0000","last_clean":"2024-04-26T12:20:34.935064+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:20:34.935064+0000","last_undegraded":"2024-04-26T12:20:34.935064+0000","last_fullsized":"2024-04-26T12:20:34.935064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.808505+0000","last_change":"2024-04-26T12:20:59.808505+0000","last_active":"2024-04-26T12:20:59.808505+0000","last_peered":"2024-04-26T12:20:59.808505+0000","last_clean":"2024-04-26T12:20:59.808505+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:59.808505+0000","last_undegraded":"2024-04-26T12:20:59.808505+0000","last_fullsized":"2024-04-26T12:20:59.808505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.808367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.929534+0000","scrub_duration":0.002171816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:59.966971+0000","last_change":"2024-04-26T12:21:59.967089+0000","last_active":"2024-04-26T12:21:59.966971+0000","last_peered":"2024-04-26T12:21:59.966971+0000","last_clean":"2024-04-26T12:21:59.966971+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:21:59.966971+0000","last_undegraded":"2024-04-26T12:21:59.966971+0000","last_fullsized":"2024-04-26T12:21:59.966971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:59.966927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:59.966927+0000","last_clean_scrub_stamp":"2024-04-26T12:21:59.966927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:42.846217+0000","scrub_duration":0.038480333999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:13.806551+0000","last_change":"2024-04-26T12:21:13.806657+0000","last_active":"2024-04-26T12:21:13.806551+0000","last_peered":"2024-04-26T12:21:13.806551+0000","last_clean":"2024-04-26T12:21:13.806551+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:21:13.806551+0000","last_undegraded":"2024-04-26T12:21:13.806551+0000","last_fullsized":"2024-04-26T12:21:13.806551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_clean_scrub_stamp":"2024-04-26T12:21:13.806530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:56.319084+0000","scrub_duration":0.0017893570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.003640+0000","last_change":"2024-04-26T12:21:56.003766+0000","last_active":"2024-04-26T12:21:56.003640+0000","last_peered":"2024-04-26T12:21:56.003640+0000","last_clean":"2024-04-26T12:21:56.003640+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:21:56.003640+0000","last_undegraded":"2024-04-26T12:21:56.003640+0000","last_fullsized":"2024-04-26T12:21:56.003640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.003619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.003619+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.003619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:58.633567+0000","scrub_duration":0.001618424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:29.262783+0000","last_change":"2024-04-26T12:22:29.262892+0000","last_active":"2024-04-26T12:22:29.262783+0000","last_peered":"2024-04-26T12:22:29.262783+0000","last_clean":"2024-04-26T12:22:29.262783+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:22:29.262783+0000","last_undegraded":"2024-04-26T12:22:29.262783+0000","last_fullsized":"2024-04-26T12:22:29.262783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:29.262763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:29.262763+0000","last_clean_scrub_stamp":"2024-04-26T12:22:29.262763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:16.971662+0000","scrub_duration":0.0019073429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:05.803095+0000","last_change":"2024-04-26T12:21:05.803095+0000","last_active":"2024-04-26T12:21:05.803095+0000","last_peered":"2024-04-26T12:21:05.803095+0000","last_clean":"2024-04-26T12:21:05.803095+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:21:05.803095+0000","last_undegraded":"2024-04-26T12:21:05.803095+0000","last_fullsized":"2024-04-26T12:21:05.803095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_clean_scrub_stamp":"2024-04-26T12:21:05.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:22.222434+0000","scrub_duration":0.0018232630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"79'4","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:18.232102+0000","last_change":"2024-04-26T12:22:18.232212+0000","last_active":"2024-04-26T12:22:18.232102+0000","last_peered":"2024-04-26T12:22:18.232102+0000","last_clean":"2024-04-26T12:22:18.232102+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:22:18.232102+0000","last_undegraded":"2024-04-26T12:22:18.232102+0000","last_fullsized":"2024-04-26T12:22:18.232102+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-26T12:22:18.232080+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-26T12:22:18.232080+0000","last_clean_scrub_stamp":"2024-04-26T12:22:18.232080+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:48.758491+0000","scrub_duration":0.0037899420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.778599+0000","last_change":"2024-04-26T12:20:53.778599+0000","last_active":"2024-04-26T12:20:53.778599+0000","last_peered":"2024-04-26T12:20:53.778599+0000","last_clean":"2024-04-26T12:20:53.778599+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:53.778599+0000","last_undegraded":"2024-04-26T12:20:53.778599+0000","last_fullsized":"2024-04-26T12:20:53.778599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.778477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:08.585386+0000","scrub_duration":0.021558476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:47.162047+0000","last_change":"2024-04-26T12:20:47.162047+0000","last_active":"2024-04-26T12:20:47.162047+0000","last_peered":"2024-04-26T12:20:47.162047+0000","last_clean":"2024-04-26T12:20:47.162047+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:47.162047+0000","last_undegraded":"2024-04-26T12:20:47.162047+0000","last_fullsized":"2024-04-26T12:20:47.162047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_clean_scrub_stamp":"2024-04-26T12:20:47.161913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:03.581394+0000","scrub_duration":0.00169505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.982751+0000","last_change":"2024-04-26T12:21:19.982751+0000","last_active":"2024-04-26T12:21:19.982751+0000","last_peered":"2024-04-26T12:21:19.982751+0000","last_clean":"2024-04-26T12:21:19.982751+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:21:19.982751+0000","last_undegraded":"2024-04-26T12:21:19.982751+0000","last_fullsized":"2024-04-26T12:21:19.982751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.982628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:02.501013+0000","scrub_duration":0.001761875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:53.911367+0000","last_change":"2024-04-26T12:21:53.911462+0000","last_active":"2024-04-26T12:21:53.911367+0000","last_peered":"2024-04-26T12:21:53.911367+0000","last_clean":"2024-04-26T12:21:53.911367+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:21:53.911367+0000","last_undegraded":"2024-04-26T12:21:53.911367+0000","last_fullsized":"2024-04-26T12:21:53.911367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:53.911345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:53.911345+0000","last_clean_scrub_stamp":"2024-04-26T12:21:53.911345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:45.849360+0000","scrub_duration":0.0017856079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:52.053906+0000","last_change":"2024-04-26T12:21:52.053906+0000","last_active":"2024-04-26T12:21:52.053906+0000","last_peered":"2024-04-26T12:21:52.053906+0000","last_clean":"2024-04-26T12:21:52.053906+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:21:52.053906+0000","last_undegraded":"2024-04-26T12:21:52.053906+0000","last_fullsized":"2024-04-26T12:21:52.053906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:52.053743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:52.053743+0000","last_clean_scrub_stamp":"2024-04-26T12:21:52.053743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:11.521087+0000","scrub_duration":0.037699734999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'12","reported_seq":57,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:16.161292+0000","last_change":"2024-04-26T12:22:16.161408+0000","last_active":"2024-04-26T12:22:16.161292+0000","last_peered":"2024-04-26T12:22:16.161292+0000","last_clean":"2024-04-26T12:22:16.161292+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:22:16.161292+0000","last_undegraded":"2024-04-26T12:22:16.161292+0000","last_fullsized":"2024-04-26T12:22:16.161292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-04-26T12:22:16.161269+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-04-26T12:22:16.161269+0000","last_clean_scrub_stamp":"2024-04-26T12:22:16.161269+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:11.975031+0000","scrub_duration":0.007597945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:31.359857+0000","last_change":"2024-04-26T12:22:31.359994+0000","last_active":"2024-04-26T12:22:31.359857+0000","last_peered":"2024-04-26T12:22:31.359857+0000","last_clean":"2024-04-26T12:22:31.359857+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:22:31.359857+0000","last_undegraded":"2024-04-26T12:22:31.359857+0000","last_fullsized":"2024-04-26T12:22:31.359857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-26T12:22:31.359817+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-26T12:22:31.359817+0000","last_clean_scrub_stamp":"2024-04-26T12:22:31.359817+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:48.638467+0000","scrub_duration":0.0035788780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:21.922061+0000","last_change":"2024-04-26T12:21:21.922165+0000","last_active":"2024-04-26T12:21:21.922061+0000","last_peered":"2024-04-26T12:21:21.922061+0000","last_clean":"2024-04-26T12:21:21.922061+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:21:21.922061+0000","last_undegraded":"2024-04-26T12:21:21.922061+0000","last_fullsized":"2024-04-26T12:21:21.922061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_clean_scrub_stamp":"2024-04-26T12:21:21.922041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:21.947746+0000","scrub_duration":0.0019268759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"79'3","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:52.869663+0000","last_change":"2024-04-26T12:21:52.869775+0000","last_active":"2024-04-26T12:21:52.869663+0000","last_peered":"2024-04-26T12:21:52.869663+0000","last_clean":"2024-04-26T12:21:52.869663+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:21:52.869663+0000","last_undegraded":"2024-04-26T12:21:52.869663+0000","last_fullsized":"2024-04-26T12:21:52.869663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:52.869641+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:52.869641+0000","last_clean_scrub_stamp":"2024-04-26T12:21:52.869641+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:59.685725+0000","scrub_duration":0.0034181530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:01.967451+0000","last_change":"2024-04-26T12:22:01.967556+0000","last_active":"2024-04-26T12:22:01.967451+0000","last_peered":"2024-04-26T12:22:01.967451+0000","last_clean":"2024-04-26T12:22:01.967451+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:22:01.967451+0000","last_undegraded":"2024-04-26T12:22:01.967451+0000","last_fullsized":"2024-04-26T12:22:01.967451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:01.967417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:01.967417+0000","last_clean_scrub_stamp":"2024-04-26T12:22:01.967417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:56.957901+0000","scrub_duration":0.001588613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683701+0000","last_change":"2024-04-26T12:20:25.666509+0000","last_active":"2024-04-26T12:20:29.683701+0000","last_peered":"2024-04-26T12:20:29.683701+0000","last_clean":"2024-04-26T12:20:29.683701+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:20:29.683701+0000","last_undegraded":"2024-04-26T12:20:29.683701+0000","last_fullsized":"2024-04-26T12:20:29.683701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.505865+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.505865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.240064+0000","last_change":"2024-04-26T12:20:51.240064+0000","last_active":"2024-04-26T12:20:51.240064+0000","last_peered":"2024-04-26T12:20:51.240064+0000","last_clean":"2024-04-26T12:20:51.240064+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:51.240064+0000","last_undegraded":"2024-04-26T12:20:51.240064+0000","last_fullsized":"2024-04-26T12:20:51.240064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.239936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:38.455956+0000","scrub_duration":0.0018569750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.195154+0000","last_change":"2024-04-26T12:20:45.195262+0000","last_active":"2024-04-26T12:20:45.195154+0000","last_peered":"2024-04-26T12:20:45.195154+0000","last_clean":"2024-04-26T12:20:45.195154+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:45.195154+0000","last_undegraded":"2024-04-26T12:20:45.195154+0000","last_fullsized":"2024-04-26T12:20:45.195154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.195132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:03.642870+0000","scrub_duration":0.001821214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:44.228054+0000","last_change":"2024-04-26T12:20:44.228054+0000","last_active":"2024-04-26T12:20:44.228054+0000","last_peered":"2024-04-26T12:20:44.228054+0000","last_clean":"2024-04-26T12:20:44.228054+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:44.228054+0000","last_undegraded":"2024-04-26T12:20:44.228054+0000","last_fullsized":"2024-04-26T12:20:44.228054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_clean_scrub_stamp":"2024-04-26T12:20:44.227884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:28.326058+0000","scrub_duration":0.037590602000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.054265+0000","last_change":"2024-04-26T12:21:45.054404+0000","last_active":"2024-04-26T12:21:45.054265+0000","last_peered":"2024-04-26T12:21:45.054265+0000","last_clean":"2024-04-26T12:21:45.054265+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:21:45.054265+0000","last_undegraded":"2024-04-26T12:21:45.054265+0000","last_fullsized":"2024-04-26T12:21:45.054265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.054243+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:10.556480+0000","scrub_duration":0.003031026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:29.683745+0000","last_change":"2024-04-26T12:20:25.663147+0000","last_active":"2024-04-26T12:20:29.683745+0000","last_peered":"2024-04-26T12:20:29.683745+0000","last_clean":"2024-04-26T12:20:29.683745+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:20:29.683745+0000","last_undegraded":"2024-04-26T12:20:29.683745+0000","last_fullsized":"2024-04-26T12:20:29.683745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:17.191850+0000","last_change":"2024-04-26T12:22:17.191850+0000","last_active":"2024-04-26T12:22:17.191850+0000","last_peered":"2024-04-26T12:22:17.191850+0000","last_clean":"2024-04-26T12:22:17.191850+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:22:17.191850+0000","last_undegraded":"2024-04-26T12:22:17.191850+0000","last_fullsized":"2024-04-26T12:22:17.191850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:17.191725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:17.191725+0000","last_clean_scrub_stamp":"2024-04-26T12:22:17.191725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:14.904499+0000","scrub_duration":0.0017556060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.185645+0000","last_change":"2024-04-26T12:20:37.185781+0000","last_active":"2024-04-26T12:20:37.185645+0000","last_peered":"2024-04-26T12:20:37.185645+0000","last_clean":"2024-04-26T12:20:37.185645+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:37.185645+0000","last_undegraded":"2024-04-26T12:20:37.185645+0000","last_fullsized":"2024-04-26T12:20:37.185645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.185622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:13.134344+0000","scrub_duration":0.0022406729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.736459+0000","last_change":"2024-04-26T12:21:42.736574+0000","last_active":"2024-04-26T12:21:42.736459+0000","last_peered":"2024-04-26T12:21:42.736459+0000","last_clean":"2024-04-26T12:21:42.736459+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:42.736459+0000","last_undegraded":"2024-04-26T12:21:42.736459+0000","last_fullsized":"2024-04-26T12:21:42.736459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.736439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:28.494771+0000","scrub_duration":0.001884997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:32.316190+0000","last_change":"2024-04-26T12:22:32.316283+0000","last_active":"2024-04-26T12:22:32.316190+0000","last_peered":"2024-04-26T12:22:32.316190+0000","last_clean":"2024-04-26T12:22:32.316190+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:22:32.316190+0000","last_undegraded":"2024-04-26T12:22:32.316190+0000","last_fullsized":"2024-04-26T12:22:32.316190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:32.316170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:32.316170+0000","last_clean_scrub_stamp":"2024-04-26T12:22:32.316170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:03.229810+0000","scrub_duration":0.002212061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.724802+0000","last_change":"2024-04-26T12:21:36.724938+0000","last_active":"2024-04-26T12:21:36.724802+0000","last_peered":"2024-04-26T12:21:36.724802+0000","last_clean":"2024-04-26T12:21:36.724802+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:21:36.724802+0000","last_undegraded":"2024-04-26T12:21:36.724802+0000","last_fullsized":"2024-04-26T12:21:36.724802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.724781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:21.696248+0000","scrub_duration":0.001563694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.243964+0000","last_change":"2024-04-26T12:20:46.243964+0000","last_active":"2024-04-26T12:20:46.243964+0000","last_peered":"2024-04-26T12:20:46.243964+0000","last_clean":"2024-04-26T12:20:46.243964+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:46.243964+0000","last_undegraded":"2024-04-26T12:20:46.243964+0000","last_fullsized":"2024-04-26T12:20:46.243964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_clean_scrub_stamp":"2024-04-26T12:20:46.243795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.992132+0000","scrub_duration":0.071910356999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":246,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.182801+0000","last_change":"2024-04-26T12:22:07.182801+0000","last_active":"2024-04-26T12:22:07.182801+0000","last_peered":"2024-04-26T12:22:07.182801+0000","last_clean":"2024-04-26T12:22:07.182801+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:22:07.182801+0000","last_undegraded":"2024-04-26T12:22:07.182801+0000","last_fullsized":"2024-04-26T12:22:07.182801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-26T12:22:07.182648+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-26T12:22:07.182648+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.182648+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:45.009503+0000","scrub_duration":0.0079940380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:14.181780+0000","last_change":"2024-04-26T12:22:14.181780+0000","last_active":"2024-04-26T12:22:14.181780+0000","last_peered":"2024-04-26T12:22:14.181780+0000","last_clean":"2024-04-26T12:22:14.181780+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:22:14.181780+0000","last_undegraded":"2024-04-26T12:22:14.181780+0000","last_fullsized":"2024-04-26T12:22:14.181780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:14.181647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:14.181647+0000","last_clean_scrub_stamp":"2024-04-26T12:22:14.181647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:06.398648+0000","scrub_duration":0.0017895210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:50.996724+0000","last_change":"2024-04-26T12:21:50.996837+0000","last_active":"2024-04-26T12:21:50.996724+0000","last_peered":"2024-04-26T12:21:50.996724+0000","last_clean":"2024-04-26T12:21:50.996724+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:21:50.996724+0000","last_undegraded":"2024-04-26T12:21:50.996724+0000","last_fullsized":"2024-04-26T12:21:50.996724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_clean_scrub_stamp":"2024-04-26T12:21:50.996704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:37.430031+0000","scrub_duration":0.001618841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:34.934885+0000","last_change":"2024-04-26T12:20:25.666504+0000","last_active":"2024-04-26T12:20:34.934885+0000","last_peered":"2024-04-26T12:20:34.934885+0000","last_clean":"2024-04-26T12:20:34.934885+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:20:34.934885+0000","last_undegraded":"2024-04-26T12:20:34.934885+0000","last_fullsized":"2024-04-26T12:20:34.934885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:42.510472+0000","last_clean_scrub_stamp":"2024-04-26T12:14:42.510472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:28.389208+0000","last_change":"2024-04-26T12:21:28.389208+0000","last_active":"2024-04-26T12:21:28.389208+0000","last_peered":"2024-04-26T12:21:28.389208+0000","last_clean":"2024-04-26T12:21:28.389208+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:21:28.389208+0000","last_undegraded":"2024-04-26T12:21:28.389208+0000","last_fullsized":"2024-04-26T12:21:28.389208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_clean_scrub_stamp":"2024-04-26T12:21:28.389079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:28.433507+0000","scrub_duration":0.0020847600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.985544+0000","last_change":"2024-04-26T12:21:42.985671+0000","last_active":"2024-04-26T12:21:42.985544+0000","last_peered":"2024-04-26T12:21:42.985544+0000","last_clean":"2024-04-26T12:21:42.985544+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:21:42.985544+0000","last_undegraded":"2024-04-26T12:21:42.985544+0000","last_fullsized":"2024-04-26T12:21:42.985544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.985508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:34.923523+0000","scrub_duration":0.0018060699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:15.845585+0000","last_change":"2024-04-26T12:21:15.845585+0000","last_active":"2024-04-26T12:21:15.845585+0000","last_peered":"2024-04-26T12:21:15.845585+0000","last_clean":"2024-04-26T12:21:15.845585+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:21:15.845585+0000","last_undegraded":"2024-04-26T12:21:15.845585+0000","last_fullsized":"2024-04-26T12:21:15.845585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_clean_scrub_stamp":"2024-04-26T12:21:15.845433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:43.633693+0000","scrub_duration":0.0020180860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:31.960816+0000","last_change":"2024-04-26T12:21:31.960941+0000","last_active":"2024-04-26T12:21:31.960816+0000","last_peered":"2024-04-26T12:21:31.960816+0000","last_clean":"2024-04-26T12:21:31.960816+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:21:31.960816+0000","last_undegraded":"2024-04-26T12:21:31.960816+0000","last_fullsized":"2024-04-26T12:21:31.960816+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:31.960781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:56.778609+0000","scrub_duration":0.001606894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.804328+0000","last_change":"2024-04-26T12:21:44.804441+0000","last_active":"2024-04-26T12:21:44.804328+0000","last_peered":"2024-04-26T12:21:44.804328+0000","last_clean":"2024-04-26T12:21:44.804328+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:44.804328+0000","last_undegraded":"2024-04-26T12:21:44.804328+0000","last_fullsized":"2024-04-26T12:21:44.804328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.804307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:13.373258+0000","scrub_duration":0.001678099,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:40.233585+0000","last_change":"2024-04-26T12:20:40.233585+0000","last_active":"2024-04-26T12:20:40.233585+0000","last_peered":"2024-04-26T12:20:40.233585+0000","last_clean":"2024-04-26T12:20:40.233585+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:40.233585+0000","last_undegraded":"2024-04-26T12:20:40.233585+0000","last_fullsized":"2024-04-26T12:20:40.233585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_clean_scrub_stamp":"2024-04-26T12:20:40.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.531307+0000","scrub_duration":0.037253345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:11.112610+0000","last_change":"2024-04-26T12:22:11.112610+0000","last_active":"2024-04-26T12:22:11.112610+0000","last_peered":"2024-04-26T12:22:11.112610+0000","last_clean":"2024-04-26T12:22:11.112610+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:22:11.112610+0000","last_undegraded":"2024-04-26T12:22:11.112610+0000","last_fullsized":"2024-04-26T12:22:11.112610+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:11.112489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:11.112489+0000","last_clean_scrub_stamp":"2024-04-26T12:22:11.112489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:54.929523+0000","scrub_duration":0.001642983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:13.167567+0000","last_change":"2024-04-26T12:22:13.167567+0000","last_active":"2024-04-26T12:22:13.167567+0000","last_peered":"2024-04-26T12:22:13.167567+0000","last_clean":"2024-04-26T12:22:13.167567+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:22:13.167567+0000","last_undegraded":"2024-04-26T12:22:13.167567+0000","last_fullsized":"2024-04-26T12:22:13.167567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:13.167431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:13.167431+0000","last_clean_scrub_stamp":"2024-04-26T12:22:13.167431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:49.168000+0000","scrub_duration":0.001889948,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:38.217915+0000","last_change":"2024-04-26T12:20:38.217915+0000","last_active":"2024-04-26T12:20:38.217915+0000","last_peered":"2024-04-26T12:20:38.217915+0000","last_clean":"2024-04-26T12:20:38.217915+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:38.217915+0000","last_undegraded":"2024-04-26T12:20:38.217915+0000","last_fullsized":"2024-04-26T12:20:38.217915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_clean_scrub_stamp":"2024-04-26T12:20:38.217739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:53.024648+0000","scrub_duration":0.001837775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.345857+0000","last_change":"2024-04-26T12:21:02.345857+0000","last_active":"2024-04-26T12:21:02.345857+0000","last_peered":"2024-04-26T12:21:02.345857+0000","last_clean":"2024-04-26T12:21:02.345857+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:21:02.345857+0000","last_undegraded":"2024-04-26T12:21:02.345857+0000","last_fullsized":"2024-04-26T12:21:02.345857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.345738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:46.742649+0000","scrub_duration":0.0017828270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.947417+0000","last_change":"2024-04-26T12:21:27.947522+0000","last_active":"2024-04-26T12:21:27.947417+0000","last_peered":"2024-04-26T12:21:27.947417+0000","last_clean":"2024-04-26T12:21:27.947417+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:21:27.947417+0000","last_undegraded":"2024-04-26T12:21:27.947417+0000","last_fullsized":"2024-04-26T12:21:27.947417+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.947395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:02.048329+0000","scrub_duration":0.0020297980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.788962+0000","last_change":"2024-04-26T12:20:42.788962+0000","last_active":"2024-04-26T12:20:42.788962+0000","last_peered":"2024-04-26T12:20:42.788962+0000","last_clean":"2024-04-26T12:20:42.788962+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:42.788962+0000","last_undegraded":"2024-04-26T12:20:42.788962+0000","last_fullsized":"2024-04-26T12:20:42.788962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.788831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:48.051123+0000","scrub_duration":0.0018731360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:08.930400+0000","last_change":"2024-04-26T12:21:08.930526+0000","last_active":"2024-04-26T12:21:08.930400+0000","last_peered":"2024-04-26T12:21:08.930400+0000","last_clean":"2024-04-26T12:21:08.930400+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:21:08.930400+0000","last_undegraded":"2024-04-26T12:21:08.930400+0000","last_fullsized":"2024-04-26T12:21:08.930400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_clean_scrub_stamp":"2024-04-26T12:21:08.930381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:57.478621+0000","scrub_duration":0.0022001880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:40.742763+0000","last_change":"2024-04-26T12:21:40.742884+0000","last_active":"2024-04-26T12:21:40.742763+0000","last_peered":"2024-04-26T12:21:40.742763+0000","last_clean":"2024-04-26T12:21:40.742763+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:21:40.742763+0000","last_undegraded":"2024-04-26T12:21:40.742763+0000","last_fullsized":"2024-04-26T12:21:40.742763+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_clean_scrub_stamp":"2024-04-26T12:21:40.742726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:25.864637+0000","scrub_duration":0.001946726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.798092+0000","last_change":"2024-04-26T12:21:01.798203+0000","last_active":"2024-04-26T12:21:01.798092+0000","last_peered":"2024-04-26T12:21:01.798092+0000","last_clean":"2024-04-26T12:21:01.798092+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:21:01.798092+0000","last_undegraded":"2024-04-26T12:21:01.798092+0000","last_fullsized":"2024-04-26T12:21:01.798092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.798071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:26.107733+0000","scrub_duration":0.0017992150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.980665+0000","last_change":"2024-04-26T12:21:49.980795+0000","last_active":"2024-04-26T12:21:49.980665+0000","last_peered":"2024-04-26T12:21:49.980665+0000","last_clean":"2024-04-26T12:21:49.980665+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:21:49.980665+0000","last_undegraded":"2024-04-26T12:21:49.980665+0000","last_fullsized":"2024-04-26T12:21:49.980665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.980626+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:48.325677+0000","scrub_duration":0.0034005770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.927249+0000","last_change":"2024-04-26T12:21:29.927349+0000","last_active":"2024-04-26T12:21:29.927249+0000","last_peered":"2024-04-26T12:21:29.927249+0000","last_clean":"2024-04-26T12:21:29.927249+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:21:29.927249+0000","last_undegraded":"2024-04-26T12:21:29.927249+0000","last_fullsized":"2024-04-26T12:21:29.927249+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.927228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:13.697104+0000","scrub_duration":0.001694173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:39.239308+0000","last_change":"2024-04-26T12:20:39.239308+0000","last_active":"2024-04-26T12:20:39.239308+0000","last_peered":"2024-04-26T12:20:39.239308+0000","last_clean":"2024-04-26T12:20:39.239308+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:39.239308+0000","last_undegraded":"2024-04-26T12:20:39.239308+0000","last_fullsized":"2024-04-26T12:20:39.239308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_clean_scrub_stamp":"2024-04-26T12:20:39.239159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:05.765227+0000","scrub_duration":0.001927977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.019184+0000","last_change":"2024-04-26T12:21:49.019288+0000","last_active":"2024-04-26T12:21:49.019184+0000","last_peered":"2024-04-26T12:21:49.019184+0000","last_clean":"2024-04-26T12:21:49.019184+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:21:49.019184+0000","last_undegraded":"2024-04-26T12:21:49.019184+0000","last_fullsized":"2024-04-26T12:21:49.019184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.019162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:32.716076+0000","scrub_duration":0.0032590919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.628397+0000","last_change":"2024-04-26T12:21:20.628397+0000","last_active":"2024-04-26T12:21:20.628397+0000","last_peered":"2024-04-26T12:21:20.628397+0000","last_clean":"2024-04-26T12:21:20.628397+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:21:20.628397+0000","last_undegraded":"2024-04-26T12:21:20.628397+0000","last_fullsized":"2024-04-26T12:21:20.628397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.628273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:36.645398+0000","scrub_duration":0.001806247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.938858+0000","last_change":"2024-04-26T12:21:20.938983+0000","last_active":"2024-04-26T12:21:20.938858+0000","last_peered":"2024-04-26T12:21:20.938858+0000","last_clean":"2024-04-26T12:21:20.938858+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:21:20.938858+0000","last_undegraded":"2024-04-26T12:21:20.938858+0000","last_fullsized":"2024-04-26T12:21:20.938858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.938837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:40.130354+0000","scrub_duration":0.001772615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.298753+0000","last_change":"2024-04-26T12:21:36.298863+0000","last_active":"2024-04-26T12:21:36.298753+0000","last_peered":"2024-04-26T12:21:36.298753+0000","last_clean":"2024-04-26T12:21:36.298753+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:21:36.298753+0000","last_undegraded":"2024-04-26T12:21:36.298753+0000","last_fullsized":"2024-04-26T12:21:36.298753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.298732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:04.694417+0000","scrub_duration":0.0016097329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.286787+0000","last_change":"2024-04-26T12:21:44.286929+0000","last_active":"2024-04-26T12:21:44.286787+0000","last_peered":"2024-04-26T12:21:44.286787+0000","last_clean":"2024-04-26T12:21:44.286787+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:21:44.286787+0000","last_undegraded":"2024-04-26T12:21:44.286787+0000","last_fullsized":"2024-04-26T12:21:44.286787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.286751+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:41.216976+0000","scrub_duration":0.0052196680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.046248+0000","last_change":"2024-04-26T12:21:02.046248+0000","last_active":"2024-04-26T12:21:02.046248+0000","last_peered":"2024-04-26T12:21:02.046248+0000","last_clean":"2024-04-26T12:21:02.046248+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:21:02.046248+0000","last_undegraded":"2024-04-26T12:21:02.046248+0000","last_fullsized":"2024-04-26T12:21:02.046248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.046099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:02.071804+0000","scrub_duration":0.0017987509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:43.763333+0000","last_change":"2024-04-26T12:21:43.763333+0000","last_active":"2024-04-26T12:21:43.763333+0000","last_peered":"2024-04-26T12:21:43.763333+0000","last_clean":"2024-04-26T12:21:43.763333+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:21:43.763333+0000","last_undegraded":"2024-04-26T12:21:43.763333+0000","last_fullsized":"2024-04-26T12:21:43.763333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_clean_scrub_stamp":"2024-04-26T12:21:43.763181+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:50.040543+0000","scrub_duration":0.0039017230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:14.537563+0000","last_change":"2024-04-26T12:21:14.537700+0000","last_active":"2024-04-26T12:21:14.537563+0000","last_peered":"2024-04-26T12:21:14.537563+0000","last_clean":"2024-04-26T12:21:14.537563+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:21:14.537563+0000","last_undegraded":"2024-04-26T12:21:14.537563+0000","last_fullsized":"2024-04-26T12:21:14.537563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_clean_scrub_stamp":"2024-04-26T12:21:14.537541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:35.164328+0000","scrub_duration":0.001714157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.062080+0000","last_change":"2024-04-26T12:20:53.062080+0000","last_active":"2024-04-26T12:20:53.062080+0000","last_peered":"2024-04-26T12:20:53.062080+0000","last_clean":"2024-04-26T12:20:53.062080+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:53.062080+0000","last_undegraded":"2024-04-26T12:20:53.062080+0000","last_fullsized":"2024-04-26T12:20:53.062080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.061955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:36.090188+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.148696+0000","last_change":"2024-04-26T12:20:45.148696+0000","last_active":"2024-04-26T12:20:45.148696+0000","last_peered":"2024-04-26T12:20:45.148696+0000","last_clean":"2024-04-26T12:20:45.148696+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:45.148696+0000","last_undegraded":"2024-04-26T12:20:45.148696+0000","last_fullsized":"2024-04-26T12:20:45.148696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.148548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.383636+0000","scrub_duration":0.0018031029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:49.111929+0000","last_change":"2024-04-26T12:20:49.111929+0000","last_active":"2024-04-26T12:20:49.111929+0000","last_peered":"2024-04-26T12:20:49.111929+0000","last_clean":"2024-04-26T12:20:49.111929+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:49.111929+0000","last_undegraded":"2024-04-26T12:20:49.111929+0000","last_fullsized":"2024-04-26T12:20:49.111929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_clean_scrub_stamp":"2024-04-26T12:20:49.111806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:18.633109+0000","scrub_duration":0.0015728319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:55.873745+0000","last_change":"2024-04-26T12:20:55.873745+0000","last_active":"2024-04-26T12:20:55.873745+0000","last_peered":"2024-04-26T12:20:55.873745+0000","last_clean":"2024-04-26T12:20:55.873745+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:55.873745+0000","last_undegraded":"2024-04-26T12:20:55.873745+0000","last_fullsized":"2024-04-26T12:20:55.873745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_clean_scrub_stamp":"2024-04-26T12:20:55.873506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:35.165043+0000","scrub_duration":0.069253721000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:23.973578+0000","last_change":"2024-04-26T12:21:23.973578+0000","last_active":"2024-04-26T12:21:23.973578+0000","last_peered":"2024-04-26T12:21:23.973578+0000","last_clean":"2024-04-26T12:21:23.973578+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:21:23.973578+0000","last_undegraded":"2024-04-26T12:21:23.973578+0000","last_fullsized":"2024-04-26T12:21:23.973578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_clean_scrub_stamp":"2024-04-26T12:21:23.973458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:16.098425+0000","scrub_duration":0.001902541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.267347+0000","last_change":"2024-04-26T12:20:37.267347+0000","last_active":"2024-04-26T12:20:37.267347+0000","last_peered":"2024-04-26T12:20:37.267347+0000","last_clean":"2024-04-26T12:20:37.267347+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:37.267347+0000","last_undegraded":"2024-04-26T12:20:37.267347+0000","last_fullsized":"2024-04-26T12:20:37.267347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.267215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:21.882383+0000","scrub_duration":0.0018490620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.010072+0000","last_change":"2024-04-26T12:21:01.010072+0000","last_active":"2024-04-26T12:21:01.010072+0000","last_peered":"2024-04-26T12:21:01.010072+0000","last_clean":"2024-04-26T12:21:01.010072+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:21:01.010072+0000","last_undegraded":"2024-04-26T12:21:01.010072+0000","last_fullsized":"2024-04-26T12:21:01.010072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.009933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:20.201451+0000","scrub_duration":0.0018985370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:35.734685+0000","last_change":"2024-04-26T12:21:35.734685+0000","last_active":"2024-04-26T12:21:35.734685+0000","last_peered":"2024-04-26T12:21:35.734685+0000","last_clean":"2024-04-26T12:21:35.734685+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:21:35.734685+0000","last_undegraded":"2024-04-26T12:21:35.734685+0000","last_fullsized":"2024-04-26T12:21:35.734685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_clean_scrub_stamp":"2024-04-26T12:21:35.734571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:20.757460+0000","scrub_duration":0.0018119519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":91,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:41.754671+0000","last_change":"2024-04-26T12:21:41.754671+0000","last_active":"2024-04-26T12:21:41.754671+0000","last_peered":"2024-04-26T12:21:41.754671+0000","last_clean":"2024-04-26T12:21:41.754671+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:21:41.754671+0000","last_undegraded":"2024-04-26T12:21:41.754671+0000","last_fullsized":"2024-04-26T12:21:41.754671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_clean_scrub_stamp":"2024-04-26T12:21:41.754524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:50.022019+0000","scrub_duration":0.0017813410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:00.945941+0000","last_change":"2024-04-26T12:22:00.945941+0000","last_active":"2024-04-26T12:22:00.945941+0000","last_peered":"2024-04-26T12:22:00.945941+0000","last_clean":"2024-04-26T12:22:00.945941+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:22:00.945941+0000","last_undegraded":"2024-04-26T12:22:00.945941+0000","last_fullsized":"2024-04-26T12:22:00.945941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:00.945758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:00.945758+0000","last_clean_scrub_stamp":"2024-04-26T12:22:00.945758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:31.118414+0000","scrub_duration":0.0016528490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.781607+0000","last_change":"2024-04-26T12:21:45.781607+0000","last_active":"2024-04-26T12:21:45.781607+0000","last_peered":"2024-04-26T12:21:45.781607+0000","last_clean":"2024-04-26T12:21:45.781607+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:21:45.781607+0000","last_undegraded":"2024-04-26T12:21:45.781607+0000","last_fullsized":"2024-04-26T12:21:45.781607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.781441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:10.599270+0000","scrub_duration":0.0018896659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:55.235575+0000","last_change":"2024-04-26T12:21:55.235679+0000","last_active":"2024-04-26T12:21:55.235575+0000","last_peered":"2024-04-26T12:21:55.235575+0000","last_clean":"2024-04-26T12:21:55.235575+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:21:55.235575+0000","last_undegraded":"2024-04-26T12:21:55.235575+0000","last_fullsized":"2024-04-26T12:21:55.235575+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:55.235555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:55.235555+0000","last_clean_scrub_stamp":"2024-04-26T12:21:55.235555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:56.584254+0000","scrub_duration":0.022038149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.306612+0000","last_change":"2024-04-26T12:21:01.306715+0000","last_active":"2024-04-26T12:21:01.306612+0000","last_peered":"2024-04-26T12:21:01.306612+0000","last_clean":"2024-04-26T12:21:01.306612+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:21:01.306612+0000","last_undegraded":"2024-04-26T12:21:01.306612+0000","last_fullsized":"2024-04-26T12:21:01.306612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.306592+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:51.007517+0000","scrub_duration":0.003604196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:01.085593+0000","last_change":"2024-04-26T12:22:01.085691+0000","last_active":"2024-04-26T12:22:01.085593+0000","last_peered":"2024-04-26T12:22:01.085593+0000","last_clean":"2024-04-26T12:22:01.085593+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:22:01.085593+0000","last_undegraded":"2024-04-26T12:22:01.085593+0000","last_fullsized":"2024-04-26T12:22:01.085593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:01.085572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:01.085572+0000","last_clean_scrub_stamp":"2024-04-26T12:22:01.085572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:17.660371+0000","scrub_duration":0.002072618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:34.783753+0000","last_change":"2024-04-26T12:21:34.783753+0000","last_active":"2024-04-26T12:21:34.783753+0000","last_peered":"2024-04-26T12:21:34.783753+0000","last_clean":"2024-04-26T12:21:34.783753+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:21:34.783753+0000","last_undegraded":"2024-04-26T12:21:34.783753+0000","last_fullsized":"2024-04-26T12:21:34.783753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_clean_scrub_stamp":"2024-04-26T12:21:34.783633+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:31.032530+0000","scrub_duration":0.0033859229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.922084+0000","last_change":"2024-04-26T12:21:19.922084+0000","last_active":"2024-04-26T12:21:19.922084+0000","last_peered":"2024-04-26T12:21:19.922084+0000","last_clean":"2024-04-26T12:21:19.922084+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:21:19.922084+0000","last_undegraded":"2024-04-26T12:21:19.922084+0000","last_fullsized":"2024-04-26T12:21:19.922084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.921926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:07.112057+0000","scrub_duration":0.020713793000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.113455+0000","last_change":"2024-04-26T12:20:51.113577+0000","last_active":"2024-04-26T12:20:51.113455+0000","last_peered":"2024-04-26T12:20:51.113455+0000","last_clean":"2024-04-26T12:20:51.113455+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:51.113455+0000","last_undegraded":"2024-04-26T12:20:51.113455+0000","last_fullsized":"2024-04-26T12:20:51.113455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.113432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:11.752649+0000","scrub_duration":0.0017589649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.269911+0000","last_change":"2024-04-26T12:20:59.270025+0000","last_active":"2024-04-26T12:20:59.269911+0000","last_peered":"2024-04-26T12:20:59.269911+0000","last_clean":"2024-04-26T12:20:59.269911+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:59.269911+0000","last_undegraded":"2024-04-26T12:20:59.269911+0000","last_fullsized":"2024-04-26T12:20:59.269911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.269890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:50.740249+0000","scrub_duration":0.0016247309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.241925+0000","last_change":"2024-04-26T12:20:42.241925+0000","last_active":"2024-04-26T12:20:42.241925+0000","last_peered":"2024-04-26T12:20:42.241925+0000","last_clean":"2024-04-26T12:20:42.241925+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:42.241925+0000","last_undegraded":"2024-04-26T12:20:42.241925+0000","last_fullsized":"2024-04-26T12:20:42.241925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.241764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:44.362930+0000","scrub_duration":0.0044497909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738467,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321308,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050532,"statfs":{"total":96636764160,"available":96307744768,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:21:58 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47999999999999998,"15min":0.40400000000000003},"min":{"1min":0.28000000000000003,"5min":0.19,"15min":0.17899999999999999},"max":{"1min":0.626,"5min":0.871,"15min":0.871},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46700000000000003,"15min":0.42999999999999999},"min":{"1min":0.30199999999999999,"5min":0.19800000000000001,"15min":0.192},"max":{"1min":0.53600000000000003,"5min":0.88400000000000001,"15min":0.92900000000000005},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:22:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.47099999999999997}]}]},{"osd":1,"up_from":74,"seq":317827579932,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:22:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.33700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"min":{"1min":0.35299999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:22:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.48399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483144,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888696,"statfs":{"total":96636764160,"available":96142024704,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:22:27 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.51400000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.46500000000000002,"15min":0.46899999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57799999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.436}]},{"osd":2,"last update":"Fri Apr 26 12:21:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45900000000000002,"15min":0.377},"min":{"1min":0.34799999999999998,"5min":0.191,"15min":0.161},"max":{"1min":0.59899999999999998,"5min":0.65300000000000002,"15min":0.92200000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.185},"max":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.879},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:22:37.619 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:37.619 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:37.620 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:37.620 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:14:41.505865+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=41, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:37.620 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:37.620 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:14:42.510472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=14, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:22:37.621 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:22:57.622 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:22:57.917 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:22:57.919 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-26T12:22:57.927 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-04-26T12:22:56.558895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":834444,"kb_used_data":3700,"kb_used_omap":11,"kb_used_meta":830708,"kb_avail":282281076,"statfs":{"total":289910292480,"available":289055821824,"internally_reserved":0,"allocated":3788800,"data_stored":2209701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11935,"internal_metadata":850645345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003568"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.028568+0000","last_change":"2024-04-26T12:22:07.028769+0000","last_active":"2024-04-26T12:22:07.028568+0000","last_peered":"2024-04-26T12:22:07.028568+0000","last_clean":"2024-04-26T12:22:07.028568+0000","last_became_active":"2024-04-26T12:14:42.868160+0000","last_became_peered":"2024-04-26T12:14:42.868160+0000","last_unstale":"2024-04-26T12:22:07.028568+0000","last_undegraded":"2024-04-26T12:22:07.028568+0000","last_fullsized":"2024-04-26T12:22:07.028568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.028533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.028533+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.028533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:03.368476+0000","scrub_duration":0.093946051000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:19.008249+0000","last_change":"2024-04-26T12:22:19.008387+0000","last_active":"2024-04-26T12:22:19.008249+0000","last_peered":"2024-04-26T12:22:19.008249+0000","last_clean":"2024-04-26T12:22:19.008249+0000","last_became_active":"2024-04-26T12:14:42.867597+0000","last_became_peered":"2024-04-26T12:14:42.867597+0000","last_unstale":"2024-04-26T12:22:19.008249+0000","last_undegraded":"2024-04-26T12:22:19.008249+0000","last_fullsized":"2024-04-26T12:22:19.008249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:19.008196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:19.008196+0000","last_clean_scrub_stamp":"2024-04-26T12:22:19.008196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:14.918088+0000","scrub_duration":0.0016858260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:49.317985+0000","last_change":"2024-04-26T12:22:49.318080+0000","last_active":"2024-04-26T12:22:49.317985+0000","last_peered":"2024-04-26T12:22:49.317985+0000","last_clean":"2024-04-26T12:22:49.317985+0000","last_became_active":"2024-04-26T12:20:25.665143+0000","last_became_peered":"2024-04-26T12:20:25.665143+0000","last_unstale":"2024-04-26T12:22:49.317985+0000","last_undegraded":"2024-04-26T12:22:49.317985+0000","last_fullsized":"2024-04-26T12:22:49.317985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:49.317963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:49.317963+0000","last_clean_scrub_stamp":"2024-04-26T12:22:49.317963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:04.769656+0000","scrub_duration":0.0020534360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:57.265567+0000","last_change":"2024-04-26T12:20:57.265567+0000","last_active":"2024-04-26T12:20:57.265567+0000","last_peered":"2024-04-26T12:20:57.265567+0000","last_clean":"2024-04-26T12:20:57.265567+0000","last_became_active":"2024-04-26T12:20:25.660478+0000","last_became_peered":"2024-04-26T12:20:25.660478+0000","last_unstale":"2024-04-26T12:20:57.265567+0000","last_undegraded":"2024-04-26T12:20:57.265567+0000","last_fullsized":"2024-04-26T12:20:57.265567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:57.265416+0000","last_clean_scrub_stamp":"2024-04-26T12:20:57.265416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:34.758945+0000","scrub_duration":0.0019165709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:03.872380+0000","last_change":"2024-04-26T12:21:03.872380+0000","last_active":"2024-04-26T12:21:03.872380+0000","last_peered":"2024-04-26T12:21:03.872380+0000","last_clean":"2024-04-26T12:21:03.872380+0000","last_became_active":"2024-04-26T12:14:42.868579+0000","last_became_peered":"2024-04-26T12:14:42.868579+0000","last_unstale":"2024-04-26T12:21:03.872380+0000","last_undegraded":"2024-04-26T12:21:03.872380+0000","last_fullsized":"2024-04-26T12:21:03.872380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:03.872236+0000","last_clean_scrub_stamp":"2024-04-26T12:21:03.872236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.873602+0000","scrub_duration":0.021825418999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:39.279942+0000","last_change":"2024-04-26T12:21:39.279942+0000","last_active":"2024-04-26T12:21:39.279942+0000","last_peered":"2024-04-26T12:21:39.279942+0000","last_clean":"2024-04-26T12:21:39.279942+0000","last_became_active":"2024-04-26T12:20:25.662449+0000","last_became_peered":"2024-04-26T12:20:25.662449+0000","last_unstale":"2024-04-26T12:21:39.279942+0000","last_undegraded":"2024-04-26T12:21:39.279942+0000","last_fullsized":"2024-04-26T12:21:39.279942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:39.279789+0000","last_clean_scrub_stamp":"2024-04-26T12:21:39.279789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:40.481707+0000","scrub_duration":0.0020338550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.205187+0000","last_change":"2024-04-26T12:21:56.205187+0000","last_active":"2024-04-26T12:21:56.205187+0000","last_peered":"2024-04-26T12:21:56.205187+0000","last_clean":"2024-04-26T12:21:56.205187+0000","last_became_active":"2024-04-26T12:20:25.658781+0000","last_became_peered":"2024-04-26T12:20:25.658781+0000","last_unstale":"2024-04-26T12:21:56.205187+0000","last_undegraded":"2024-04-26T12:21:56.205187+0000","last_fullsized":"2024-04-26T12:21:56.205187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.205068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.205068+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.205068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:58.755685+0000","scrub_duration":0.020726391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:53.219691+0000","last_change":"2024-04-26T12:21:53.219691+0000","last_active":"2024-04-26T12:21:53.219691+0000","last_peered":"2024-04-26T12:21:53.219691+0000","last_clean":"2024-04-26T12:21:53.219691+0000","last_became_active":"2024-04-26T12:20:25.662264+0000","last_became_peered":"2024-04-26T12:20:25.662264+0000","last_unstale":"2024-04-26T12:21:53.219691+0000","last_undegraded":"2024-04-26T12:21:53.219691+0000","last_fullsized":"2024-04-26T12:21:53.219691+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:53.219526+0000","last_clean_scrub_stamp":"2024-04-26T12:21:53.219526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:11.285479+0000","scrub_duration":0.001588772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:13.867897+0000","last_change":"2024-04-26T12:22:13.868058+0000","last_active":"2024-04-26T12:22:13.867897+0000","last_peered":"2024-04-26T12:22:13.867897+0000","last_clean":"2024-04-26T12:22:13.867897+0000","last_became_active":"2024-04-26T12:14:42.867473+0000","last_became_peered":"2024-04-26T12:14:42.867473+0000","last_unstale":"2024-04-26T12:22:13.867897+0000","last_undegraded":"2024-04-26T12:22:13.867897+0000","last_fullsized":"2024-04-26T12:22:13.867897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:13.867877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:13.867877+0000","last_clean_scrub_stamp":"2024-04-26T12:22:13.867877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.011584+0000","scrub_duration":0.036397444000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.790658+0000","last_change":"2024-04-26T12:20:41.790658+0000","last_active":"2024-04-26T12:20:41.790658+0000","last_peered":"2024-04-26T12:20:41.790658+0000","last_clean":"2024-04-26T12:20:41.790658+0000","last_became_active":"2024-04-26T12:14:42.867771+0000","last_became_peered":"2024-04-26T12:14:42.867771+0000","last_unstale":"2024-04-26T12:20:41.790658+0000","last_undegraded":"2024-04-26T12:20:41.790658+0000","last_fullsized":"2024-04-26T12:20:41.790658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.790495+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.790495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:52.175594+0000","scrub_duration":0.0019401209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.379199+0000","last_change":"2024-04-26T12:21:29.379199+0000","last_active":"2024-04-26T12:21:29.379199+0000","last_peered":"2024-04-26T12:21:29.379199+0000","last_clean":"2024-04-26T12:21:29.379199+0000","last_became_active":"2024-04-26T12:20:25.662607+0000","last_became_peered":"2024-04-26T12:20:25.662607+0000","last_unstale":"2024-04-26T12:21:29.379199+0000","last_undegraded":"2024-04-26T12:21:29.379199+0000","last_fullsized":"2024-04-26T12:21:29.379199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.379071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.379071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.183371+0000","scrub_duration":0.020900218000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:10.988729+0000","last_change":"2024-04-26T12:22:10.988834+0000","last_active":"2024-04-26T12:22:10.988729+0000","last_peered":"2024-04-26T12:22:10.988729+0000","last_clean":"2024-04-26T12:22:10.988729+0000","last_became_active":"2024-04-26T12:20:25.659660+0000","last_became_peered":"2024-04-26T12:20:25.659660+0000","last_unstale":"2024-04-26T12:22:10.988729+0000","last_undegraded":"2024-04-26T12:22:10.988729+0000","last_fullsized":"2024-04-26T12:22:10.988729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:10.988705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:10.988705+0000","last_clean_scrub_stamp":"2024-04-26T12:22:10.988705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:53.867995+0000","scrub_duration":0.0018000850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:02.969436+0000","last_change":"2024-04-26T12:22:02.969548+0000","last_active":"2024-04-26T12:22:02.969436+0000","last_peered":"2024-04-26T12:22:02.969436+0000","last_clean":"2024-04-26T12:22:02.969436+0000","last_became_active":"2024-04-26T12:14:42.868009+0000","last_became_peered":"2024-04-26T12:14:42.868009+0000","last_unstale":"2024-04-26T12:22:02.969436+0000","last_undegraded":"2024-04-26T12:22:02.969436+0000","last_fullsized":"2024-04-26T12:22:02.969436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:02.969417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:02.969417+0000","last_clean_scrub_stamp":"2024-04-26T12:22:02.969417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:21.464136+0000","scrub_duration":0.0209908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:32.386234+0000","last_change":"2024-04-26T12:21:32.386234+0000","last_active":"2024-04-26T12:21:32.386234+0000","last_peered":"2024-04-26T12:21:32.386234+0000","last_clean":"2024-04-26T12:21:32.386234+0000","last_became_active":"2024-04-26T12:20:25.660636+0000","last_became_peered":"2024-04-26T12:20:25.660636+0000","last_unstale":"2024-04-26T12:21:32.386234+0000","last_undegraded":"2024-04-26T12:21:32.386234+0000","last_fullsized":"2024-04-26T12:21:32.386234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:32.386115+0000","last_clean_scrub_stamp":"2024-04-26T12:21:32.386115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:35.046547+0000","scrub_duration":0.0017283579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:04.377824+0000","last_change":"2024-04-26T12:21:04.377824+0000","last_active":"2024-04-26T12:21:04.377824+0000","last_peered":"2024-04-26T12:21:04.377824+0000","last_clean":"2024-04-26T12:21:04.377824+0000","last_became_active":"2024-04-26T12:20:25.657825+0000","last_became_peered":"2024-04-26T12:20:25.657825+0000","last_unstale":"2024-04-26T12:21:04.377824+0000","last_undegraded":"2024-04-26T12:21:04.377824+0000","last_fullsized":"2024-04-26T12:21:04.377824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:04.377697+0000","last_clean_scrub_stamp":"2024-04-26T12:21:04.377697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.199940+0000","scrub_duration":0.0019611149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:41.220047+0000","last_change":"2024-04-26T12:20:41.220047+0000","last_active":"2024-04-26T12:20:41.220047+0000","last_peered":"2024-04-26T12:20:41.220047+0000","last_clean":"2024-04-26T12:20:41.220047+0000","last_became_active":"2024-04-26T12:20:25.662348+0000","last_became_peered":"2024-04-26T12:20:25.662348+0000","last_unstale":"2024-04-26T12:20:41.220047+0000","last_undegraded":"2024-04-26T12:20:41.220047+0000","last_fullsized":"2024-04-26T12:20:41.220047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:41.219912+0000","last_clean_scrub_stamp":"2024-04-26T12:20:41.219912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:44.836560+0000","scrub_duration":0.001961516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:10.912751+0000","last_change":"2024-04-26T12:22:10.912859+0000","last_active":"2024-04-26T12:22:10.912751+0000","last_peered":"2024-04-26T12:22:10.912751+0000","last_clean":"2024-04-26T12:22:10.912751+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:22:10.912751+0000","last_undegraded":"2024-04-26T12:22:10.912751+0000","last_fullsized":"2024-04-26T12:22:10.912751+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:10.912731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:10.912731+0000","last_clean_scrub_stamp":"2024-04-26T12:22:10.912731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:00.102782+0000","scrub_duration":0.10408954600000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:52.790151+0000","last_change":"2024-04-26T12:20:52.790151+0000","last_active":"2024-04-26T12:20:52.790151+0000","last_peered":"2024-04-26T12:20:52.790151+0000","last_clean":"2024-04-26T12:20:52.790151+0000","last_became_active":"2024-04-26T12:14:42.869391+0000","last_became_peered":"2024-04-26T12:14:42.869391+0000","last_unstale":"2024-04-26T12:20:52.790151+0000","last_undegraded":"2024-04-26T12:20:52.790151+0000","last_fullsized":"2024-04-26T12:20:52.790151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:52.790025+0000","last_clean_scrub_stamp":"2024-04-26T12:20:52.790025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:37.405193+0000","scrub_duration":0.0021779400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:11.869992+0000","last_change":"2024-04-26T12:22:11.870118+0000","last_active":"2024-04-26T12:22:11.869992+0000","last_peered":"2024-04-26T12:22:11.869992+0000","last_clean":"2024-04-26T12:22:11.869992+0000","last_became_active":"2024-04-26T12:14:42.866642+0000","last_became_peered":"2024-04-26T12:14:42.866642+0000","last_unstale":"2024-04-26T12:22:11.869992+0000","last_undegraded":"2024-04-26T12:22:11.869992+0000","last_fullsized":"2024-04-26T12:22:11.869992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:11.869969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:11.869969+0000","last_clean_scrub_stamp":"2024-04-26T12:22:11.869969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:34.740124+0000","scrub_duration":0.038021049000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:43.386581+0000","last_change":"2024-04-26T12:22:43.386714+0000","last_active":"2024-04-26T12:22:43.386581+0000","last_peered":"2024-04-26T12:22:43.386581+0000","last_clean":"2024-04-26T12:22:43.386581+0000","last_became_active":"2024-04-26T12:20:25.663395+0000","last_became_peered":"2024-04-26T12:20:25.663395+0000","last_unstale":"2024-04-26T12:22:43.386581+0000","last_undegraded":"2024-04-26T12:22:43.386581+0000","last_fullsized":"2024-04-26T12:22:43.386581+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:43.386562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:43.386562+0000","last_clean_scrub_stamp":"2024-04-26T12:22:43.386562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:58.027451+0000","scrub_duration":0.0016049829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:17.676291+0000","last_change":"2024-04-26T12:21:17.676291+0000","last_active":"2024-04-26T12:21:17.676291+0000","last_peered":"2024-04-26T12:21:17.676291+0000","last_clean":"2024-04-26T12:21:17.676291+0000","last_became_active":"2024-04-26T12:20:25.664470+0000","last_became_peered":"2024-04-26T12:20:25.664470+0000","last_unstale":"2024-04-26T12:21:17.676291+0000","last_undegraded":"2024-04-26T12:21:17.676291+0000","last_fullsized":"2024-04-26T12:21:17.676291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:17.676137+0000","last_clean_scrub_stamp":"2024-04-26T12:21:17.676137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:03.477865+0000","scrub_duration":0.022895645999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.955655+0000","last_change":"2024-04-26T12:22:07.955819+0000","last_active":"2024-04-26T12:22:07.955655+0000","last_peered":"2024-04-26T12:22:07.955655+0000","last_clean":"2024-04-26T12:22:07.955655+0000","last_became_active":"2024-04-26T12:20:25.664119+0000","last_became_peered":"2024-04-26T12:20:25.664119+0000","last_unstale":"2024-04-26T12:22:07.955655+0000","last_undegraded":"2024-04-26T12:22:07.955655+0000","last_fullsized":"2024-04-26T12:22:07.955655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.955633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.955633+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.955633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:04.665590+0000","scrub_duration":0.0021521180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:08.819222+0000","last_change":"2024-04-26T12:22:08.819318+0000","last_active":"2024-04-26T12:22:08.819222+0000","last_peered":"2024-04-26T12:22:08.819222+0000","last_clean":"2024-04-26T12:22:08.819222+0000","last_became_active":"2024-04-26T12:20:25.656876+0000","last_became_peered":"2024-04-26T12:20:25.656876+0000","last_unstale":"2024-04-26T12:22:08.819222+0000","last_undegraded":"2024-04-26T12:22:08.819222+0000","last_fullsized":"2024-04-26T12:22:08.819222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:08.819198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:08.819198+0000","last_clean_scrub_stamp":"2024-04-26T12:22:08.819198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:24.196455+0000","scrub_duration":0.001676493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.930881+0000","last_change":"2024-04-26T12:21:56.930998+0000","last_active":"2024-04-26T12:21:56.930881+0000","last_peered":"2024-04-26T12:21:56.930881+0000","last_clean":"2024-04-26T12:21:56.930881+0000","last_became_active":"2024-04-26T12:14:42.863233+0000","last_became_peered":"2024-04-26T12:14:42.863233+0000","last_unstale":"2024-04-26T12:21:56.930881+0000","last_undegraded":"2024-04-26T12:21:56.930881+0000","last_fullsized":"2024-04-26T12:21:56.930881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.930860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.930860+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.930860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:22.433096+0000","scrub_duration":0.0016250489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.813170+0000","last_change":"2024-04-26T12:21:27.813304+0000","last_active":"2024-04-26T12:21:27.813170+0000","last_peered":"2024-04-26T12:21:27.813170+0000","last_clean":"2024-04-26T12:21:27.813170+0000","last_became_active":"2024-04-26T12:20:25.658552+0000","last_became_peered":"2024-04-26T12:20:25.658552+0000","last_unstale":"2024-04-26T12:21:27.813170+0000","last_undegraded":"2024-04-26T12:21:27.813170+0000","last_fullsized":"2024-04-26T12:21:27.813170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.813147+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.813147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:16.361388+0000","scrub_duration":0.023876636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.835199+0000","last_change":"2024-04-26T12:22:07.835305+0000","last_active":"2024-04-26T12:22:07.835199+0000","last_peered":"2024-04-26T12:22:07.835199+0000","last_clean":"2024-04-26T12:22:07.835199+0000","last_became_active":"2024-04-26T12:20:25.657369+0000","last_became_peered":"2024-04-26T12:20:25.657369+0000","last_unstale":"2024-04-26T12:22:07.835199+0000","last_undegraded":"2024-04-26T12:22:07.835199+0000","last_fullsized":"2024-04-26T12:22:07.835199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:07.835177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:07.835177+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.835177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:03.745069+0000","scrub_duration":0.002013754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:44.366013+0000","last_change":"2024-04-26T12:22:44.366126+0000","last_active":"2024-04-26T12:22:44.366013+0000","last_peered":"2024-04-26T12:22:44.366013+0000","last_clean":"2024-04-26T12:22:44.366013+0000","last_became_active":"2024-04-26T12:20:25.663920+0000","last_became_peered":"2024-04-26T12:20:25.663920+0000","last_unstale":"2024-04-26T12:22:44.366013+0000","last_undegraded":"2024-04-26T12:22:44.366013+0000","last_fullsized":"2024-04-26T12:22:44.366013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:44.365993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:44.365993+0000","last_clean_scrub_stamp":"2024-04-26T12:22:44.365993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:52.147230+0000","scrub_duration":0.001489427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.808505+0000","last_change":"2024-04-26T12:20:59.808505+0000","last_active":"2024-04-26T12:20:59.808505+0000","last_peered":"2024-04-26T12:20:59.808505+0000","last_clean":"2024-04-26T12:20:59.808505+0000","last_became_active":"2024-04-26T12:20:25.664829+0000","last_became_peered":"2024-04-26T12:20:25.664829+0000","last_unstale":"2024-04-26T12:20:59.808505+0000","last_undegraded":"2024-04-26T12:20:59.808505+0000","last_fullsized":"2024-04-26T12:20:59.808505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.808367+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.808367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:01.929534+0000","scrub_duration":0.002171816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:59.966971+0000","last_change":"2024-04-26T12:21:59.967089+0000","last_active":"2024-04-26T12:21:59.966971+0000","last_peered":"2024-04-26T12:21:59.966971+0000","last_clean":"2024-04-26T12:21:59.966971+0000","last_became_active":"2024-04-26T12:14:42.865084+0000","last_became_peered":"2024-04-26T12:14:42.865084+0000","last_unstale":"2024-04-26T12:21:59.966971+0000","last_undegraded":"2024-04-26T12:21:59.966971+0000","last_fullsized":"2024-04-26T12:21:59.966971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:59.966927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:59.966927+0000","last_clean_scrub_stamp":"2024-04-26T12:21:59.966927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:42.846217+0000","scrub_duration":0.038480333999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:13.806551+0000","last_change":"2024-04-26T12:21:13.806657+0000","last_active":"2024-04-26T12:21:13.806551+0000","last_peered":"2024-04-26T12:21:13.806551+0000","last_clean":"2024-04-26T12:21:13.806551+0000","last_became_active":"2024-04-26T12:20:25.658547+0000","last_became_peered":"2024-04-26T12:20:25.658547+0000","last_unstale":"2024-04-26T12:21:13.806551+0000","last_undegraded":"2024-04-26T12:21:13.806551+0000","last_fullsized":"2024-04-26T12:21:13.806551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:13.806530+0000","last_clean_scrub_stamp":"2024-04-26T12:21:13.806530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:56.319084+0000","scrub_duration":0.0017893570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:56.003640+0000","last_change":"2024-04-26T12:21:56.003766+0000","last_active":"2024-04-26T12:21:56.003640+0000","last_peered":"2024-04-26T12:21:56.003640+0000","last_clean":"2024-04-26T12:21:56.003640+0000","last_became_active":"2024-04-26T12:14:42.867175+0000","last_became_peered":"2024-04-26T12:14:42.867175+0000","last_unstale":"2024-04-26T12:21:56.003640+0000","last_undegraded":"2024-04-26T12:21:56.003640+0000","last_fullsized":"2024-04-26T12:21:56.003640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:56.003619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:56.003619+0000","last_clean_scrub_stamp":"2024-04-26T12:21:56.003619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:58.633567+0000","scrub_duration":0.001618424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:29.262783+0000","last_change":"2024-04-26T12:22:29.262892+0000","last_active":"2024-04-26T12:22:29.262783+0000","last_peered":"2024-04-26T12:22:29.262783+0000","last_clean":"2024-04-26T12:22:29.262783+0000","last_became_active":"2024-04-26T12:20:25.658285+0000","last_became_peered":"2024-04-26T12:20:25.658285+0000","last_unstale":"2024-04-26T12:22:29.262783+0000","last_undegraded":"2024-04-26T12:22:29.262783+0000","last_fullsized":"2024-04-26T12:22:29.262783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:29.262763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:29.262763+0000","last_clean_scrub_stamp":"2024-04-26T12:22:29.262763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:16.971662+0000","scrub_duration":0.0019073429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:05.803095+0000","last_change":"2024-04-26T12:21:05.803095+0000","last_active":"2024-04-26T12:21:05.803095+0000","last_peered":"2024-04-26T12:21:05.803095+0000","last_clean":"2024-04-26T12:21:05.803095+0000","last_became_active":"2024-04-26T12:14:42.867898+0000","last_became_peered":"2024-04-26T12:14:42.867898+0000","last_unstale":"2024-04-26T12:21:05.803095+0000","last_undegraded":"2024-04-26T12:21:05.803095+0000","last_fullsized":"2024-04-26T12:21:05.803095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:05.802954+0000","last_clean_scrub_stamp":"2024-04-26T12:21:05.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:22.222434+0000","scrub_duration":0.0018232630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"79'4","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:18.232212+0000","last_change":"2024-04-26T12:22:18.232212+0000","last_active":"2024-04-26T12:22:18.232212+0000","last_peered":"2024-04-26T12:22:18.232212+0000","last_clean":"2024-04-26T12:22:18.232212+0000","last_became_active":"2024-04-26T12:20:25.663959+0000","last_became_peered":"2024-04-26T12:20:25.663959+0000","last_unstale":"2024-04-26T12:22:18.232212+0000","last_undegraded":"2024-04-26T12:22:18.232212+0000","last_fullsized":"2024-04-26T12:22:18.232212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-26T12:22:18.232080+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-26T12:22:18.232080+0000","last_clean_scrub_stamp":"2024-04-26T12:22:18.232080+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:48.758491+0000","scrub_duration":0.0037899420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.778599+0000","last_change":"2024-04-26T12:20:53.778599+0000","last_active":"2024-04-26T12:20:53.778599+0000","last_peered":"2024-04-26T12:20:53.778599+0000","last_clean":"2024-04-26T12:20:53.778599+0000","last_became_active":"2024-04-26T12:14:42.864005+0000","last_became_peered":"2024-04-26T12:14:42.864005+0000","last_unstale":"2024-04-26T12:20:53.778599+0000","last_undegraded":"2024-04-26T12:20:53.778599+0000","last_fullsized":"2024-04-26T12:20:53.778599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.778477+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.778477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:08.585386+0000","scrub_duration":0.021558476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:47.162047+0000","last_change":"2024-04-26T12:20:47.162047+0000","last_active":"2024-04-26T12:20:47.162047+0000","last_peered":"2024-04-26T12:20:47.162047+0000","last_clean":"2024-04-26T12:20:47.162047+0000","last_became_active":"2024-04-26T12:20:25.657652+0000","last_became_peered":"2024-04-26T12:20:25.657652+0000","last_unstale":"2024-04-26T12:20:47.162047+0000","last_undegraded":"2024-04-26T12:20:47.162047+0000","last_fullsized":"2024-04-26T12:20:47.162047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:47.161913+0000","last_clean_scrub_stamp":"2024-04-26T12:20:47.161913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:03.581394+0000","scrub_duration":0.00169505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.982751+0000","last_change":"2024-04-26T12:21:19.982751+0000","last_active":"2024-04-26T12:21:19.982751+0000","last_peered":"2024-04-26T12:21:19.982751+0000","last_clean":"2024-04-26T12:21:19.982751+0000","last_became_active":"2024-04-26T12:20:25.657998+0000","last_became_peered":"2024-04-26T12:20:25.657998+0000","last_unstale":"2024-04-26T12:21:19.982751+0000","last_undegraded":"2024-04-26T12:21:19.982751+0000","last_fullsized":"2024-04-26T12:21:19.982751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.982628+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.982628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:02.501013+0000","scrub_duration":0.001761875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:53.911367+0000","last_change":"2024-04-26T12:21:53.911462+0000","last_active":"2024-04-26T12:21:53.911367+0000","last_peered":"2024-04-26T12:21:53.911367+0000","last_clean":"2024-04-26T12:21:53.911367+0000","last_became_active":"2024-04-26T12:20:25.658112+0000","last_became_peered":"2024-04-26T12:20:25.658112+0000","last_unstale":"2024-04-26T12:21:53.911367+0000","last_undegraded":"2024-04-26T12:21:53.911367+0000","last_fullsized":"2024-04-26T12:21:53.911367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:53.911345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:53.911345+0000","last_clean_scrub_stamp":"2024-04-26T12:21:53.911345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:45.849360+0000","scrub_duration":0.0017856079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:52.053906+0000","last_change":"2024-04-26T12:21:52.053906+0000","last_active":"2024-04-26T12:21:52.053906+0000","last_peered":"2024-04-26T12:21:52.053906+0000","last_clean":"2024-04-26T12:21:52.053906+0000","last_became_active":"2024-04-26T12:20:25.657679+0000","last_became_peered":"2024-04-26T12:20:25.657679+0000","last_unstale":"2024-04-26T12:21:52.053906+0000","last_undegraded":"2024-04-26T12:21:52.053906+0000","last_fullsized":"2024-04-26T12:21:52.053906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:52.053743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:52.053743+0000","last_clean_scrub_stamp":"2024-04-26T12:21:52.053743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:11.521087+0000","scrub_duration":0.037699734999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'12","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:16.161408+0000","last_change":"2024-04-26T12:22:16.161408+0000","last_active":"2024-04-26T12:22:16.161408+0000","last_peered":"2024-04-26T12:22:16.161408+0000","last_clean":"2024-04-26T12:22:16.161408+0000","last_became_active":"2024-04-26T12:20:25.657836+0000","last_became_peered":"2024-04-26T12:20:25.657836+0000","last_unstale":"2024-04-26T12:22:16.161408+0000","last_undegraded":"2024-04-26T12:22:16.161408+0000","last_fullsized":"2024-04-26T12:22:16.161408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-04-26T12:22:16.161269+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-04-26T12:22:16.161269+0000","last_clean_scrub_stamp":"2024-04-26T12:22:16.161269+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:11.975031+0000","scrub_duration":0.007597945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:31.359994+0000","last_change":"2024-04-26T12:22:31.359994+0000","last_active":"2024-04-26T12:22:31.359994+0000","last_peered":"2024-04-26T12:22:31.359994+0000","last_clean":"2024-04-26T12:22:31.359994+0000","last_became_active":"2024-04-26T12:20:25.660178+0000","last_became_peered":"2024-04-26T12:20:25.660178+0000","last_unstale":"2024-04-26T12:22:31.359994+0000","last_undegraded":"2024-04-26T12:22:31.359994+0000","last_fullsized":"2024-04-26T12:22:31.359994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-26T12:22:31.359817+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-26T12:22:31.359817+0000","last_clean_scrub_stamp":"2024-04-26T12:22:31.359817+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:48.638467+0000","scrub_duration":0.0035788780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:21.922061+0000","last_change":"2024-04-26T12:21:21.922165+0000","last_active":"2024-04-26T12:21:21.922061+0000","last_peered":"2024-04-26T12:21:21.922061+0000","last_clean":"2024-04-26T12:21:21.922061+0000","last_became_active":"2024-04-26T12:20:25.664189+0000","last_became_peered":"2024-04-26T12:20:25.664189+0000","last_unstale":"2024-04-26T12:21:21.922061+0000","last_undegraded":"2024-04-26T12:21:21.922061+0000","last_fullsized":"2024-04-26T12:21:21.922061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:21.922041+0000","last_clean_scrub_stamp":"2024-04-26T12:21:21.922041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:21.947746+0000","scrub_duration":0.0019268759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"79'3","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:52.869663+0000","last_change":"2024-04-26T12:21:52.869775+0000","last_active":"2024-04-26T12:21:52.869663+0000","last_peered":"2024-04-26T12:21:52.869663+0000","last_clean":"2024-04-26T12:21:52.869663+0000","last_became_active":"2024-04-26T12:20:25.658526+0000","last_became_peered":"2024-04-26T12:20:25.658526+0000","last_unstale":"2024-04-26T12:21:52.869663+0000","last_undegraded":"2024-04-26T12:21:52.869663+0000","last_fullsized":"2024-04-26T12:21:52.869663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:52.869641+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:52.869641+0000","last_clean_scrub_stamp":"2024-04-26T12:21:52.869641+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:59.685725+0000","scrub_duration":0.0034181530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:01.967451+0000","last_change":"2024-04-26T12:22:01.967556+0000","last_active":"2024-04-26T12:22:01.967451+0000","last_peered":"2024-04-26T12:22:01.967451+0000","last_clean":"2024-04-26T12:22:01.967451+0000","last_became_active":"2024-04-26T12:14:42.867745+0000","last_became_peered":"2024-04-26T12:14:42.867745+0000","last_unstale":"2024-04-26T12:22:01.967451+0000","last_undegraded":"2024-04-26T12:22:01.967451+0000","last_fullsized":"2024-04-26T12:22:01.967451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:01.967417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:01.967417+0000","last_clean_scrub_stamp":"2024-04-26T12:22:01.967417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:56.957901+0000","scrub_duration":0.001588613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:41.373346+0000","last_change":"2024-04-26T12:22:41.373466+0000","last_active":"2024-04-26T12:22:41.373346+0000","last_peered":"2024-04-26T12:22:41.373346+0000","last_clean":"2024-04-26T12:22:41.373346+0000","last_became_active":"2024-04-26T12:20:25.665027+0000","last_became_peered":"2024-04-26T12:20:25.665027+0000","last_unstale":"2024-04-26T12:22:41.373346+0000","last_undegraded":"2024-04-26T12:22:41.373346+0000","last_fullsized":"2024-04-26T12:22:41.373346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-26T12:22:41.373324+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-26T12:22:41.373324+0000","last_clean_scrub_stamp":"2024-04-26T12:22:41.373324+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:47.833364+0000","scrub_duration":0.0036604250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.240064+0000","last_change":"2024-04-26T12:20:51.240064+0000","last_active":"2024-04-26T12:20:51.240064+0000","last_peered":"2024-04-26T12:20:51.240064+0000","last_clean":"2024-04-26T12:20:51.240064+0000","last_became_active":"2024-04-26T12:20:25.661882+0000","last_became_peered":"2024-04-26T12:20:25.661882+0000","last_unstale":"2024-04-26T12:20:51.240064+0000","last_undegraded":"2024-04-26T12:20:51.240064+0000","last_fullsized":"2024-04-26T12:20:51.240064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:51.239936+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.239936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:38.455956+0000","scrub_duration":0.0018569750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.195262+0000","last_change":"2024-04-26T12:20:45.195262+0000","last_active":"2024-04-26T12:20:45.195262+0000","last_peered":"2024-04-26T12:20:45.195262+0000","last_clean":"2024-04-26T12:20:45.195262+0000","last_became_active":"2024-04-26T12:20:25.662419+0000","last_became_peered":"2024-04-26T12:20:25.662419+0000","last_unstale":"2024-04-26T12:20:45.195262+0000","last_undegraded":"2024-04-26T12:20:45.195262+0000","last_fullsized":"2024-04-26T12:20:45.195262+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.195132+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.195132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:03.642870+0000","scrub_duration":0.001821214,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:44.228054+0000","last_change":"2024-04-26T12:20:44.228054+0000","last_active":"2024-04-26T12:20:44.228054+0000","last_peered":"2024-04-26T12:20:44.228054+0000","last_clean":"2024-04-26T12:20:44.228054+0000","last_became_active":"2024-04-26T12:20:25.657020+0000","last_became_peered":"2024-04-26T12:20:25.657020+0000","last_unstale":"2024-04-26T12:20:44.228054+0000","last_undegraded":"2024-04-26T12:20:44.228054+0000","last_fullsized":"2024-04-26T12:20:44.228054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:44.227884+0000","last_clean_scrub_stamp":"2024-04-26T12:20:44.227884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:28.326058+0000","scrub_duration":0.037590602000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.054265+0000","last_change":"2024-04-26T12:21:45.054404+0000","last_active":"2024-04-26T12:21:45.054265+0000","last_peered":"2024-04-26T12:21:45.054265+0000","last_clean":"2024-04-26T12:21:45.054265+0000","last_became_active":"2024-04-26T12:20:25.657152+0000","last_became_peered":"2024-04-26T12:20:25.657152+0000","last_unstale":"2024-04-26T12:21:45.054265+0000","last_undegraded":"2024-04-26T12:21:45.054265+0000","last_fullsized":"2024-04-26T12:21:45.054265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:45.054243+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.054243+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:10.556480+0000","scrub_duration":0.003031026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:47.342207+0000","last_change":"2024-04-26T12:22:47.342355+0000","last_active":"2024-04-26T12:22:47.342207+0000","last_peered":"2024-04-26T12:22:47.342207+0000","last_clean":"2024-04-26T12:22:47.342207+0000","last_became_active":"2024-04-26T12:20:25.661380+0000","last_became_peered":"2024-04-26T12:20:25.661380+0000","last_unstale":"2024-04-26T12:22:47.342207+0000","last_undegraded":"2024-04-26T12:22:47.342207+0000","last_fullsized":"2024-04-26T12:22:47.342207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:47.342152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:47.342152+0000","last_clean_scrub_stamp":"2024-04-26T12:22:47.342152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:33.830022+0000","scrub_duration":0.002180366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:17.191850+0000","last_change":"2024-04-26T12:22:17.191850+0000","last_active":"2024-04-26T12:22:17.191850+0000","last_peered":"2024-04-26T12:22:17.191850+0000","last_clean":"2024-04-26T12:22:17.191850+0000","last_became_active":"2024-04-26T12:20:25.658213+0000","last_became_peered":"2024-04-26T12:20:25.658213+0000","last_unstale":"2024-04-26T12:22:17.191850+0000","last_undegraded":"2024-04-26T12:22:17.191850+0000","last_fullsized":"2024-04-26T12:22:17.191850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:17.191725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:17.191725+0000","last_clean_scrub_stamp":"2024-04-26T12:22:17.191725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:14.904499+0000","scrub_duration":0.0017556060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:37.185781+0000","last_change":"2024-04-26T12:20:37.185781+0000","last_active":"2024-04-26T12:20:37.185781+0000","last_peered":"2024-04-26T12:20:37.185781+0000","last_clean":"2024-04-26T12:20:37.185781+0000","last_became_active":"2024-04-26T12:20:25.663124+0000","last_became_peered":"2024-04-26T12:20:25.663124+0000","last_unstale":"2024-04-26T12:20:37.185781+0000","last_undegraded":"2024-04-26T12:20:37.185781+0000","last_fullsized":"2024-04-26T12:20:37.185781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.185622+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.185622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:13.134344+0000","scrub_duration":0.0022406729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.736459+0000","last_change":"2024-04-26T12:21:42.736574+0000","last_active":"2024-04-26T12:21:42.736459+0000","last_peered":"2024-04-26T12:21:42.736459+0000","last_clean":"2024-04-26T12:21:42.736459+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:42.736459+0000","last_undegraded":"2024-04-26T12:21:42.736459+0000","last_fullsized":"2024-04-26T12:21:42.736459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.736439+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.736439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:28.494771+0000","scrub_duration":0.001884997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:32.316283+0000","last_change":"2024-04-26T12:22:32.316283+0000","last_active":"2024-04-26T12:22:32.316283+0000","last_peered":"2024-04-26T12:22:32.316283+0000","last_clean":"2024-04-26T12:22:32.316283+0000","last_became_active":"2024-04-26T12:20:25.660281+0000","last_became_peered":"2024-04-26T12:20:25.660281+0000","last_unstale":"2024-04-26T12:22:32.316283+0000","last_undegraded":"2024-04-26T12:22:32.316283+0000","last_fullsized":"2024-04-26T12:22:32.316283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:32.316170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:32.316170+0000","last_clean_scrub_stamp":"2024-04-26T12:22:32.316170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:03.229810+0000","scrub_duration":0.002212061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.724802+0000","last_change":"2024-04-26T12:21:36.724938+0000","last_active":"2024-04-26T12:21:36.724802+0000","last_peered":"2024-04-26T12:21:36.724802+0000","last_clean":"2024-04-26T12:21:36.724802+0000","last_became_active":"2024-04-26T12:14:42.528150+0000","last_became_peered":"2024-04-26T12:14:42.528150+0000","last_unstale":"2024-04-26T12:21:36.724802+0000","last_undegraded":"2024-04-26T12:21:36.724802+0000","last_fullsized":"2024-04-26T12:21:36.724802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.724781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.724781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:21.696248+0000","scrub_duration":0.001563694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.243964+0000","last_change":"2024-04-26T12:20:46.243964+0000","last_active":"2024-04-26T12:20:46.243964+0000","last_peered":"2024-04-26T12:20:46.243964+0000","last_clean":"2024-04-26T12:20:46.243964+0000","last_became_active":"2024-04-26T12:14:42.867428+0000","last_became_peered":"2024-04-26T12:14:42.867428+0000","last_unstale":"2024-04-26T12:20:46.243964+0000","last_undegraded":"2024-04-26T12:20:46.243964+0000","last_fullsized":"2024-04-26T12:20:46.243964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:46.243795+0000","last_clean_scrub_stamp":"2024-04-26T12:20:46.243795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.992132+0000","scrub_duration":0.071910356999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":246,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:07.182801+0000","last_change":"2024-04-26T12:22:07.182801+0000","last_active":"2024-04-26T12:22:07.182801+0000","last_peered":"2024-04-26T12:22:07.182801+0000","last_clean":"2024-04-26T12:22:07.182801+0000","last_became_active":"2024-04-26T12:20:25.657706+0000","last_became_peered":"2024-04-26T12:20:25.657706+0000","last_unstale":"2024-04-26T12:22:07.182801+0000","last_undegraded":"2024-04-26T12:22:07.182801+0000","last_fullsized":"2024-04-26T12:22:07.182801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-26T12:22:07.182648+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-26T12:22:07.182648+0000","last_clean_scrub_stamp":"2024-04-26T12:22:07.182648+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:45.009503+0000","scrub_duration":0.0079940380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:14.181780+0000","last_change":"2024-04-26T12:22:14.181780+0000","last_active":"2024-04-26T12:22:14.181780+0000","last_peered":"2024-04-26T12:22:14.181780+0000","last_clean":"2024-04-26T12:22:14.181780+0000","last_became_active":"2024-04-26T12:20:25.657983+0000","last_became_peered":"2024-04-26T12:20:25.657983+0000","last_unstale":"2024-04-26T12:22:14.181780+0000","last_undegraded":"2024-04-26T12:22:14.181780+0000","last_fullsized":"2024-04-26T12:22:14.181780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:14.181647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:14.181647+0000","last_clean_scrub_stamp":"2024-04-26T12:22:14.181647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:06.398648+0000","scrub_duration":0.0017895210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:50.996724+0000","last_change":"2024-04-26T12:21:50.996837+0000","last_active":"2024-04-26T12:21:50.996724+0000","last_peered":"2024-04-26T12:21:50.996724+0000","last_clean":"2024-04-26T12:21:50.996724+0000","last_became_active":"2024-04-26T12:14:42.526693+0000","last_became_peered":"2024-04-26T12:14:42.526693+0000","last_unstale":"2024-04-26T12:21:50.996724+0000","last_undegraded":"2024-04-26T12:21:50.996724+0000","last_fullsized":"2024-04-26T12:21:50.996724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:50.996704+0000","last_clean_scrub_stamp":"2024-04-26T12:21:50.996704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:37.430031+0000","scrub_duration":0.001618841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:35.315208+0000","last_change":"2024-04-26T12:22:35.315329+0000","last_active":"2024-04-26T12:22:35.315208+0000","last_peered":"2024-04-26T12:22:35.315208+0000","last_clean":"2024-04-26T12:22:35.315208+0000","last_became_active":"2024-04-26T12:20:25.664309+0000","last_became_peered":"2024-04-26T12:20:25.664309+0000","last_unstale":"2024-04-26T12:22:35.315208+0000","last_undegraded":"2024-04-26T12:22:35.315208+0000","last_fullsized":"2024-04-26T12:22:35.315208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:35.315188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:35.315188+0000","last_clean_scrub_stamp":"2024-04-26T12:22:35.315188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:17.834487+0000","scrub_duration":0.0018252330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:28.389208+0000","last_change":"2024-04-26T12:21:28.389208+0000","last_active":"2024-04-26T12:21:28.389208+0000","last_peered":"2024-04-26T12:21:28.389208+0000","last_clean":"2024-04-26T12:21:28.389208+0000","last_became_active":"2024-04-26T12:20:25.664030+0000","last_became_peered":"2024-04-26T12:20:25.664030+0000","last_unstale":"2024-04-26T12:21:28.389208+0000","last_undegraded":"2024-04-26T12:21:28.389208+0000","last_fullsized":"2024-04-26T12:21:28.389208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:28.389079+0000","last_clean_scrub_stamp":"2024-04-26T12:21:28.389079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:28.433507+0000","scrub_duration":0.0020847600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:42.985544+0000","last_change":"2024-04-26T12:21:42.985671+0000","last_active":"2024-04-26T12:21:42.985544+0000","last_peered":"2024-04-26T12:21:42.985544+0000","last_clean":"2024-04-26T12:21:42.985544+0000","last_became_active":"2024-04-26T12:20:25.657412+0000","last_became_peered":"2024-04-26T12:20:25.657412+0000","last_unstale":"2024-04-26T12:21:42.985544+0000","last_undegraded":"2024-04-26T12:21:42.985544+0000","last_fullsized":"2024-04-26T12:21:42.985544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:42.985508+0000","last_clean_scrub_stamp":"2024-04-26T12:21:42.985508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:34.923523+0000","scrub_duration":0.0018060699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:15.845585+0000","last_change":"2024-04-26T12:21:15.845585+0000","last_active":"2024-04-26T12:21:15.845585+0000","last_peered":"2024-04-26T12:21:15.845585+0000","last_clean":"2024-04-26T12:21:15.845585+0000","last_became_active":"2024-04-26T12:14:42.868355+0000","last_became_peered":"2024-04-26T12:14:42.868355+0000","last_unstale":"2024-04-26T12:21:15.845585+0000","last_undegraded":"2024-04-26T12:21:15.845585+0000","last_fullsized":"2024-04-26T12:21:15.845585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:15.845433+0000","last_clean_scrub_stamp":"2024-04-26T12:21:15.845433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:43.633693+0000","scrub_duration":0.0020180860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:31.960816+0000","last_change":"2024-04-26T12:21:31.960941+0000","last_active":"2024-04-26T12:21:31.960816+0000","last_peered":"2024-04-26T12:21:31.960816+0000","last_clean":"2024-04-26T12:21:31.960816+0000","last_became_active":"2024-04-26T12:14:38.230862+0000","last_became_peered":"2024-04-26T12:14:38.230862+0000","last_unstale":"2024-04-26T12:21:31.960816+0000","last_undegraded":"2024-04-26T12:21:31.960816+0000","last_fullsized":"2024-04-26T12:21:31.960816+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:31.960781+0000","last_clean_scrub_stamp":"2024-04-26T12:21:31.960781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:56.778609+0000","scrub_duration":0.001606894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.804441+0000","last_change":"2024-04-26T12:21:44.804441+0000","last_active":"2024-04-26T12:21:44.804441+0000","last_peered":"2024-04-26T12:21:44.804441+0000","last_clean":"2024-04-26T12:21:44.804441+0000","last_became_active":"2024-04-26T12:20:25.657951+0000","last_became_peered":"2024-04-26T12:20:25.657951+0000","last_unstale":"2024-04-26T12:21:44.804441+0000","last_undegraded":"2024-04-26T12:21:44.804441+0000","last_fullsized":"2024-04-26T12:21:44.804441+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:44.804307+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.804307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:13.373258+0000","scrub_duration":0.001678099,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:40.233585+0000","last_change":"2024-04-26T12:20:40.233585+0000","last_active":"2024-04-26T12:20:40.233585+0000","last_peered":"2024-04-26T12:20:40.233585+0000","last_clean":"2024-04-26T12:20:40.233585+0000","last_became_active":"2024-04-26T12:14:42.871854+0000","last_became_peered":"2024-04-26T12:14:42.871854+0000","last_unstale":"2024-04-26T12:20:40.233585+0000","last_undegraded":"2024-04-26T12:20:40.233585+0000","last_fullsized":"2024-04-26T12:20:40.233585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:40.233426+0000","last_clean_scrub_stamp":"2024-04-26T12:20:40.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.531307+0000","scrub_duration":0.037253345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:11.112610+0000","last_change":"2024-04-26T12:22:11.112610+0000","last_active":"2024-04-26T12:22:11.112610+0000","last_peered":"2024-04-26T12:22:11.112610+0000","last_clean":"2024-04-26T12:22:11.112610+0000","last_became_active":"2024-04-26T12:20:25.658986+0000","last_became_peered":"2024-04-26T12:20:25.658986+0000","last_unstale":"2024-04-26T12:22:11.112610+0000","last_undegraded":"2024-04-26T12:22:11.112610+0000","last_fullsized":"2024-04-26T12:22:11.112610+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:11.112489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:11.112489+0000","last_clean_scrub_stamp":"2024-04-26T12:22:11.112489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:54.929523+0000","scrub_duration":0.001642983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:13.167567+0000","last_change":"2024-04-26T12:22:13.167567+0000","last_active":"2024-04-26T12:22:13.167567+0000","last_peered":"2024-04-26T12:22:13.167567+0000","last_clean":"2024-04-26T12:22:13.167567+0000","last_became_active":"2024-04-26T12:20:25.661133+0000","last_became_peered":"2024-04-26T12:20:25.661133+0000","last_unstale":"2024-04-26T12:22:13.167567+0000","last_undegraded":"2024-04-26T12:22:13.167567+0000","last_fullsized":"2024-04-26T12:22:13.167567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:13.167431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:13.167431+0000","last_clean_scrub_stamp":"2024-04-26T12:22:13.167431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:49.168000+0000","scrub_duration":0.001889948,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:38.217915+0000","last_change":"2024-04-26T12:20:38.217915+0000","last_active":"2024-04-26T12:20:38.217915+0000","last_peered":"2024-04-26T12:20:38.217915+0000","last_clean":"2024-04-26T12:20:38.217915+0000","last_became_active":"2024-04-26T12:14:42.867045+0000","last_became_peered":"2024-04-26T12:14:42.867045+0000","last_unstale":"2024-04-26T12:20:38.217915+0000","last_undegraded":"2024-04-26T12:20:38.217915+0000","last_fullsized":"2024-04-26T12:20:38.217915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:38.217739+0000","last_clean_scrub_stamp":"2024-04-26T12:20:38.217739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:53.024648+0000","scrub_duration":0.001837775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.345857+0000","last_change":"2024-04-26T12:21:02.345857+0000","last_active":"2024-04-26T12:21:02.345857+0000","last_peered":"2024-04-26T12:21:02.345857+0000","last_clean":"2024-04-26T12:21:02.345857+0000","last_became_active":"2024-04-26T12:20:25.661092+0000","last_became_peered":"2024-04-26T12:20:25.661092+0000","last_unstale":"2024-04-26T12:21:02.345857+0000","last_undegraded":"2024-04-26T12:21:02.345857+0000","last_fullsized":"2024-04-26T12:21:02.345857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.345738+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.345738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:46.742649+0000","scrub_duration":0.0017828270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:27.947417+0000","last_change":"2024-04-26T12:21:27.947522+0000","last_active":"2024-04-26T12:21:27.947417+0000","last_peered":"2024-04-26T12:21:27.947417+0000","last_clean":"2024-04-26T12:21:27.947417+0000","last_became_active":"2024-04-26T12:14:38.230860+0000","last_became_peered":"2024-04-26T12:14:38.230860+0000","last_unstale":"2024-04-26T12:21:27.947417+0000","last_undegraded":"2024-04-26T12:21:27.947417+0000","last_fullsized":"2024-04-26T12:21:27.947417+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:27.947395+0000","last_clean_scrub_stamp":"2024-04-26T12:21:27.947395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:02.048329+0000","scrub_duration":0.0020297980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.788962+0000","last_change":"2024-04-26T12:20:42.788962+0000","last_active":"2024-04-26T12:20:42.788962+0000","last_peered":"2024-04-26T12:20:42.788962+0000","last_clean":"2024-04-26T12:20:42.788962+0000","last_became_active":"2024-04-26T12:20:25.658596+0000","last_became_peered":"2024-04-26T12:20:25.658596+0000","last_unstale":"2024-04-26T12:20:42.788962+0000","last_undegraded":"2024-04-26T12:20:42.788962+0000","last_fullsized":"2024-04-26T12:20:42.788962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:42.788831+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.788831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:48.051123+0000","scrub_duration":0.0018731360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:08.930400+0000","last_change":"2024-04-26T12:21:08.930526+0000","last_active":"2024-04-26T12:21:08.930400+0000","last_peered":"2024-04-26T12:21:08.930400+0000","last_clean":"2024-04-26T12:21:08.930400+0000","last_became_active":"2024-04-26T12:14:42.526825+0000","last_became_peered":"2024-04-26T12:14:42.526825+0000","last_unstale":"2024-04-26T12:21:08.930400+0000","last_undegraded":"2024-04-26T12:21:08.930400+0000","last_fullsized":"2024-04-26T12:21:08.930400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:08.930381+0000","last_clean_scrub_stamp":"2024-04-26T12:21:08.930381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:57.478621+0000","scrub_duration":0.0022001880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:40.742763+0000","last_change":"2024-04-26T12:21:40.742884+0000","last_active":"2024-04-26T12:21:40.742763+0000","last_peered":"2024-04-26T12:21:40.742763+0000","last_clean":"2024-04-26T12:21:40.742763+0000","last_became_active":"2024-04-26T12:14:38.228694+0000","last_became_peered":"2024-04-26T12:14:38.228694+0000","last_unstale":"2024-04-26T12:21:40.742763+0000","last_undegraded":"2024-04-26T12:21:40.742763+0000","last_fullsized":"2024-04-26T12:21:40.742763+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:40.742726+0000","last_clean_scrub_stamp":"2024-04-26T12:21:40.742726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:25.864637+0000","scrub_duration":0.001946726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.798092+0000","last_change":"2024-04-26T12:21:01.798203+0000","last_active":"2024-04-26T12:21:01.798092+0000","last_peered":"2024-04-26T12:21:01.798092+0000","last_clean":"2024-04-26T12:21:01.798092+0000","last_became_active":"2024-04-26T12:20:25.659613+0000","last_became_peered":"2024-04-26T12:20:25.659613+0000","last_unstale":"2024-04-26T12:21:01.798092+0000","last_undegraded":"2024-04-26T12:21:01.798092+0000","last_fullsized":"2024-04-26T12:21:01.798092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.798071+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.798071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:26.107733+0000","scrub_duration":0.0017992150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.980665+0000","last_change":"2024-04-26T12:21:49.980795+0000","last_active":"2024-04-26T12:21:49.980665+0000","last_peered":"2024-04-26T12:21:49.980665+0000","last_clean":"2024-04-26T12:21:49.980665+0000","last_became_active":"2024-04-26T12:14:42.526973+0000","last_became_peered":"2024-04-26T12:14:42.526973+0000","last_unstale":"2024-04-26T12:21:49.980665+0000","last_undegraded":"2024-04-26T12:21:49.980665+0000","last_fullsized":"2024-04-26T12:21:49.980665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:49.980626+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.980626+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:48.325677+0000","scrub_duration":0.0034005770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:29.927249+0000","last_change":"2024-04-26T12:21:29.927349+0000","last_active":"2024-04-26T12:21:29.927249+0000","last_peered":"2024-04-26T12:21:29.927249+0000","last_clean":"2024-04-26T12:21:29.927249+0000","last_became_active":"2024-04-26T12:14:38.233370+0000","last_became_peered":"2024-04-26T12:14:38.233370+0000","last_unstale":"2024-04-26T12:21:29.927249+0000","last_undegraded":"2024-04-26T12:21:29.927249+0000","last_fullsized":"2024-04-26T12:21:29.927249+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:29.927228+0000","last_clean_scrub_stamp":"2024-04-26T12:21:29.927228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:13.697104+0000","scrub_duration":0.001694173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.791029+0000","last_change":"2024-04-26T12:20:39.239308+0000","last_active":"2024-04-26T12:20:46.791029+0000","last_peered":"2024-04-26T12:20:46.791029+0000","last_clean":"2024-04-26T12:20:46.791029+0000","last_became_active":"2024-04-26T12:20:25.658051+0000","last_became_peered":"2024-04-26T12:20:25.658051+0000","last_unstale":"2024-04-26T12:20:46.791029+0000","last_undegraded":"2024-04-26T12:20:46.791029+0000","last_fullsized":"2024-04-26T12:20:46.791029+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:39.239159+0000","last_clean_scrub_stamp":"2024-04-26T12:20:39.239159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:05.765227+0000","scrub_duration":0.001927977,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"79'2","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:49.019184+0000","last_change":"2024-04-26T12:21:49.019288+0000","last_active":"2024-04-26T12:21:49.019184+0000","last_peered":"2024-04-26T12:21:49.019184+0000","last_clean":"2024-04-26T12:21:49.019184+0000","last_became_active":"2024-04-26T12:20:25.657841+0000","last_became_peered":"2024-04-26T12:20:25.657841+0000","last_unstale":"2024-04-26T12:21:49.019184+0000","last_undegraded":"2024-04-26T12:21:49.019184+0000","last_fullsized":"2024-04-26T12:21:49.019184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-26T12:21:49.019162+0000","last_clean_scrub_stamp":"2024-04-26T12:21:49.019162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:32.716076+0000","scrub_duration":0.0032590919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.628397+0000","last_change":"2024-04-26T12:21:20.628397+0000","last_active":"2024-04-26T12:21:20.628397+0000","last_peered":"2024-04-26T12:21:20.628397+0000","last_clean":"2024-04-26T12:21:20.628397+0000","last_became_active":"2024-04-26T12:20:25.657010+0000","last_became_peered":"2024-04-26T12:20:25.657010+0000","last_unstale":"2024-04-26T12:21:20.628397+0000","last_undegraded":"2024-04-26T12:21:20.628397+0000","last_fullsized":"2024-04-26T12:21:20.628397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.628273+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.628273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:36.645398+0000","scrub_duration":0.001806247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:20.938858+0000","last_change":"2024-04-26T12:21:20.938983+0000","last_active":"2024-04-26T12:21:20.938858+0000","last_peered":"2024-04-26T12:21:20.938858+0000","last_clean":"2024-04-26T12:21:20.938858+0000","last_became_active":"2024-04-26T12:20:25.658482+0000","last_became_peered":"2024-04-26T12:20:25.658482+0000","last_unstale":"2024-04-26T12:21:20.938858+0000","last_undegraded":"2024-04-26T12:21:20.938858+0000","last_fullsized":"2024-04-26T12:21:20.938858+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:20.938837+0000","last_clean_scrub_stamp":"2024-04-26T12:21:20.938837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:40.130354+0000","scrub_duration":0.001772615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:36.298863+0000","last_change":"2024-04-26T12:21:36.298863+0000","last_active":"2024-04-26T12:21:36.298863+0000","last_peered":"2024-04-26T12:21:36.298863+0000","last_clean":"2024-04-26T12:21:36.298863+0000","last_became_active":"2024-04-26T12:20:25.663036+0000","last_became_peered":"2024-04-26T12:20:25.663036+0000","last_unstale":"2024-04-26T12:21:36.298863+0000","last_undegraded":"2024-04-26T12:21:36.298863+0000","last_fullsized":"2024-04-26T12:21:36.298863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:36.298732+0000","last_clean_scrub_stamp":"2024-04-26T12:21:36.298732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:04.694417+0000","scrub_duration":0.0016097329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'10","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:44.286929+0000","last_change":"2024-04-26T12:21:44.286929+0000","last_active":"2024-04-26T12:21:44.286929+0000","last_peered":"2024-04-26T12:21:44.286929+0000","last_clean":"2024-04-26T12:21:44.286929+0000","last_became_active":"2024-04-26T12:20:25.657582+0000","last_became_peered":"2024-04-26T12:20:25.657582+0000","last_unstale":"2024-04-26T12:21:44.286929+0000","last_undegraded":"2024-04-26T12:21:44.286929+0000","last_fullsized":"2024-04-26T12:21:44.286929+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-04-26T12:21:44.286751+0000","last_clean_scrub_stamp":"2024-04-26T12:21:44.286751+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:41.216976+0000","scrub_duration":0.0052196680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:02.046248+0000","last_change":"2024-04-26T12:21:02.046248+0000","last_active":"2024-04-26T12:21:02.046248+0000","last_peered":"2024-04-26T12:21:02.046248+0000","last_clean":"2024-04-26T12:21:02.046248+0000","last_became_active":"2024-04-26T12:14:42.865632+0000","last_became_peered":"2024-04-26T12:14:42.865632+0000","last_unstale":"2024-04-26T12:21:02.046248+0000","last_undegraded":"2024-04-26T12:21:02.046248+0000","last_fullsized":"2024-04-26T12:21:02.046248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:02.046099+0000","last_clean_scrub_stamp":"2024-04-26T12:21:02.046099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:02.071804+0000","scrub_duration":0.0017987509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"79'5","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:43.763333+0000","last_change":"2024-04-26T12:21:43.763333+0000","last_active":"2024-04-26T12:21:43.763333+0000","last_peered":"2024-04-26T12:21:43.763333+0000","last_clean":"2024-04-26T12:21:43.763333+0000","last_became_active":"2024-04-26T12:20:25.667043+0000","last_became_peered":"2024-04-26T12:20:25.667043+0000","last_unstale":"2024-04-26T12:21:43.763333+0000","last_undegraded":"2024-04-26T12:21:43.763333+0000","last_fullsized":"2024-04-26T12:21:43.763333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-04-26T12:21:43.763181+0000","last_clean_scrub_stamp":"2024-04-26T12:21:43.763181+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:50.040543+0000","scrub_duration":0.0039017230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:14.537700+0000","last_change":"2024-04-26T12:21:14.537700+0000","last_active":"2024-04-26T12:21:14.537700+0000","last_peered":"2024-04-26T12:21:14.537700+0000","last_clean":"2024-04-26T12:21:14.537700+0000","last_became_active":"2024-04-26T12:20:25.658342+0000","last_became_peered":"2024-04-26T12:20:25.658342+0000","last_unstale":"2024-04-26T12:21:14.537700+0000","last_undegraded":"2024-04-26T12:21:14.537700+0000","last_fullsized":"2024-04-26T12:21:14.537700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:14.537541+0000","last_clean_scrub_stamp":"2024-04-26T12:21:14.537541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:35.164328+0000","scrub_duration":0.001714157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":114,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:53.062080+0000","last_change":"2024-04-26T12:20:53.062080+0000","last_active":"2024-04-26T12:20:53.062080+0000","last_peered":"2024-04-26T12:20:53.062080+0000","last_clean":"2024-04-26T12:20:53.062080+0000","last_became_active":"2024-04-26T12:20:25.656976+0000","last_became_peered":"2024-04-26T12:20:25.656976+0000","last_unstale":"2024-04-26T12:20:53.062080+0000","last_undegraded":"2024-04-26T12:20:53.062080+0000","last_fullsized":"2024-04-26T12:20:53.062080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:53.061955+0000","last_clean_scrub_stamp":"2024-04-26T12:20:53.061955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:36.090188+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:45.148696+0000","last_change":"2024-04-26T12:20:45.148696+0000","last_active":"2024-04-26T12:20:45.148696+0000","last_peered":"2024-04-26T12:20:45.148696+0000","last_clean":"2024-04-26T12:20:45.148696+0000","last_became_active":"2024-04-26T12:20:25.657638+0000","last_became_peered":"2024-04-26T12:20:25.657638+0000","last_unstale":"2024-04-26T12:20:45.148696+0000","last_undegraded":"2024-04-26T12:20:45.148696+0000","last_fullsized":"2024-04-26T12:20:45.148696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:45.148548+0000","last_clean_scrub_stamp":"2024-04-26T12:20:45.148548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.383636+0000","scrub_duration":0.0018031029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:49.111929+0000","last_change":"2024-04-26T12:20:49.111929+0000","last_active":"2024-04-26T12:20:49.111929+0000","last_peered":"2024-04-26T12:20:49.111929+0000","last_clean":"2024-04-26T12:20:49.111929+0000","last_became_active":"2024-04-26T12:14:42.863778+0000","last_became_peered":"2024-04-26T12:14:42.863778+0000","last_unstale":"2024-04-26T12:20:49.111929+0000","last_undegraded":"2024-04-26T12:20:49.111929+0000","last_fullsized":"2024-04-26T12:20:49.111929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:49.111806+0000","last_clean_scrub_stamp":"2024-04-26T12:20:49.111806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:18.633109+0000","scrub_duration":0.0015728319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:55.873745+0000","last_change":"2024-04-26T12:20:55.873745+0000","last_active":"2024-04-26T12:20:55.873745+0000","last_peered":"2024-04-26T12:20:55.873745+0000","last_clean":"2024-04-26T12:20:55.873745+0000","last_became_active":"2024-04-26T12:20:25.664116+0000","last_became_peered":"2024-04-26T12:20:25.664116+0000","last_unstale":"2024-04-26T12:20:55.873745+0000","last_undegraded":"2024-04-26T12:20:55.873745+0000","last_fullsized":"2024-04-26T12:20:55.873745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:55.873506+0000","last_clean_scrub_stamp":"2024-04-26T12:20:55.873506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:35.165043+0000","scrub_duration":0.069253721000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:23.973578+0000","last_change":"2024-04-26T12:21:23.973578+0000","last_active":"2024-04-26T12:21:23.973578+0000","last_peered":"2024-04-26T12:21:23.973578+0000","last_clean":"2024-04-26T12:21:23.973578+0000","last_became_active":"2024-04-26T12:14:42.526679+0000","last_became_peered":"2024-04-26T12:14:42.526679+0000","last_unstale":"2024-04-26T12:21:23.973578+0000","last_undegraded":"2024-04-26T12:21:23.973578+0000","last_fullsized":"2024-04-26T12:21:23.973578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:23.973458+0000","last_clean_scrub_stamp":"2024-04-26T12:21:23.973458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:16.098425+0000","scrub_duration":0.001902541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:46.791165+0000","last_change":"2024-04-26T12:20:37.267347+0000","last_active":"2024-04-26T12:20:46.791165+0000","last_peered":"2024-04-26T12:20:46.791165+0000","last_clean":"2024-04-26T12:20:46.791165+0000","last_became_active":"2024-04-26T12:20:25.659074+0000","last_became_peered":"2024-04-26T12:20:25.659074+0000","last_unstale":"2024-04-26T12:20:46.791165+0000","last_undegraded":"2024-04-26T12:20:46.791165+0000","last_fullsized":"2024-04-26T12:20:46.791165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:37.267215+0000","last_clean_scrub_stamp":"2024-04-26T12:20:37.267215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:21.882383+0000","scrub_duration":0.0018490620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.010072+0000","last_change":"2024-04-26T12:21:01.010072+0000","last_active":"2024-04-26T12:21:01.010072+0000","last_peered":"2024-04-26T12:21:01.010072+0000","last_clean":"2024-04-26T12:21:01.010072+0000","last_became_active":"2024-04-26T12:20:25.657890+0000","last_became_peered":"2024-04-26T12:20:25.657890+0000","last_unstale":"2024-04-26T12:21:01.010072+0000","last_undegraded":"2024-04-26T12:21:01.010072+0000","last_fullsized":"2024-04-26T12:21:01.010072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:01.009933+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.009933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:20.201451+0000","scrub_duration":0.0018985370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:35.734685+0000","last_change":"2024-04-26T12:21:35.734685+0000","last_active":"2024-04-26T12:21:35.734685+0000","last_peered":"2024-04-26T12:21:35.734685+0000","last_clean":"2024-04-26T12:21:35.734685+0000","last_became_active":"2024-04-26T12:20:25.659657+0000","last_became_peered":"2024-04-26T12:20:25.659657+0000","last_unstale":"2024-04-26T12:21:35.734685+0000","last_undegraded":"2024-04-26T12:21:35.734685+0000","last_fullsized":"2024-04-26T12:21:35.734685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:35.734571+0000","last_clean_scrub_stamp":"2024-04-26T12:21:35.734571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:20.757460+0000","scrub_duration":0.0018119519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":91,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:41.754671+0000","last_change":"2024-04-26T12:21:41.754671+0000","last_active":"2024-04-26T12:21:41.754671+0000","last_peered":"2024-04-26T12:21:41.754671+0000","last_clean":"2024-04-26T12:21:41.754671+0000","last_became_active":"2024-04-26T12:14:42.528069+0000","last_became_peered":"2024-04-26T12:14:42.528069+0000","last_unstale":"2024-04-26T12:21:41.754671+0000","last_undegraded":"2024-04-26T12:21:41.754671+0000","last_fullsized":"2024-04-26T12:21:41.754671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:41.754524+0000","last_clean_scrub_stamp":"2024-04-26T12:21:41.754524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:50.022019+0000","scrub_duration":0.0017813410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:00.945941+0000","last_change":"2024-04-26T12:22:00.945941+0000","last_active":"2024-04-26T12:22:00.945941+0000","last_peered":"2024-04-26T12:22:00.945941+0000","last_clean":"2024-04-26T12:22:00.945941+0000","last_became_active":"2024-04-26T12:14:42.863055+0000","last_became_peered":"2024-04-26T12:14:42.863055+0000","last_unstale":"2024-04-26T12:22:00.945941+0000","last_undegraded":"2024-04-26T12:22:00.945941+0000","last_fullsized":"2024-04-26T12:22:00.945941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:00.945758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:00.945758+0000","last_clean_scrub_stamp":"2024-04-26T12:22:00.945758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:31.118414+0000","scrub_duration":0.0016528490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:45.781607+0000","last_change":"2024-04-26T12:21:45.781607+0000","last_active":"2024-04-26T12:21:45.781607+0000","last_peered":"2024-04-26T12:21:45.781607+0000","last_clean":"2024-04-26T12:21:45.781607+0000","last_became_active":"2024-04-26T12:20:25.666901+0000","last_became_peered":"2024-04-26T12:20:25.666901+0000","last_unstale":"2024-04-26T12:21:45.781607+0000","last_undegraded":"2024-04-26T12:21:45.781607+0000","last_fullsized":"2024-04-26T12:21:45.781607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:21:45.781441+0000","last_clean_scrub_stamp":"2024-04-26T12:21:45.781441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:10.599270+0000","scrub_duration":0.0018896659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:55.235679+0000","last_change":"2024-04-26T12:21:55.235679+0000","last_active":"2024-04-26T12:21:55.235679+0000","last_peered":"2024-04-26T12:21:55.235679+0000","last_clean":"2024-04-26T12:21:55.235679+0000","last_became_active":"2024-04-26T12:20:25.664273+0000","last_became_peered":"2024-04-26T12:20:25.664273+0000","last_unstale":"2024-04-26T12:21:55.235679+0000","last_undegraded":"2024-04-26T12:21:55.235679+0000","last_fullsized":"2024-04-26T12:21:55.235679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:55.235555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:55.235555+0000","last_clean_scrub_stamp":"2024-04-26T12:21:55.235555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:56.584254+0000","scrub_duration":0.022038149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:01.306715+0000","last_change":"2024-04-26T12:21:01.306715+0000","last_active":"2024-04-26T12:21:01.306715+0000","last_peered":"2024-04-26T12:21:01.306715+0000","last_clean":"2024-04-26T12:21:01.306715+0000","last_became_active":"2024-04-26T12:20:25.660036+0000","last_became_peered":"2024-04-26T12:20:25.660036+0000","last_unstale":"2024-04-26T12:21:01.306715+0000","last_undegraded":"2024-04-26T12:21:01.306715+0000","last_fullsized":"2024-04-26T12:21:01.306715+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:01.306592+0000","last_clean_scrub_stamp":"2024-04-26T12:21:01.306592+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:51.007517+0000","scrub_duration":0.003604196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:22:01.085691+0000","last_change":"2024-04-26T12:22:01.085691+0000","last_active":"2024-04-26T12:22:01.085691+0000","last_peered":"2024-04-26T12:22:01.085691+0000","last_clean":"2024-04-26T12:22:01.085691+0000","last_became_active":"2024-04-26T12:20:25.658473+0000","last_became_peered":"2024-04-26T12:20:25.658473+0000","last_unstale":"2024-04-26T12:22:01.085691+0000","last_undegraded":"2024-04-26T12:22:01.085691+0000","last_fullsized":"2024-04-26T12:22:01.085691+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:22:01.085572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:22:01.085572+0000","last_clean_scrub_stamp":"2024-04-26T12:22:01.085572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:17.660371+0000","scrub_duration":0.002072618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:34.783753+0000","last_change":"2024-04-26T12:21:34.783753+0000","last_active":"2024-04-26T12:21:34.783753+0000","last_peered":"2024-04-26T12:21:34.783753+0000","last_clean":"2024-04-26T12:21:34.783753+0000","last_became_active":"2024-04-26T12:20:25.658163+0000","last_became_peered":"2024-04-26T12:20:25.658163+0000","last_unstale":"2024-04-26T12:21:34.783753+0000","last_undegraded":"2024-04-26T12:21:34.783753+0000","last_fullsized":"2024-04-26T12:21:34.783753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-26T12:21:34.783633+0000","last_clean_scrub_stamp":"2024-04-26T12:21:34.783633+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:31.032530+0000","scrub_duration":0.0033859229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:21:19.922084+0000","last_change":"2024-04-26T12:21:19.922084+0000","last_active":"2024-04-26T12:21:19.922084+0000","last_peered":"2024-04-26T12:21:19.922084+0000","last_clean":"2024-04-26T12:21:19.922084+0000","last_became_active":"2024-04-26T12:14:42.867351+0000","last_became_peered":"2024-04-26T12:14:42.867351+0000","last_unstale":"2024-04-26T12:21:19.922084+0000","last_undegraded":"2024-04-26T12:21:19.922084+0000","last_fullsized":"2024-04-26T12:21:19.922084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:21:19.921926+0000","last_clean_scrub_stamp":"2024-04-26T12:21:19.921926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:07.112057+0000","scrub_duration":0.020713793000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":91,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:51.113577+0000","last_change":"2024-04-26T12:20:51.113577+0000","last_active":"2024-04-26T12:20:51.113577+0000","last_peered":"2024-04-26T12:20:51.113577+0000","last_clean":"2024-04-26T12:20:51.113577+0000","last_became_active":"2024-04-26T12:14:42.526849+0000","last_became_peered":"2024-04-26T12:14:42.526849+0000","last_unstale":"2024-04-26T12:20:51.113577+0000","last_undegraded":"2024-04-26T12:20:51.113577+0000","last_fullsized":"2024-04-26T12:20:51.113577+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:20:51.113432+0000","last_clean_scrub_stamp":"2024-04-26T12:20:51.113432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:11.752649+0000","scrub_duration":0.0017589649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:59.270025+0000","last_change":"2024-04-26T12:20:59.270025+0000","last_active":"2024-04-26T12:20:59.270025+0000","last_peered":"2024-04-26T12:20:59.270025+0000","last_clean":"2024-04-26T12:20:59.270025+0000","last_became_active":"2024-04-26T12:20:25.663448+0000","last_became_peered":"2024-04-26T12:20:25.663448+0000","last_unstale":"2024-04-26T12:20:59.270025+0000","last_undegraded":"2024-04-26T12:20:59.270025+0000","last_fullsized":"2024-04-26T12:20:59.270025+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:20:59.269890+0000","last_clean_scrub_stamp":"2024-04-26T12:20:59.269890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:50.740249+0000","scrub_duration":0.0016247309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:20:42.241925+0000","last_change":"2024-04-26T12:20:42.241925+0000","last_active":"2024-04-26T12:20:42.241925+0000","last_peered":"2024-04-26T12:20:42.241925+0000","last_clean":"2024-04-26T12:20:42.241925+0000","last_became_active":"2024-04-26T12:20:25.658282+0000","last_became_peered":"2024-04-26T12:20:25.658282+0000","last_unstale":"2024-04-26T12:20:42.241925+0000","last_undegraded":"2024-04-26T12:20:42.241925+0000","last_fullsized":"2024-04-26T12:20:42.241925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-26T12:20:42.241764+0000","last_clean_scrub_stamp":"2024-04-26T12:20:42.241764+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:44.362930+0000","scrub_duration":0.0044497909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738471,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321308,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":94050532,"statfs":{"total":96636764160,"available":96307744768,"internally_reserved":0,"allocated":1462272,"data_stored":932818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:21:58 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47999999999999998,"15min":0.40400000000000003},"min":{"1min":0.28000000000000003,"5min":0.19,"15min":0.17899999999999999},"max":{"1min":0.626,"5min":0.871,"15min":0.871},"last":0.435},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46700000000000003,"15min":0.42999999999999999},"min":{"1min":0.30199999999999999,"5min":0.19800000000000001,"15min":0.192},"max":{"1min":0.53600000000000003,"5min":0.88400000000000001,"15min":0.92900000000000005},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Apr 26 12:22:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58099999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.51900000000000002}]}]},{"osd":1,"up_from":74,"seq":317827579936,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":1440,"kb_used_omap":8,"kb_used_meta":28535,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":1474560,"data_stored":935555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8747,"internal_metadata":29220309},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:22:25 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.33700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"min":{"1min":0.35299999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:22:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.45900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738471,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483144,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93888696,"statfs":{"total":96636764160,"available":96142024704,"internally_reserved":0,"allocated":851968,"data_stored":341328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493877702},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:22:27 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.51400000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.46500000000000002,"15min":0.46899999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57799999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:21:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45900000000000002,"15min":0.377},"min":{"1min":0.34799999999999998,"5min":0.191,"15min":0.161},"max":{"1min":0.59899999999999998,"5min":0.65300000000000002,"15min":0.92200000000000004},"last":0.379},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.40200000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.185},"max":{"1min":0.63200000000000001,"5min":0.68500000000000005,"15min":0.879},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5482,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:22:57.933 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:22:58.264 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T12:22:58.264 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:22:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:22:58.578 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:14:42.847976+0000","modified":"2024-04-26T12:14:44.858997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6803/2901824101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":2901824101},{"type":"v1","addr":"172.21.15.69:6803","nonce":2901824101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:22:58.579 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-04-26T12:22:58.591 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:22:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:22:58.907 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:14:42.847976+0000","modified":"2024-04-26T12:14:44.858997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6803/2901824101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":2901824101},{"type":"v1","addr":"172.21.15.69:6803","nonce":2901824101}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:22:58.907 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-04-26T12:22:58.919 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:22:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-26T12:22:59.195 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":79,"fsid":"38aaef92-b73b-4053-b2f0-6b2ea75fb544","created":"2024-04-26T12:14:27.921075+0000","modified":"2024-04-26T12:20:29.676527+0000","last_up_change":"2024-04-26T12:20:24.639333+0000","last_in_change":"2024-04-26T12:14:29.155786+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:14:36.451914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:14:36.730304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:14:41.002412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:14:41.827946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89200742-a13d-457a-aef2-b2a7ff7adfa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":28647},{"type":"v1","addr":"172.21.15.70:6801","nonce":28647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":28647},{"type":"v1","addr":"172.21.15.70:6803","nonce":28647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":28647},{"type":"v1","addr":"172.21.15.70:6807","nonce":28647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":28647},{"type":"v1","addr":"172.21.15.70:6805","nonce":28647}]},"public_addr":"172.21.15.70:6801/28647","cluster_addr":"172.21.15.70:6803/28647","heartbeat_back_addr":"172.21.15.70:6807/28647","heartbeat_front_addr":"172.21.15.70:6805/28647","state":["exists","up"]},{"osd":1,"uuid":"ea84835a-16c2-4100-a546-95ddfec7c9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":66,"last_clean_end":70,"up_from":74,"up_thru":74,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":1460},{"type":"v1","addr":"172.21.15.113:6801","nonce":1460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":1460},{"type":"v1","addr":"172.21.15.113:6803","nonce":1460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":1460},{"type":"v1","addr":"172.21.15.113:6807","nonce":1460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":1460},{"type":"v1","addr":"172.21.15.113:6805","nonce":1460}]},"public_addr":"172.21.15.113:6801/1460","cluster_addr":"172.21.15.113:6803/1460","heartbeat_back_addr":"172.21.15.113:6807/1460","heartbeat_front_addr":"172.21.15.113:6805/1460","state":["exists","up"]},{"osd":2,"uuid":"ee2ef2ba-d976-41f8-811d-8b1131867aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":28763},{"type":"v1","addr":"172.21.15.172:6801","nonce":28763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":28763},{"type":"v1","addr":"172.21.15.172:6803","nonce":28763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":28763},{"type":"v1","addr":"172.21.15.172:6807","nonce":28763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":28763},{"type":"v1","addr":"172.21.15.172:6805","nonce":28763}]},"public_addr":"172.21.15.172:6801/28763","cluster_addr":"172.21.15.172:6803/28763","heartbeat_back_addr":"172.21.15.172:6807/28763","heartbeat_front_addr":"172.21.15.172:6805/28763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.184143+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.200112+0000","dead_epoch":70},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:14:34.172397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:22:59.207 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T12:22:59.533 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T12:22:59.533 INFO:tasks.ceph.mds.a.smithi069.stderr: -2560> 2024-04-26T12:14:48.325+0000 7f5df4e21640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T12:22:59.547 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T12:22:59.560 INFO:tasks.ceph.mds.a.smithi069.stdout:starting mds.a at 2024-04-26T12:23:00.552 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T12:23:01.543 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2024-04-26T12:23:01.559 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T12:23:02.547 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2024-04-26T12:23:02.563 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:23:02.563 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T12:23:02.564 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.573 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T12:23:02.574 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:23:02.574 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:23:02.574 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.630 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:23:02.631 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:23:02.631 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.668 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:23:02.669 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:23:02.669 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.726 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:23:02.726 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:23:02.726 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:23:02.727 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.755 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:23:02.755 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T12:23:02.755 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.824 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T12:23:02.824 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:23:02.824 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:23:02.824 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.876 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:23:02.876 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T12:23:02.876 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.929 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T12:23:02.929 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T12:23:02.929 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:23:02.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-26T12:23:02.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-26T12:23:02.982 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T12:23:02.982 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:23:02.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T12:23:03.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T12:23:03.052 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:23:03.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:23:03.177 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:23:03.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T12:23:03.345 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:23:03.548 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:23:03.549 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/data/mon.a.tgz 2024-04-26T12:23:03.549 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2024-04-26T12:23:03.568 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.KG7iR6NZXm 2024-04-26T12:23:03.568 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KG7iR6NZXm 2024-04-26T12:23:03.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.KG7iR6NZXm 2024-04-26T12:23:03.819 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.KG7iR6NZXm is 451KB 2024-04-26T12:23:03.917 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.KG7iR6NZXm 2024-04-26T12:23:03.931 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/data/mon.b.tgz 2024-04-26T12:23:03.932 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2024-04-26T12:23:03.985 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.0ju2snRenY 2024-04-26T12:23:03.985 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0ju2snRenY 2024-04-26T12:23:04.171 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.0ju2snRenY 2024-04-26T12:23:04.252 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.0ju2snRenY is 609KB 2024-04-26T12:23:04.355 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.0ju2snRenY 2024-04-26T12:23:04.369 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/data/mon.c.tgz 2024-04-26T12:23:04.369 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2024-04-26T12:23:04.423 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.dtEZPLVfAG 2024-04-26T12:23:04.423 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dtEZPLVfAG 2024-04-26T12:23:04.610 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.dtEZPLVfAG 2024-04-26T12:23:04.691 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.dtEZPLVfAG is 609KB 2024-04-26T12:23:04.762 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.dtEZPLVfAG 2024-04-26T12:23:04.777 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:23:04.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:23:04.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:23:04.822 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:23:04.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:23:04.864 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T12:23:04.864 DEBUG:teuthology.orchestra.run.smithi069:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:23:04.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:23:04.888 DEBUG:teuthology.orchestra.run.smithi113:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:23:04.904 INFO:teuthology.orchestra.run.smithi069.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:23:04.906 DEBUG:teuthology.orchestra.run.smithi172:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:23:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:23:04.936 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:23:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:23:04.944 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:23:04.945 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi069/crash 2024-04-26T12:23:04.946 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:23:04.971 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi070/crash 2024-04-26T12:23:04.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:23:05.121 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi113/crash 2024-04-26T12:23:05.122 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:23:05.157 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi172/crash 2024-04-26T12:23:05.158 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:23:05.276 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:23:05.277 DEBUG:teuthology.orchestra.run.smithi069:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:23:05.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:23:05.282 DEBUG:teuthology.orchestra.run.smithi113:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:23:05.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:23:07.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-26T12:23:07.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-26T12:23:57.601 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:23:57.602 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi069/log 2024-04-26T12:23:57.603 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:23:57.938 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi070/log 2024-04-26T12:23:57.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:24:04.364 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi113/log 2024-04-26T12:24:04.366 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:24:04.529 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi172/log 2024-04-26T12:24:04.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:24:10.372 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:24:10.386 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:24:10.386 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:24:10.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:24:10.392 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:24:10.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:24:10.528 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:24:10.537 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:24:10.537 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:24:10.540 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:24:10.542 DEBUG:teuthology.orchestra.run.smithi113:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:24:10.546 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:24:10.554 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:24:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:24:10.558 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:24:10.558 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-04-26T12:24:10.558 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +742us[ +771us] +/- 63ms 2024-04-26T12:24:10.558 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -1271us[-1241us] +/- 82ms 2024-04-26T12:24:10.558 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +229us[ +229us] +/- 75ms 2024-04-26T12:24:10.558 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:24:10.562 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:24:10.562 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:24:10.563 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:24:10.563 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-04-26T12:24:10.563 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +789us[ +795us] +/- 63ms 2024-04-26T12:24:10.563 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -1220us[-1220us] +/- 82ms 2024-04-26T12:24:10.563 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +258us[ +258us] +/- 75ms 2024-04-26T12:24:10.564 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:24:10.564 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:24:10.565 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2024-04-26T12:24:10.565 INFO:teuthology.orchestra.run.smithi113.stdout:^* hv01.front.sepia.ceph.com 3 6 177 38 +756us[ +754us] +/- 63ms 2024-04-26T12:24:10.565 INFO:teuthology.orchestra.run.smithi113.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 38 -1247us[-1249us] +/- 83ms 2024-04-26T12:24:10.565 INFO:teuthology.orchestra.run.smithi113.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 37 +237us[ +237us] +/- 75ms 2024-04-26T12:24:10.565 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:24:10.566 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:24:10.566 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-26T12:24:10.566 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +771us[ +779us] +/- 63ms 2024-04-26T12:24:10.566 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -1231us[-1222us] +/- 82ms 2024-04-26T12:24:10.566 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +231us[ +239us] +/- 75ms 2024-04-26T12:24:10.567 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:24:10.567 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:24:10.581 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:24:10.582 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:24:10.602 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:24:10.668 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:24:10.737 DEBUG:teuthology.orchestra.run.smithi113:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:24:10.875 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:24:10.944 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:24:10.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:10.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:24:11.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:11.006 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:24:11.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:11.035 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:24:11.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:11.064 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:24:11.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:24:11.123 INFO:teuthology.task.internal:Duration was 928.753158 seconds 2024-04-26T12:24:11.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:24:11.153 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:24:11.154 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:24:11.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:24:11.159 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:24:11.161 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:24:11.196 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:24:11.199 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:24:11.199 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:24:11.224 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:24:11.670 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:24:11.670 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2024-04-26T12:24:11.670 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:24:11.694 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-04-26T12:24:11.694 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:24:11.725 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi113.front.sepia.ceph.com 2024-04-26T12:24:11.725 DEBUG:teuthology.orchestra.run.smithi113:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:24:11.761 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T12:24:11.761 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:24:11.793 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:24:11.793 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:24:11.798 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:24:11.801 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:24:11.804 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:24:11.859 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:24:11.860 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:24:11.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:24:11.870 DEBUG:teuthology.orchestra.run.smithi113:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:24:11.874 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:24:12.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:24:12.015 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:24:12.015 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:24:12.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:24:12.063 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:24:12.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:24:12.114 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:24:12.125 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.132 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.147 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2024-04-26T12:24:12.149 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-04-26T12:24:12.171 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = core 2024-04-26T12:24:12.176 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-04-26T12:24:12.199 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:12.244 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:12.258 DEBUG:teuthology.orchestra.run.smithi113:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:12.272 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:24:12.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:12.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:24:12.297 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:24:12.298 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi069 2024-04-26T12:24:12.298 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:24:12.329 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi070 2024-04-26T12:24:12.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:24:12.362 DEBUG:teuthology.misc:Transferring archived files from smithi113:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi113 2024-04-26T12:24:12.362 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:24:12.392 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674210/remote/smithi172 2024-04-26T12:24:12.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:24:12.425 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:24:12.425 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:24:12.427 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:24:12.430 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:24:12.432 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:24:12.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:24:12.487 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:24:12.487 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:24:12.511 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:24:12.511 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:24:12.514 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:24:12.516 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:24:12.518 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:24:12.525 INFO:teuthology.orchestra.run.smithi069.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:24 /home/ubuntu/cephtest 2024-04-26T12:24:12.528 INFO:teuthology.orchestra.run.smithi070.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:24 /home/ubuntu/cephtest 2024-04-26T12:24:12.530 INFO:teuthology.orchestra.run.smithi113.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:24 /home/ubuntu/cephtest 2024-04-26T12:24:12.532 INFO:teuthology.orchestra.run.smithi172.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:24 /home/ubuntu/cephtest 2024-04-26T12:24:12.533 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:24:12.544 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:24:12.616 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/admin_socket_objecter_requests thrashosds-health} duration: 928.7531578540802 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T12:24:12.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:24:12.699 INFO:teuthology.run:pass